[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:00:49.554561  7283 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.28.254:34595
I20260709 13:00:49.556183  7283 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:00:49.557276  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:49.574252  7289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:49.574226  7292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:49.574227  7290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:50.776575  7291 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:00:50.776783  7283 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:00:50.780634  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:50.780877  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:50.781028  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602050781012 us; error 0 us; skew 500 ppm
I20260709 13:00:50.781857  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:50.787206  7283 webserver.cc:533] Webserver started at http://127.7.28.254:46015/ using document root <none> and password file <none>
I20260709 13:00:50.788035  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:50.788220  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:50.788630  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:50.794412  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/master-0-root/instance:
uuid: "7c435cd168624abaa38a341708e352c0"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-ll1f"
I20260709 13:00:50.802208  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:00:50.807696  7298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:50.808911  7283 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:00:50.809285  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/master-0-root
uuid: "7c435cd168624abaa38a341708e352c0"
format_stamp: "Formatted at 2026-07-09 13:00:50 on dist-test-slave-ll1f"
I20260709 13:00:50.809645  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:50.872076  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:50.873617  7283 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:00:50.874128  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:50.947171  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.254:34595
I20260709 13:00:50.947245  7349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.254:34595 every 8 connection(s)
I20260709 13:00:50.954947  7350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:50.976244  7350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0: Bootstrap starting.
I20260709 13:00:50.982156  7350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.984037  7350 log.cc:826] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0: Log is configured to *not* fsync() on all Append() calls
I20260709 13:00:50.988694  7350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0: No bootstrap required, opened a new log
I20260709 13:00:51.009734  7350 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c435cd168624abaa38a341708e352c0" member_type: VOTER }
I20260709 13:00:51.010385  7350 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.010736  7350 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c435cd168624abaa38a341708e352c0, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.011653  7350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c435cd168624abaa38a341708e352c0" member_type: VOTER }
I20260709 13:00:51.012166  7350 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:51.012470  7350 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:51.012827  7350 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.017006  7350 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c435cd168624abaa38a341708e352c0" member_type: VOTER }
I20260709 13:00:51.017808  7350 leader_election.cc:304] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c435cd168624abaa38a341708e352c0; no voters: 
I20260709 13:00:51.019542  7350 leader_election.cc:290] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:51.019912  7353 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:51.022233  7353 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 1 LEADER]: Becoming Leader. State: Replica: 7c435cd168624abaa38a341708e352c0, State: Running, Role: LEADER
I20260709 13:00:51.023238  7353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c435cd168624abaa38a341708e352c0" member_type: VOTER }
I20260709 13:00:51.024248  7350 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:51.035032  7354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c435cd168624abaa38a341708e352c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c435cd168624abaa38a341708e352c0" member_type: VOTER } }
I20260709 13:00:51.035108  7355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c435cd168624abaa38a341708e352c0. Latest consensus state: current_term: 1 leader_uuid: "7c435cd168624abaa38a341708e352c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c435cd168624abaa38a341708e352c0" member_type: VOTER } }
I20260709 13:00:51.035876  7355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:51.035821  7354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:51.039677  7363 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:51.051911  7363 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:51.054767  7283 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:51.070541  7363 catalog_manager.cc:1383] Generated new cluster ID: 20ed013b68dd4f23ab7c939e56b21028
I20260709 13:00:51.070925  7363 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:51.102254  7363 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:51.103842  7363 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:51.117684  7363 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0: Generated new TSK 0
I20260709 13:00:51.118670  7363 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:51.185772  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:51.194924  7372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:51.196951  7373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:51.200296  7375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:51.200582  7283 server_base.cc:1061] running on GCE node
I20260709 13:00:51.201475  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:51.201706  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:51.201969  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602051201932 us; error 0 us; skew 500 ppm
I20260709 13:00:51.202683  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:51.207376  7283 webserver.cc:533] Webserver started at http://127.7.28.193:33995/ using document root <none> and password file <none>
I20260709 13:00:51.207983  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:51.208200  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:51.208506  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:51.209651  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-0-root/instance:
uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
format_stamp: "Formatted at 2026-07-09 13:00:51 on dist-test-slave-ll1f"
I20260709 13:00:51.215734  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:00:51.220397  7380 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.221264  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:00:51.221623  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
format_stamp: "Formatted at 2026-07-09 13:00:51 on dist-test-slave-ll1f"
I20260709 13:00:51.222026  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:51.245494  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:51.247326  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:51.250208  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:51.255740  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:51.256053  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.256361  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:51.256582  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.347697  7442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:45277 every 8 connection(s)
I20260709 13:00:51.347687  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:45277
I20260709 13:00:51.356323  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:51.371407  7447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:51.374495  7448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:51.389165  7283 server_base.cc:1061] running on GCE node
W20260709 13:00:51.389772  7450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:51.390939  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:51.391235  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:51.391443  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602051391426 us; error 0 us; skew 500 ppm
I20260709 13:00:51.392259  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:51.396512  7283 webserver.cc:533] Webserver started at http://127.7.28.194:35487/ using document root <none> and password file <none>
I20260709 13:00:51.397200  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:51.397450  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:51.397825  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:51.398222  7443 heartbeater.cc:344] Connected to a master server at 127.7.28.254:34595
I20260709 13:00:51.398699  7443 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:51.399308  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-1-root/instance:
uuid: "deb6f45d505f4393a368cddcde226c37"
format_stamp: "Formatted at 2026-07-09 13:00:51 on dist-test-slave-ll1f"
I20260709 13:00:51.399852  7443 heartbeater.cc:507] Master 127.7.28.254:34595 requested a full tablet report, sending...
I20260709 13:00:51.403501  7315 ts_manager.cc:194] Registered new tserver with Master: a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277)
I20260709 13:00:51.405431  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:00:51.406853  7315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42104
I20260709 13:00:51.409973  7455 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.410972  7283 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:00:51.411262  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-1-root
uuid: "deb6f45d505f4393a368cddcde226c37"
format_stamp: "Formatted at 2026-07-09 13:00:51 on dist-test-slave-ll1f"
I20260709 13:00:51.411532  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:51.427955  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:51.429200  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:51.431353  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:51.434649  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:51.434885  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.435119  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:51.435299  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.533595  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.194:36269
I20260709 13:00:51.533907  7517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.194:36269 every 8 connection(s)
I20260709 13:00:51.540295  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:51.549299  7521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:51.555893  7518 heartbeater.cc:344] Connected to a master server at 127.7.28.254:34595
I20260709 13:00:51.556332  7518 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:51.557426  7518 heartbeater.cc:507] Master 127.7.28.254:34595 requested a full tablet report, sending...
W20260709 13:00:51.559379  7524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:51.559461  7283 server_base.cc:1061] running on GCE node
I20260709 13:00:51.560217  7315 ts_manager.cc:194] Registered new tserver with Master: deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:51.562106  7315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42110
W20260709 13:00:51.565775  7522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:51.567234  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:51.567531  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:51.567778  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602051567757 us; error 0 us; skew 500 ppm
I20260709 13:00:51.568404  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:51.571462  7283 webserver.cc:533] Webserver started at http://127.7.28.195:42753/ using document root <none> and password file <none>
I20260709 13:00:51.571954  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:51.572139  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:51.572415  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:51.573410  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-2-root/instance:
uuid: "9e6feb8699754c389392df847f556cf3"
format_stamp: "Formatted at 2026-07-09 13:00:51 on dist-test-slave-ll1f"
I20260709 13:00:51.578007  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:00:51.581723  7529 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.582720  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:00:51.583079  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-2-root
uuid: "9e6feb8699754c389392df847f556cf3"
format_stamp: "Formatted at 2026-07-09 13:00:51 on dist-test-slave-ll1f"
I20260709 13:00:51.583456  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602049386691-7283-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:51.601372  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:51.603091  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:51.605628  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:51.609449  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:51.609742  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.610064  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:51.610281  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:51.699035  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.195:42725
I20260709 13:00:51.699085  7591 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.195:42725 every 8 connection(s)
I20260709 13:00:51.717531  7592 heartbeater.cc:344] Connected to a master server at 127.7.28.254:34595
I20260709 13:00:51.718004  7592 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:51.718940  7592 heartbeater.cc:507] Master 127.7.28.254:34595 requested a full tablet report, sending...
I20260709 13:00:51.720908  7315 ts_manager.cc:194] Registered new tserver with Master: 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:51.721499  7283 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016272799s
I20260709 13:00:51.722647  7315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42124
I20260709 13:00:51.771488  7315 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42128:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:51.775094  7315 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:51.883245  7557 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2c608bc3864dd0b45393b8f0b652e7 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:51.885078  7557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2c608bc3864dd0b45393b8f0b652e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.897948  7556 tablet_service.cc:1511] Processing CreateTablet for tablet f379ecb9a89043afa633f851883332f3 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:51.898226  7555 tablet_service.cc:1511] Processing CreateTablet for tablet 309a3e144228404182437dfa7ce9e47b (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:51.899358  7556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f379ecb9a89043afa633f851883332f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.900941  7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309a3e144228404182437dfa7ce9e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.901566  7554 tablet_service.cc:1511] Processing CreateTablet for tablet 674cc72587aa491da78b367bfc456c43 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:51.904352  7554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674cc72587aa491da78b367bfc456c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.907641  7551 tablet_service.cc:1511] Processing CreateTablet for tablet 7d702a5f90e84362b6e361346cc27809 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:51.906082  7552 tablet_service.cc:1511] Processing CreateTablet for tablet ac4672e8ed904cce9fed3552436b2a29 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:51.917762  7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d702a5f90e84362b6e361346cc27809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.917460  7553 tablet_service.cc:1511] Processing CreateTablet for tablet b9e0054161d74c2da4a1edcff37b7c70 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:51.929822  7483 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2c608bc3864dd0b45393b8f0b652e7 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:51.925657  7481 tablet_service.cc:1511] Processing CreateTablet for tablet 309a3e144228404182437dfa7ce9e47b (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:51.915894  7550 tablet_service.cc:1511] Processing CreateTablet for tablet 91593f09a0c444c0b44986e4f55879cf (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:51.939563  7549 tablet_service.cc:1511] Processing CreateTablet for tablet af3cb382010c48d78a171421cb528b01 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:51.926923  7482 tablet_service.cc:1511] Processing CreateTablet for tablet f379ecb9a89043afa633f851883332f3 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:51.943084  7552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4672e8ed904cce9fed3552436b2a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.942276  7407 tablet_service.cc:1511] Processing CreateTablet for tablet f379ecb9a89043afa633f851883332f3 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:51.948067  7483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2c608bc3864dd0b45393b8f0b652e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.942211  7408 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2c608bc3864dd0b45393b8f0b652e7 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:51.943198  7479 tablet_service.cc:1511] Processing CreateTablet for tablet b9e0054161d74c2da4a1edcff37b7c70 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:51.954428  7480 tablet_service.cc:1511] Processing CreateTablet for tablet 674cc72587aa491da78b367bfc456c43 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:51.956404  7481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309a3e144228404182437dfa7ce9e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.956012  7553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e0054161d74c2da4a1edcff37b7c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.960249  7404 tablet_service.cc:1511] Processing CreateTablet for tablet b9e0054161d74c2da4a1edcff37b7c70 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:51.962802  7407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f379ecb9a89043afa633f851883332f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.959360  7478 tablet_service.cc:1511] Processing CreateTablet for tablet ac4672e8ed904cce9fed3552436b2a29 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:51.966519  7405 tablet_service.cc:1511] Processing CreateTablet for tablet 674cc72587aa491da78b367bfc456c43 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:51.958084  7406 tablet_service.cc:1511] Processing CreateTablet for tablet 309a3e144228404182437dfa7ce9e47b (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:51.968501  7479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e0054161d74c2da4a1edcff37b7c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.961730  7477 tablet_service.cc:1511] Processing CreateTablet for tablet 7d702a5f90e84362b6e361346cc27809 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:51.969755  7549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3cb382010c48d78a171421cb528b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.965947  7476 tablet_service.cc:1511] Processing CreateTablet for tablet 91593f09a0c444c0b44986e4f55879cf (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:51.974370  7475 tablet_service.cc:1511] Processing CreateTablet for tablet af3cb382010c48d78a171421cb528b01 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:51.974400  7403 tablet_service.cc:1511] Processing CreateTablet for tablet ac4672e8ed904cce9fed3552436b2a29 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:51.980367  7482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f379ecb9a89043afa633f851883332f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.981072  7408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2c608bc3864dd0b45393b8f0b652e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.984056  7480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674cc72587aa491da78b367bfc456c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.985904  7405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674cc72587aa491da78b367bfc456c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.986174  7475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3cb382010c48d78a171421cb528b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.988124  7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91593f09a0c444c0b44986e4f55879cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.989629  7403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4672e8ed904cce9fed3552436b2a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.990839  7476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91593f09a0c444c0b44986e4f55879cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:51.988570  7402 tablet_service.cc:1511] Processing CreateTablet for tablet 7d702a5f90e84362b6e361346cc27809 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:51.998327  7401 tablet_service.cc:1511] Processing CreateTablet for tablet 91593f09a0c444c0b44986e4f55879cf (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:52.000382  7406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309a3e144228404182437dfa7ce9e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.012982  7477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d702a5f90e84362b6e361346cc27809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.033048  7404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e0054161d74c2da4a1edcff37b7c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.034951  7400 tablet_service.cc:1511] Processing CreateTablet for tablet af3cb382010c48d78a171421cb528b01 (DEFAULT_TABLE table=test-workload [id=8a29fde15cbb4e7287b6fb6cfbf6dc2f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:52.036944  7478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4672e8ed904cce9fed3552436b2a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.038383  7401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91593f09a0c444c0b44986e4f55879cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:52.046522  7362 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:52.051628  7402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d702a5f90e84362b6e361346cc27809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.055737  7400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3cb382010c48d78a171421cb528b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.102178  7610 tablet_bootstrap.cc:492] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
I20260709 13:00:52.169586  7610 tablet_bootstrap.cc:654] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.259845  7612 tablet_bootstrap.cc:492] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:52.276969  7611 tablet_bootstrap.cc:492] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
W20260709 13:00:52.291558  7598 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.7.28.254:34595, user_credentials={real_user=slave}} blocked reactor thread for 79817.2us
I20260709 13:00:52.294644  7612 tablet_bootstrap.cc:654] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.298718  7610 tablet_bootstrap.cc:492] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:52.299235  7610 ts_tablet_manager.cc:1403] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.224s	user 0.013s	sys 0.007s
I20260709 13:00:52.302845  7611 tablet_bootstrap.cc:654] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.302616  7610 raft_consensus.cc:359] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.303606  7610 raft_consensus.cc:385] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.304066  7610 raft_consensus.cc:740] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.304967  7610 consensus_queue.cc:260] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.314102  7611 tablet_bootstrap.cc:492] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:52.314385  7612 tablet_bootstrap.cc:492] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:52.314637  7611 ts_tablet_manager.cc:1403] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.012s
I20260709 13:00:52.315003  7612 ts_tablet_manager.cc:1403] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.007s
I20260709 13:00:52.317823  7611 raft_consensus.cc:359] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.318607  7611 raft_consensus.cc:385] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.318920  7611 raft_consensus.cc:740] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.319082  7612 raft_consensus.cc:359] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.320151  7612 raft_consensus.cc:385] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.320006  7611 consensus_queue.cc:260] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.320614  7612 raft_consensus.cc:740] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.321830  7612 consensus_queue.cc:260] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.323820  7610 ts_tablet_manager.cc:1434] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.012s
I20260709 13:00:52.323910  7592 heartbeater.cc:499] Master 127.7.28.254:34595 was elected leader, sending a full tablet report...
I20260709 13:00:52.325075  7610 tablet_bootstrap.cc:492] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
I20260709 13:00:52.333168  7610 tablet_bootstrap.cc:654] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.338621  7616 raft_consensus.cc:493] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.339148  7616 raft_consensus.cc:515] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.339815  7612 ts_tablet_manager.cc:1434] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:00:52.340878  7518 heartbeater.cc:499] Master 127.7.28.254:34595 was elected leader, sending a full tablet report...
I20260709 13:00:52.341363  7612 tablet_bootstrap.cc:492] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:52.342658  7616 leader_election.cc:290] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:52.350476  7612 tablet_bootstrap.cc:654] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.365077  7612 tablet_bootstrap.cc:492] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:52.365813  7612 ts_tablet_manager.cc:1403] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:00:52.375077  7443 heartbeater.cc:499] Master 127.7.28.254:34595 was elected leader, sending a full tablet report...
I20260709 13:00:52.371376  7611 ts_tablet_manager.cc:1434] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.056s	user 0.013s	sys 0.004s
I20260709 13:00:52.380771  7611 tablet_bootstrap.cc:492] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
I20260709 13:00:52.382797  7612 raft_consensus.cc:359] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.388111  7612 raft_consensus.cc:385] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.388526  7612 raft_consensus.cc:740] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.390511  7612 consensus_queue.cc:260] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.394235  7612 ts_tablet_manager.cc:1434] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:00:52.395300  7612 tablet_bootstrap.cc:492] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:52.411401  7612 tablet_bootstrap.cc:654] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.414014  7610 tablet_bootstrap.cc:492] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:52.414520  7610 ts_tablet_manager.cc:1403] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.090s	user 0.033s	sys 0.028s
I20260709 13:00:52.416810  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:52.418051  7610 raft_consensus.cc:359] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.418812  7610 raft_consensus.cc:385] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.419104  7610 raft_consensus.cc:740] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.419811  7610 consensus_queue.cc:260] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.421844  7610 ts_tablet_manager.cc:1434] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:52.422842  7610 tablet_bootstrap.cc:492] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
W20260709 13:00:52.427945  7531 leader_election.cc:343] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.433660  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:52.430922  7610 tablet_bootstrap.cc:654] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:52.435592  7531 leader_election.cc:343] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.435972  7611 tablet_bootstrap.cc:654] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.436146  7531 leader_election.cc:304] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6feb8699754c389392df847f556cf3; no voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37
I20260709 13:00:52.437525  7616 raft_consensus.cc:2749] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.452236  7610 tablet_bootstrap.cc:492] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:52.447371  7612 tablet_bootstrap.cc:492] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:52.452759  7610 ts_tablet_manager.cc:1403] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.007s
I20260709 13:00:52.453047  7612 ts_tablet_manager.cc:1403] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.015s
W20260709 13:00:52.456468  7593 tablet.cc:2406] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:52.456856  7611 tablet_bootstrap.cc:492] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:52.456665  7612 raft_consensus.cc:359] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.457345  7611 ts_tablet_manager.cc:1403] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.077s	user 0.033s	sys 0.011s
I20260709 13:00:52.457409  7612 raft_consensus.cc:385] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.457862  7612 raft_consensus.cc:740] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.458683  7610 raft_consensus.cc:359] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.458652  7612 consensus_queue.cc:260] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.459666  7610 raft_consensus.cc:385] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.460040  7610 raft_consensus.cc:740] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.460386  7611 raft_consensus.cc:359] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.461117  7611 raft_consensus.cc:385] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.460852  7610 consensus_queue.cc:260] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.461436  7611 raft_consensus.cc:740] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.461514  7612 ts_tablet_manager.cc:1434] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:52.467939  7612 tablet_bootstrap.cc:492] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:52.462390  7611 consensus_queue.cc:260] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.472785  7611 ts_tablet_manager.cc:1434] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:00:52.473881  7611 tablet_bootstrap.cc:492] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
I20260709 13:00:52.463567  7610 ts_tablet_manager.cc:1434] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 13:00:52.475399  7610 tablet_bootstrap.cc:492] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
I20260709 13:00:52.482227  7610 tablet_bootstrap.cc:654] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.487447  7611 tablet_bootstrap.cc:654] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.487773  7612 tablet_bootstrap.cc:654] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.496057  7610 tablet_bootstrap.cc:492] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:52.496587  7610 ts_tablet_manager.cc:1403] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:00:52.496897  7612 tablet_bootstrap.cc:492] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:52.497443  7612 ts_tablet_manager.cc:1403] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.004s
I20260709 13:00:52.499570  7610 raft_consensus.cc:359] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.500365  7610 raft_consensus.cc:385] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.500716  7610 raft_consensus.cc:740] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.501024  7612 raft_consensus.cc:359] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.501878  7612 raft_consensus.cc:385] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.501592  7610 consensus_queue.cc:260] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.502233  7612 raft_consensus.cc:740] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.504046  7610 ts_tablet_manager.cc:1434] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:52.504477  7611 tablet_bootstrap.cc:492] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:52.505003  7611 ts_tablet_manager.cc:1403] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.008s
I20260709 13:00:52.505187  7610 tablet_bootstrap.cc:492] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
I20260709 13:00:52.505684  7612 consensus_queue.cc:260] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.508028  7612 ts_tablet_manager.cc:1434] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.005s
I20260709 13:00:52.508347  7611 raft_consensus.cc:359] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.509132  7611 raft_consensus.cc:385] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.509512  7611 raft_consensus.cc:740] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.510759  7612 tablet_bootstrap.cc:492] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:52.518097  7612 tablet_bootstrap.cc:654] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.518749  7616 raft_consensus.cc:493] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.519321  7610 tablet_bootstrap.cc:654] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.519238  7616 raft_consensus.cc:515] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.521546  7616 leader_election.cc:290] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:52.522192  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:52.522560  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:52.523227  7611 consensus_queue.cc:260] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
W20260709 13:00:52.523794  7531 leader_election.cc:343] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:52.524466  7531 leader_election.cc:343] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.524863  7531 leader_election.cc:304] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6feb8699754c389392df847f556cf3; no voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37
I20260709 13:00:52.525566  7616 raft_consensus.cc:2749] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.525418  7611 ts_tablet_manager.cc:1434] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:00:52.527410  7611 tablet_bootstrap.cc:492] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
I20260709 13:00:52.534597  7611 tablet_bootstrap.cc:654] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.535547  7612 tablet_bootstrap.cc:492] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:52.536144  7612 ts_tablet_manager.cc:1403] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.015s
I20260709 13:00:52.539462  7612 raft_consensus.cc:359] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.540359  7612 raft_consensus.cc:385] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.541520  7612 raft_consensus.cc:740] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.544091  7612 consensus_queue.cc:260] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.547180  7612 ts_tablet_manager.cc:1434] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:00:52.548239  7612 tablet_bootstrap.cc:492] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:52.553928  7617 raft_consensus.cc:493] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.554502  7617 raft_consensus.cc:515] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.557161  7617 leader_election.cc:290] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:52.558108  7610 tablet_bootstrap.cc:492] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:52.558590  7610 ts_tablet_manager.cc:1403] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.001s
I20260709 13:00:52.560045  7612 tablet_bootstrap.cc:654] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.562217  7610 raft_consensus.cc:359] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.565865  7610 raft_consensus.cc:385] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.566303  7610 raft_consensus.cc:740] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.567368  7610 consensus_queue.cc:260] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.570107  7610 ts_tablet_manager.cc:1434] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:00:52.571902  7610 tablet_bootstrap.cc:492] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
I20260709 13:00:52.573101  7611 tablet_bootstrap.cc:492] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:52.573580  7611 ts_tablet_manager.cc:1403] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.021s
I20260709 13:00:52.576963  7611 raft_consensus.cc:359] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.580050  7612 tablet_bootstrap.cc:492] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:52.577692  7611 raft_consensus.cc:385] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.585659  7618 raft_consensus.cc:493] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.585825  7611 raft_consensus.cc:740] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.586530  7618 raft_consensus.cc:515] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.587270  7612 ts_tablet_manager.cc:1403] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.003s
I20260709 13:00:52.586957  7611 consensus_queue.cc:260] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.597801  7618 leader_election.cc:290] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.598626  7612 raft_consensus.cc:359] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.599414  7612 raft_consensus.cc:385] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.599720  7612 raft_consensus.cc:740] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.600448  7610 tablet_bootstrap.cc:654] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.600471  7612 consensus_queue.cc:260] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.608790  7611 ts_tablet_manager.cc:1434] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:00:52.611680  7611 tablet_bootstrap.cc:492] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
I20260709 13:00:52.631564  7612 ts_tablet_manager.cc:1434] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 13:00:52.633452  7612 tablet_bootstrap.cc:492] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:52.640465  7610 tablet_bootstrap.cc:492] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:52.642518  7611 tablet_bootstrap.cc:654] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.647315  7610 ts_tablet_manager.cc:1403] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.016s
I20260709 13:00:52.650092  7612 tablet_bootstrap.cc:654] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.650596  7610 raft_consensus.cc:359] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.651418  7610 raft_consensus.cc:385] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.651741  7610 raft_consensus.cc:740] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.652530  7610 consensus_queue.cc:260] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.654944  7610 ts_tablet_manager.cc:1434] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:00:52.655874  7610 tablet_bootstrap.cc:492] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
I20260709 13:00:52.666265  7616 raft_consensus.cc:493] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.666769  7616 raft_consensus.cc:515] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.668632  7616 leader_election.cc:290] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:52.670812  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3cb382010c48d78a171421cb528b01" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:52.670850  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3cb382010c48d78a171421cb528b01" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:52.671758  7493 raft_consensus.cc:2468] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 0.
W20260709 13:00:52.672421  7531 leader_election.cc:343] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.673657  7531 leader_election.cc:304] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:52.676894  7616 raft_consensus.cc:2804] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.677386  7616 raft_consensus.cc:493] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.677809  7616 raft_consensus.cc:3060] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.678431  7611 tablet_bootstrap.cc:492] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:52.678948  7611 ts_tablet_manager.cc:1403] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.003s
I20260709 13:00:52.680598  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
W20260709 13:00:52.682536  7382 leader_election.cc:343] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.687991  7611 raft_consensus.cc:359] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.688838  7611 raft_consensus.cc:385] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.689146  7611 raft_consensus.cc:740] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.689941  7611 consensus_queue.cc:260] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.692317  7610 tablet_bootstrap.cc:654] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.693804  7567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:52.694060  7616 raft_consensus.cc:515] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.694622  7567 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 0.
I20260709 13:00:52.696171  7382 leader_election.cc:304] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: deb6f45d505f4393a368cddcde226c37
I20260709 13:00:52.697762  7617 raft_consensus.cc:2804] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.701853  7617 raft_consensus.cc:493] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.702307  7617 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.711654  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3cb382010c48d78a171421cb528b01" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
W20260709 13:00:52.713898  7531 leader_election.cc:343] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.714069  7616 leader_election.cc:290] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:52.719492  7618 raft_consensus.cc:493] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.719543  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3cb382010c48d78a171421cb528b01" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:52.720232  7493 raft_consensus.cc:3060] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.720129  7618 raft_consensus.cc:515] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.720685  7611 ts_tablet_manager.cc:1434] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 13:00:52.723685  7611 tablet_bootstrap.cc:492] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
I20260709 13:00:52.723086  7617 raft_consensus.cc:515] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.724017  7618 leader_election.cc:290] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.726250  7617 leader_election.cc:290] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Requested vote from peers 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:52.734942  7567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:52.733218  7493 raft_consensus.cc:2468] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 1.
I20260709 13:00:52.735559  7567 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.738790  7492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:52.740907  7531 leader_election.cc:304] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:52.742118  7616 raft_consensus.cc:2804] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.744575  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3cb382010c48d78a171421cb528b01" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:52.748096  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f379ecb9a89043afa633f851883332f3" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:52.754849  7618 raft_consensus.cc:493] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.757356  7457 leader_election.cc:343] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.755537  7618 raft_consensus.cc:515] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
W20260709 13:00:52.757673  7382 leader_election.cc:343] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.759543  7567 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 1.
I20260709 13:00:52.759624  7618 leader_election.cc:290] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
W20260709 13:00:52.758144  7457 leader_election.cc:343] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.755292  7643 raft_consensus.cc:493] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.759462  7611 tablet_bootstrap.cc:654] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.760949  7382 leader_election.cc:304] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: deb6f45d505f4393a368cddcde226c37
I20260709 13:00:52.762440  7617 raft_consensus.cc:2804] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.761636  7612 tablet_bootstrap.cc:492] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:52.766867  7612 ts_tablet_manager.cc:1403] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.134s	user 0.005s	sys 0.025s
I20260709 13:00:52.767969  7567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3cb382010c48d78a171421cb528b01" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:52.768538  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f379ecb9a89043afa633f851883332f3" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:52.773665  7566 raft_consensus.cc:2468] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 0.
I20260709 13:00:52.769675  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:52.775134  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:52.775197  7565 raft_consensus.cc:2468] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 0.
I20260709 13:00:52.763833  7643 raft_consensus.cc:515] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.775401  7457 leader_election.cc:304] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:52.771317  7616 raft_consensus.cc:697] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 1 LEADER]: Becoming Leader. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:00:52.784991  7457 leader_election.cc:304] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:52.782744  7618 raft_consensus.cc:2804] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.790161  7618 raft_consensus.cc:493] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.782969  7617 raft_consensus.cc:697] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:52.790815  7618 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.791466  7610 tablet_bootstrap.cc:492] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:52.795348  7610 ts_tablet_manager.cc:1403] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.140s	user 0.028s	sys 0.020s
I20260709 13:00:52.785137  7616 consensus_queue.cc:237] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.776134  7418 raft_consensus.cc:2468] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 0.
I20260709 13:00:52.798031  7645 raft_consensus.cc:493] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.800885  7645 raft_consensus.cc:515] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.802304  7617 consensus_queue.cc:237] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.812014  7643 leader_election.cc:290] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.818397  7645 leader_election.cc:290] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.816601  7610 raft_consensus.cc:359] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.820513  7649 raft_consensus.cc:493] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.821307  7610 raft_consensus.cc:385] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.821976  7610 raft_consensus.cc:740] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.822587  7647 raft_consensus.cc:2804] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.823036  7647 raft_consensus.cc:493] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.823380  7647 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.823182  7610 consensus_queue.cc:260] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.826337  7610 ts_tablet_manager.cc:1434] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:00:52.826185  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:52.827428  7610 tablet_bootstrap.cc:492] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
I20260709 13:00:52.828042  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:52.828635  7566 raft_consensus.cc:2468] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 0.
I20260709 13:00:52.822057  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:52.829879  7565 raft_consensus.cc:2468] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 0.
I20260709 13:00:52.825439  7492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:52.820581  7612 raft_consensus.cc:359] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.841744  7382 leader_election.cc:304] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 
I20260709 13:00:52.842630  7645 raft_consensus.cc:2804] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:52.842794  7382 leader_election.cc:343] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.843052  7645 raft_consensus.cc:493] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.821123  7649 raft_consensus.cc:515] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.843549  7645 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.851459  7643 raft_consensus.cc:493] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.852429  7618 raft_consensus.cc:515] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.852558  7643 raft_consensus.cc:515] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.846065  7612 raft_consensus.cc:385] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.855667  7382 leader_election.cc:304] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: deb6f45d505f4393a368cddcde226c37
I20260709 13:00:52.857318  7618 leader_election.cc:290] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.858172  7612 raft_consensus.cc:740] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.859917  7646 raft_consensus.cc:2804] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.860332  7646 raft_consensus.cc:493] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.860704  7646 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.860443  7612 consensus_queue.cc:260] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:52.861151  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
W20260709 13:00:52.863322  7457 leader_election.cc:343] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.858544  7643 leader_election.cc:290] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.857704  7649 leader_election.cc:290] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.863337  7612 ts_tablet_manager.cc:1434] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.003s
I20260709 13:00:52.866861  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f379ecb9a89043afa633f851883332f3" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:52.867909  7492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:52.869998  7565 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.870301  7492 raft_consensus.cc:2468] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 0.
I20260709 13:00:52.873330  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:52.875233  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f379ecb9a89043afa633f851883332f3" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:52.881309  7612 tablet_bootstrap.cc:492] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:52.882905  7610 tablet_bootstrap.cc:654] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.885354  7611 tablet_bootstrap.cc:492] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:52.885849  7611 ts_tablet_manager.cc:1403] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.003s
I20260709 13:00:52.888882  7611 raft_consensus.cc:359] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.880424  7646 raft_consensus.cc:515] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
W20260709 13:00:52.890959  7457 leader_election.cc:343] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:52.892163  7382 leader_election.cc:343] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.893394  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:52.893183  7645 raft_consensus.cc:515] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.894829  7418 raft_consensus.cc:2468] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 0.
I20260709 13:00:52.892621  7611 raft_consensus.cc:385] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.895347  7646 leader_election.cc:290] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Requested vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.895649  7611 raft_consensus.cc:740] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.896008  7645 leader_election.cc:290] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Requested vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.896746  7382 leader_election.cc:304] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 9e6feb8699754c389392df847f556cf3
I20260709 13:00:52.896504  7611 consensus_queue.cc:260] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.880414  7565 raft_consensus.cc:2468] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 1.
I20260709 13:00:52.898213  7645 raft_consensus.cc:2804] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.889678  7312 catalog_manager.cc:5697] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 1 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.900271  7492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:52.899402  7645 raft_consensus.cc:493] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.901572  7645 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.905999  7457 leader_election.cc:304] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deb6f45d505f4393a368cddcde226c37; no voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:52.906953  7649 raft_consensus.cc:2749] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.904165  7647 raft_consensus.cc:515] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.907541  7457 leader_election.cc:304] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:52.907413  7314 catalog_manager.cc:5697] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e6feb8699754c389392df847f556cf3 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "9e6feb8699754c389392df847f556cf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.908689  7493 raft_consensus.cc:2393] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in current term 1: Already voted for candidate deb6f45d505f4393a368cddcde226c37 in this term.
I20260709 13:00:52.908532  7649 raft_consensus.cc:2804] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.911388  7649 raft_consensus.cc:697] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:52.912945  7457 leader_election.cc:304] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 9e6feb8699754c389392df847f556cf3
I20260709 13:00:52.907233  7616 raft_consensus.cc:493] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.913899  7618 raft_consensus.cc:2804] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.913259  7649 consensus_queue.cc:237] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.915203  7618 raft_consensus.cc:493] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.915618  7618 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.919626  7611 ts_tablet_manager.cc:1434] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 13:00:52.919386  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:52.919076  7616 raft_consensus.cc:515] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.920076  7565 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.920697  7611 tablet_bootstrap.cc:492] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
I20260709 13:00:52.923924  7618 raft_consensus.cc:515] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.927335  7618 leader_election.cc:290] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.928499  7567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:52.928958  7610 tablet_bootstrap.cc:492] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:52.929431  7610 ts_tablet_manager.cc:1403] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.000s
W20260709 13:00:52.928495  7382 leader_election.cc:343] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.929260  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
W20260709 13:00:52.929984  7457 leader_election.cc:343] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.930338  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:52.929992  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:52.931962  7566 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.934072  7493 raft_consensus.cc:2393] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in current term 1: Already voted for candidate deb6f45d505f4393a368cddcde226c37 in this term.
I20260709 13:00:52.931658  7417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d702a5f90e84362b6e361346cc27809" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:52.959378  7417 raft_consensus.cc:2468] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 0.
I20260709 13:00:52.960106  7647 leader_election.cc:290] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:52.961910  7612 tablet_bootstrap.cc:654] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.961978  7567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:52.962127  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d702a5f90e84362b6e361346cc27809" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:52.961611  7645 raft_consensus.cc:515] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.967626  7418 raft_consensus.cc:2393] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate deb6f45d505f4393a368cddcde226c37 in current term 1: Already voted for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in this term.
I20260709 13:00:52.958204  7646 raft_consensus.cc:493] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.970993  7646 raft_consensus.cc:515] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.975544  7531 leader_election.cc:304] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 
I20260709 13:00:52.935259  7616 leader_election.cc:290] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:52.934180  7565 raft_consensus.cc:2468] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 1.
I20260709 13:00:52.977365  7610 raft_consensus.cc:359] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.977909  7610 raft_consensus.cc:385] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.978149  7610 raft_consensus.cc:740] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.979380  7644 raft_consensus.cc:2804] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.979794  7644 raft_consensus.cc:493] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.980144  7644 raft_consensus.cc:3060] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.978803  7611 tablet_bootstrap.cc:654] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.979230  7610 consensus_queue.cc:260] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.983453  7610 ts_tablet_manager.cc:1434] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 13:00:52.984130  7610 tablet_bootstrap.cc:492] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3: Bootstrap starting.
I20260709 13:00:52.985913  7382 leader_election.cc:304] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: deb6f45d505f4393a368cddcde226c37
I20260709 13:00:52.986707  7457 leader_election.cc:304] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deb6f45d505f4393a368cddcde226c37; no voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:52.987030  7617 raft_consensus.cc:2804] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.987470  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:52.988010  7617 raft_consensus.cc:697] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:52.988247  7418 raft_consensus.cc:2393] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate deb6f45d505f4393a368cddcde226c37 in current term 1: Already voted for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in this term.
I20260709 13:00:52.988336  7647 raft_consensus.cc:2749] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.989965  7647 raft_consensus.cc:493] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.990183  7646 leader_election.cc:290] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
W20260709 13:00:52.977228  7531 leader_election.cc:343] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.990612  7647 raft_consensus.cc:515] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.989190  7617 consensus_queue.cc:237] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:52.986361  7566 raft_consensus.cc:2468] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 1.
I20260709 13:00:53.003144  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:53.003821  7493 raft_consensus.cc:2468] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 0.
I20260709 13:00:53.004108  7611 tablet_bootstrap.cc:492] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:53.004590  7611 ts_tablet_manager.cc:1403] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.084s	user 0.005s	sys 0.014s
I20260709 13:00:53.005978  7645 leader_election.cc:290] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Requested vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:53.008523  7610 tablet_bootstrap.cc:654] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.011072  7611 raft_consensus.cc:359] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.012749  7611 raft_consensus.cc:385] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.013055  7611 raft_consensus.cc:740] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.015637  7649 raft_consensus.cc:493] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.016088  7649 raft_consensus.cc:515] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.017835  7649 leader_election.cc:290] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:53.019318  7612 tablet_bootstrap.cc:492] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:53.019719  7612 ts_tablet_manager.cc:1403] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.010s
I20260709 13:00:53.021570  7612 raft_consensus.cc:359] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.022639  7612 raft_consensus.cc:385] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.022962  7612 raft_consensus.cc:740] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.021974  7647 leader_election.cc:290] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:53.025745  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:53.027877  7567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:53.028522  7493 raft_consensus.cc:2393] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in current term 1: Already voted for candidate deb6f45d505f4393a368cddcde226c37 in this term.
I20260709 13:00:53.028426  7567 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 0.
I20260709 13:00:53.029438  7457 leader_election.cc:304] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deb6f45d505f4393a368cddcde226c37; no voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:53.024032  7612 consensus_queue.cc:260] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.026844  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:53.027513  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:53.013886  7611 consensus_queue.cc:260] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.035282  7567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:53.036141  7567 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.037250  7611 ts_tablet_manager.cc:1434] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:00:53.036330  7382 leader_election.cc:304] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:53.038298  7611 tablet_bootstrap.cc:492] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
I20260709 13:00:53.038431  7457 leader_election.cc:304] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:53.039036  7645 raft_consensus.cc:2804] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.039431  7645 raft_consensus.cc:493] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.043375  7644 raft_consensus.cc:515] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.034353  7647 raft_consensus.cc:2749] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.041446  7645 raft_consensus.cc:3060] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:53.039603  7457 leader_election.cc:343] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:53.051067  7362 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:53.041366  7649 raft_consensus.cc:2804] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.053153  7649 raft_consensus.cc:493] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.053565  7649 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.059120  7612 ts_tablet_manager.cc:1434] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:00:53.060853  7612 tablet_bootstrap.cc:492] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37: Bootstrap starting.
I20260709 13:00:53.064229  7649 raft_consensus.cc:515] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.064787  7611 tablet_bootstrap.cc:654] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.064246  7610 tablet_bootstrap.cc:492] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3: No bootstrap required, opened a new log
I20260709 13:00:53.065459  7610 ts_tablet_manager.cc:1403] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.008s
I20260709 13:00:53.060508  7382 leader_election.cc:304] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: deb6f45d505f4393a368cddcde226c37
I20260709 13:00:53.066046  7645 raft_consensus.cc:515] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
W20260709 13:00:53.066910  7382 leader_election.cc:343] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.068567  7649 leader_election.cc:290] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:53.070858  7417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:53.070789  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d702a5f90e84362b6e361346cc27809" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:53.070056  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:53.072650  7418 raft_consensus.cc:3060] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.072440  7416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:53.071627  7644 leader_election.cc:290] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:53.072772  7566 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.069185  7617 raft_consensus.cc:2804] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.079489  7416 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 0.
I20260709 13:00:53.080227  7612 tablet_bootstrap.cc:654] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.070319  7645 leader_election.cc:290] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Requested vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:53.110431  7417 raft_consensus.cc:2393] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate deb6f45d505f4393a368cddcde226c37 in current term 1: Already voted for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in this term.
I20260709 13:00:53.093887  7610 raft_consensus.cc:359] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.151749  7610 raft_consensus.cc:385] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.151592  7617 raft_consensus.cc:697] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:53.153012  7492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:53.152931  7617 consensus_queue.cc:237] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.153613  7492 raft_consensus.cc:3060] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.153820  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:53.152133  7610 raft_consensus.cc:740] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.094162  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d702a5f90e84362b6e361346cc27809" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:53.156728  7418 raft_consensus.cc:2468] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 1.
I20260709 13:00:53.158059  7531 leader_election.cc:304] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 
I20260709 13:00:53.080951  7567 raft_consensus.cc:2468] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 1.
I20260709 13:00:53.158679  7610 consensus_queue.cc:260] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.160274  7565 raft_consensus.cc:3060] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.160641  7644 raft_consensus.cc:2804] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.162427  7610 ts_tablet_manager.cc:1434] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.020s
I20260709 13:00:53.160001  7493 raft_consensus.cc:3060] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.167023  7457 leader_election.cc:304] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: deb6f45d505f4393a368cddcde226c37; no voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:53.167222  7382 leader_election.cc:304] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: deb6f45d505f4393a368cddcde226c37
I20260709 13:00:53.120596  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:53.169902  7646 raft_consensus.cc:2804] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.169927  7415 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.170503  7646 raft_consensus.cc:697] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:53.171429  7646 consensus_queue.cc:237] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.173983  7644 raft_consensus.cc:697] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 1 LEADER]: Becoming Leader. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:00:53.190836  7611 tablet_bootstrap.cc:492] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:53.191466  7611 ts_tablet_manager.cc:1403] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.010s
I20260709 13:00:53.185928  7493 raft_consensus.cc:2468] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 1.
I20260709 13:00:53.198673  7492 raft_consensus.cc:2468] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 1.
I20260709 13:00:53.199458  7649 raft_consensus.cc:2749] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.201251  7382 leader_election.cc:304] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:53.202490  7617 raft_consensus.cc:2804] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.203131  7617 raft_consensus.cc:697] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:53.202936  7611 raft_consensus.cc:359] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.203913  7611 raft_consensus.cc:385] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.204438  7611 raft_consensus.cc:740] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.204306  7617 consensus_queue.cc:237] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.205467  7611 consensus_queue.cc:260] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.186652  7644 consensus_queue.cc:237] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.207070  7566 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 1.
I20260709 13:00:53.207216  7565 raft_consensus.cc:2468] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 1.
I20260709 13:00:53.211251  7611 ts_tablet_manager.cc:1434] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:00:53.213855  7457 leader_election.cc:304] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:53.215112  7612 tablet_bootstrap.cc:492] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37: No bootstrap required, opened a new log
I20260709 13:00:53.215128  7618 raft_consensus.cc:2804] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.215651  7612 ts_tablet_manager.cc:1403] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.020s
I20260709 13:00:53.215750  7618 raft_consensus.cc:697] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:53.216734  7618 consensus_queue.cc:237] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.225446  7612 raft_consensus.cc:359] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.226608  7612 raft_consensus.cc:385] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.226855  7612 raft_consensus.cc:740] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.228552  7612 consensus_queue.cc:260] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.235374  7612 ts_tablet_manager.cc:1434] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:00:53.236181  7644 consensus_queue.cc:1048] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.238157  7415 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 1.
I20260709 13:00:53.250218  7611 tablet_bootstrap.cc:492] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Bootstrap starting.
I20260709 13:00:53.256223  7611 tablet_bootstrap.cc:654] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.290210  7312 catalog_manager.cc:5697] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e6feb8699754c389392df847f556cf3 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "9e6feb8699754c389392df847f556cf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.294242  7492 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:53.309427  7531 consensus_peers.cc:597] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 -> Peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Couldn't send request to peer a1cadc4ea6604c4083ffe46c2aa3ff4d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:53.310132  7649 raft_consensus.cc:493] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.310608  7649 raft_consensus.cc:515] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:53.311124  7617 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.313235  7649 leader_election.cc:290] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725), a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277)
I20260709 13:00:53.315604  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:53.316301  7565 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 1.
I20260709 13:00:53.316663  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" is_pre_election: true
I20260709 13:00:53.308490  7315 catalog_manager.cc:5697] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 0 to 1, leader changed from <none> to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.317654  7457 leader_election.cc:304] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:53.318954  7315 catalog_manager.cc:5697] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 0 to 1, leader changed from <none> to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.320310  7611 tablet_bootstrap.cc:492] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d: No bootstrap required, opened a new log
I20260709 13:00:53.320923  7649 raft_consensus.cc:2804] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:53.321950  7649 raft_consensus.cc:493] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1cadc4ea6604c4083ffe46c2aa3ff4d)
I20260709 13:00:53.322371  7649 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.325941  7611 ts_tablet_manager.cc:1403] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent bootstrapping tablet: real 0.076s	user 0.036s	sys 0.025s
I20260709 13:00:53.329180  7649 raft_consensus.cc:515] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:53.330407  7493 raft_consensus.cc:1240] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Rejecting Update request from peer a1cadc4ea6604c4083ffe46c2aa3ff4d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:53.331466  7611 raft_consensus.cc:359] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.332093  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:53.332257  7611 raft_consensus.cc:385] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.332700  7611 raft_consensus.cc:740] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.332701  7565 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.333675  7611 consensus_queue.cc:260] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.335860  7611 ts_tablet_manager.cc:1434] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:00:53.339713  7565 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:53.340914  7457 leader_election.cc:304] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:53.341763  7618 raft_consensus.cc:2804] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:53.341238  7314 catalog_manager.cc:5697] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 1 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.342859  7649 leader_election.cc:290] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725), a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277)
I20260709 13:00:53.343173  7566 raft_consensus.cc:1240] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Rejecting Update request from peer a1cadc4ea6604c4083ffe46c2aa3ff4d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:53.343621  7314 catalog_manager.cc:5697] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 1 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.342278  7618 raft_consensus.cc:697] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:53.345947  7645 consensus_queue.cc:1059] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.346810  7645 raft_consensus.cc:3055] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:53.347139  7645 raft_consensus.cc:740] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:53.347398  7314 catalog_manager.cc:5697] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 1 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.348026  7645 consensus_queue.cc:260] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:53.349363  7314 catalog_manager.cc:5697] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 1 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.349560  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:53.352366  7417 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.345398  7618 consensus_queue.cc:237] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:53.356878  7645 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:53.349643  7646 consensus_queue.cc:1175] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e6feb8699754c389392df847f556cf3" responder_term: 2 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1cadc4ea6604c4083ffe46c2aa3ff4d for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:53.362391  7618 consensus_queue.cc:1048] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.363338  7315 catalog_manager.cc:5697] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 1 to 2, leader changed from a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.374240  7415 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:53.381093  7647 consensus_queue.cc:1048] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.451119  7493 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.460000  7645 consensus_queue.cc:1048] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.473667  7617 consensus_queue.cc:1048] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.559163  7493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
mode: GRACEFUL
new_leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:00:53.559906  7493 raft_consensus.cc:606] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Received request to transfer leadership to TS a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:53.566437  7493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f379ecb9a89043afa633f851883332f3"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
mode: GRACEFUL
new_leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:00:53.567065  7493 raft_consensus.cc:606] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Received request to transfer leadership to TS a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:00:53.586967  7415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
mode: GRACEFUL
new_leader_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:44602
I20260709 13:00:53.587548  7415 raft_consensus.cc:606] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Received request to transfer leadership to TS deb6f45d505f4393a368cddcde226c37
I20260709 13:00:53.588085  7646 consensus_queue.cc:1048] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.604485  7663 consensus_queue.cc:1048] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.612298  7646 consensus_queue.cc:1048] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.624646  7616 consensus_queue.cc:1048] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:53.647830  7678 consensus_queue.cc:1048] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:53.655078  7646 consensus_queue.cc:1048] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:53.678992  7647 consensus_queue.cc:1048] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:53.681098  7646 consensus_queue.cc:1048] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:53.690470  7646 consensus_queue.cc:1048] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.708711  7646 consensus_queue.cc:1048] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.727936  7646 raft_consensus.cc:993] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d: : Instructing follower deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:53.728399  7646 raft_consensus.cc:1081] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Signalling peer deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:53.730146  7492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:45608
I20260709 13:00:53.730731  7492 raft_consensus.cc:493] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:53.731065  7492 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.736297  7492 raft_consensus.cc:515] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.739656  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:53.739871  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:53.740522  7566 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.746120  7492 leader_election.cc:290] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:53.748659  7415 raft_consensus.cc:3055] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:53.749078  7415 raft_consensus.cc:740] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:53.749974  7415 consensus_queue.cc:260] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.751217  7415 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.748642  7566 raft_consensus.cc:2468] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:53.758320  7457 leader_election.cc:304] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:53.759333  7678 raft_consensus.cc:2804] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:53.760023  7678 raft_consensus.cc:697] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:53.760927  7678 consensus_queue.cc:237] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.765666  7565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d702a5f90e84362b6e361346cc27809"
dest_uuid: "9e6feb8699754c389392df847f556cf3"
mode: GRACEFUL
new_leader_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:00:53.766341  7565 raft_consensus.cc:606] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 1 LEADER]: Received request to transfer leadership to TS deb6f45d505f4393a368cddcde226c37
I20260709 13:00:53.767066  7415 raft_consensus.cc:2468] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:53.773710  7315 catalog_manager.cc:5697] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 1 to 2, leader changed from a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.774452  7415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
mode: GRACEFUL
new_leader_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:44602
I20260709 13:00:53.775138  7415 raft_consensus.cc:606] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Received request to transfer leadership to TS deb6f45d505f4393a368cddcde226c37
I20260709 13:00:53.791237  7646 raft_consensus.cc:493] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.791795  7646 raft_consensus.cc:515] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.793915  7646 leader_election.cc:290] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:53.794541  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3cb382010c48d78a171421cb528b01" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb6f45d505f4393a368cddcde226c37" is_pre_election: true
I20260709 13:00:53.794904  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3cb382010c48d78a171421cb528b01" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6feb8699754c389392df847f556cf3" is_pre_election: true
I20260709 13:00:53.796247  7382 leader_election.cc:304] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37
I20260709 13:00:53.796864  7646 raft_consensus.cc:2749] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.844930  7565 raft_consensus.cc:1275] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:53.846236  7678 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.858232  7415 raft_consensus.cc:1275] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:53.862746  7678 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.869184  7678 raft_consensus.cc:993] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37: : Instructing follower a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:00:53.869642  7678 raft_consensus.cc:1081] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Signalling peer a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:00:53.872071  7417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:56150
I20260709 13:00:53.872219  7415 raft_consensus.cc:3060] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.872691  7417 raft_consensus.cc:493] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:53.873106  7417 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.877864  7417 raft_consensus.cc:515] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:53.882217  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:53.882848  7565 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.886214  7417 leader_election.cc:290] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 3 election: Requested vote from peers 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:53.886894  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:53.887933  7493 raft_consensus.cc:3055] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:53.888276  7493 raft_consensus.cc:740] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:53.889072  7493 consensus_queue.cc:260] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:53.890341  7493 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.893589  7565 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 3.
I20260709 13:00:53.894982  7382 leader_election.cc:304] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 
I20260709 13:00:53.895939  7645 raft_consensus.cc:2804] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:53.896401  7645 raft_consensus.cc:697] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:53.897197  7645 consensus_queue.cc:237] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:53.900309  7493 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 3.
I20260709 13:00:53.908835  7313 catalog_manager.cc:5697] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 2 to 3, leader changed from deb6f45d505f4393a368cddcde226c37 (127.7.28.194) to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 3 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.922114  7649 raft_consensus.cc:993] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37: : Instructing follower a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:00:53.922570  7649 raft_consensus.cc:1081] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Signalling peer a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:00:53.924189  7415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f379ecb9a89043afa633f851883332f3"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:56150
I20260709 13:00:53.924723  7415 raft_consensus.cc:493] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:53.925089  7415 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.931770  7415 raft_consensus.cc:515] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.933861  7415 leader_election.cc:290] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 2 election: Requested vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:53.934651  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f379ecb9a89043afa633f851883332f3" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:53.934926  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f379ecb9a89043afa633f851883332f3" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:53.935379  7493 raft_consensus.cc:3055] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:53.935534  7565 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.935748  7493 raft_consensus.cc:740] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:53.936601  7493 consensus_queue.cc:260] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.937510  7493 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.942191  7493 raft_consensus.cc:2468] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 2.
I20260709 13:00:53.942353  7565 raft_consensus.cc:2468] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 2.
I20260709 13:00:53.943323  7382 leader_election.cc:304] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:53.944010  7645 raft_consensus.cc:2804] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:53.945608  7645 raft_consensus.cc:697] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:53.946416  7645 consensus_queue.cc:237] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:53.952467  7313 catalog_manager.cc:5697] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 1 to 2, leader changed from deb6f45d505f4393a368cddcde226c37 (127.7.28.194) to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 2 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.089975  7644 raft_consensus.cc:993] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3: : Instructing follower deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:54.090463  7689 raft_consensus.cc:1081] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 1 LEADER]: Signalling peer deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:54.091945  7493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d702a5f90e84362b6e361346cc27809"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:00:54.092509  7493 raft_consensus.cc:493] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.092860  7493 raft_consensus.cc:3060] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.099599  7493 raft_consensus.cc:515] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:54.101632  7493 leader_election.cc:290] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:54.102451  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d702a5f90e84362b6e361346cc27809" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:54.102754  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d702a5f90e84362b6e361346cc27809" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:54.103044  7415 raft_consensus.cc:3060] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.103302  7565 raft_consensus.cc:3055] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.103622  7565 raft_consensus.cc:740] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:00:54.104413  7565 consensus_queue.cc:260] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:54.105583  7565 raft_consensus.cc:3060] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.109722  7415 raft_consensus.cc:2468] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:54.111071  7457 leader_election.cc:304] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:54.111889  7647 raft_consensus.cc:2804] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.112042  7565 raft_consensus.cc:2468] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:54.112392  7647 raft_consensus.cc:697] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:54.113260  7647 consensus_queue.cc:237] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:54.120009  7313 catalog_manager.cc:5697] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 1 to 2, leader changed from 9e6feb8699754c389392df847f556cf3 (127.7.28.195) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.196054  7617 raft_consensus.cc:993] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d: : Instructing follower deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:54.196607  7645 raft_consensus.cc:1081] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Signalling peer deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:54.198181  7493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:45608
I20260709 13:00:54.198762  7493 raft_consensus.cc:493] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.199122  7493 raft_consensus.cc:3060] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.205812  7493 raft_consensus.cc:515] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:54.207976  7493 leader_election.cc:290] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:54.208873  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:54.209159  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91593f09a0c444c0b44986e4f55879cf" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:54.209700  7415 raft_consensus.cc:3055] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.209807  7565 raft_consensus.cc:3060] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.210139  7415 raft_consensus.cc:740] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:54.211015  7415 consensus_queue.cc:260] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:54.212427  7415 raft_consensus.cc:3060] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.217572  7565 raft_consensus.cc:2468] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:54.218870  7457 leader_election.cc:304] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:54.219707  7415 raft_consensus.cc:2468] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:54.219725  7647 raft_consensus.cc:2804] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:54.220389  7647 raft_consensus.cc:697] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:54.221299  7647 consensus_queue.cc:237] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:54.227267  7415 raft_consensus.cc:1275] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:54.228662  7647 consensus_queue.cc:1048] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.230034  7313 catalog_manager.cc:5697] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 1 to 2, leader changed from a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.242408  7565 raft_consensus.cc:1275] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:54.244092  7647 consensus_queue.cc:1048] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.311004  7565 raft_consensus.cc:1275] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:54.312533  7645 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:54.324477  7493 raft_consensus.cc:1275] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:54.326527  7617 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:54.351080  7565 raft_consensus.cc:1275] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:54.352367  7617 consensus_queue.cc:1048] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.363003  7493 raft_consensus.cc:1275] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:54.364444  7617 consensus_queue.cc:1048] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.614038  7415 raft_consensus.cc:1275] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:54.615324  7647 consensus_queue.cc:1048] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.622291  7565 raft_consensus.cc:1275] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:54.623891  7678 consensus_queue.cc:1048] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.800549  7565 raft_consensus.cc:1275] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:54.802042  7678 consensus_queue.cc:1048] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.811093  7415 raft_consensus.cc:1275] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:54.812584  7703 consensus_queue.cc:1048] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:56.806697  7283 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:00:56.807479  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:56.829672  7415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
mode: GRACEFUL
new_leader_uuid: "9e6feb8699754c389392df847f556cf3"
 from {username='slave'} at 127.0.0.1:44606
I20260709 13:00:56.830325  7415 raft_consensus.cc:606] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Received request to transfer leadership to TS 9e6feb8699754c389392df847f556cf3
I20260709 13:00:56.842260  7493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
mode: GRACEFUL
new_leader_uuid: "9e6feb8699754c389392df847f556cf3"
 from {username='slave'} at 127.0.0.1:59096
I20260709 13:00:56.842778  7493 raft_consensus.cc:606] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Received request to transfer leadership to TS 9e6feb8699754c389392df847f556cf3
I20260709 13:00:56.843815  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:56.844267  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:56.969493  7709 raft_consensus.cc:993] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d: : Instructing follower 9e6feb8699754c389392df847f556cf3 to start an election
I20260709 13:00:56.969980  7709 raft_consensus.cc:1081] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Signalling peer 9e6feb8699754c389392df847f556cf3 to start an election
I20260709 13:00:56.971410  7565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b"
dest_uuid: "9e6feb8699754c389392df847f556cf3"
 from {username='slave'} at 127.0.0.1:35002
I20260709 13:00:56.971861  7565 raft_consensus.cc:493] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:56.972144  7565 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.975841  7565 raft_consensus.cc:515] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:56.977190  7565 leader_election.cc:290] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 2 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:56.978143  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:56.978329  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:56.978665  7415 raft_consensus.cc:3055] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:56.978886  7493 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.979003  7415 raft_consensus.cc:740] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:56.979708  7415 consensus_queue.cc:260] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:56.980554  7415 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.983624  7493 raft_consensus.cc:2468] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 2.
I20260709 13:00:56.984683  7531 leader_election.cc:304] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:56.984856  7415 raft_consensus.cc:2468] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 2.
I20260709 13:00:56.985409  7700 raft_consensus.cc:2804] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:56.986668  7700 raft_consensus.cc:697] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Becoming Leader. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:00:56.987439  7700 consensus_queue.cc:237] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:56.994702  7315 catalog_manager.cc:5697] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 reported cstate change: term changed from 1 to 2, leader changed from a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193) to 9e6feb8699754c389392df847f556cf3 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "9e6feb8699754c389392df847f556cf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.361130  7703 raft_consensus.cc:993] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37: : Instructing follower 9e6feb8699754c389392df847f556cf3 to start an election
I20260709 13:00:57.361536  7716 raft_consensus.cc:1081] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Signalling peer 9e6feb8699754c389392df847f556cf3 to start an election
I20260709 13:00:57.363013  7565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29"
dest_uuid: "9e6feb8699754c389392df847f556cf3"
 from {username='slave'} at 127.0.0.1:35010
I20260709 13:00:57.363471  7565 raft_consensus.cc:493] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:57.363754  7565 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:57.367748  7565 raft_consensus.cc:515] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:57.369223  7565 leader_election.cc:290] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 2 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:00:57.370141  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:57.370338  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:00:57.370730  7415 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:57.370864  7493 raft_consensus.cc:3055] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:57.371201  7493 raft_consensus.cc:740] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:57.371959  7493 consensus_queue.cc:260] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:57.373021  7493 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:57.377192  7415 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 2.
I20260709 13:00:57.378382  7531 leader_election.cc:304] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 
I20260709 13:00:57.379052  7493 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 2.
I20260709 13:00:57.379165  7700 raft_consensus.cc:2804] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:57.379734  7700 raft_consensus.cc:697] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Becoming Leader. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:00:57.380453  7700 consensus_queue.cc:237] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:57.386998  7315 catalog_manager.cc:5697] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 reported cstate change: term changed from 1 to 2, leader changed from deb6f45d505f4393a368cddcde226c37 (127.7.28.194) to 9e6feb8699754c389392df847f556cf3 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "9e6feb8699754c389392df847f556cf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.582650  7493 raft_consensus.cc:1275] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Refusing update from remote peer 9e6feb8699754c389392df847f556cf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:57.583931  7700 consensus_queue.cc:1048] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:57.594857  7415 raft_consensus.cc:1275] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Refusing update from remote peer 9e6feb8699754c389392df847f556cf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:57.596405  7700 consensus_queue.cc:1048] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:57.805660  7493 raft_consensus.cc:1275] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Refusing update from remote peer 9e6feb8699754c389392df847f556cf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:57.806915  7700 consensus_queue.cc:1048] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:57.816447  7415 raft_consensus.cc:1275] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Refusing update from remote peer 9e6feb8699754c389392df847f556cf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:57.817736  7710 consensus_queue.cc:1048] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:57.845192  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:57.855093  7415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
mode: GRACEFUL
new_leader_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:44602
I20260709 13:00:57.855660  7415 raft_consensus.cc:606] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 LEADER]: Received request to transfer leadership to TS deb6f45d505f4393a368cddcde226c37
I20260709 13:00:57.860407  7415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f379ecb9a89043afa633f851883332f3"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
mode: GRACEFUL
new_leader_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:44602
I20260709 13:00:57.860886  7415 raft_consensus.cc:606] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 LEADER]: Received request to transfer leadership to TS deb6f45d505f4393a368cddcde226c37
I20260709 13:00:57.865415  7565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b"
dest_uuid: "9e6feb8699754c389392df847f556cf3"
mode: GRACEFUL
new_leader_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:00:57.865921  7565 raft_consensus.cc:606] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Received request to transfer leadership to TS deb6f45d505f4393a368cddcde226c37
I20260709 13:00:57.870323  7415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674cc72587aa491da78b367bfc456c43"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
mode: GRACEFUL
new_leader_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:44602
I20260709 13:00:57.870719  7415 raft_consensus.cc:606] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Received request to transfer leadership to TS deb6f45d505f4393a368cddcde226c37
I20260709 13:00:57.877637  7565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29"
dest_uuid: "9e6feb8699754c389392df847f556cf3"
mode: GRACEFUL
new_leader_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:00:57.878167  7565 raft_consensus.cc:606] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Received request to transfer leadership to TS deb6f45d505f4393a368cddcde226c37
I20260709 13:00:57.953670  7709 raft_consensus.cc:993] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d: : Instructing follower deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:57.954125  7726 raft_consensus.cc:1081] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 LEADER]: Signalling peer deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:57.955502  7493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:45608
I20260709 13:00:57.956058  7493 raft_consensus.cc:493] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:57.956295  7493 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:57.960464  7493 raft_consensus.cc:515] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:57.962158  7493 leader_election.cc:290] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725), a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277)
I20260709 13:00:57.962841  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:57.963420  7565 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:57.963280  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:57.963862  7415 raft_consensus.cc:3055] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:57.964221  7415 raft_consensus.cc:740] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:57.964918  7415 consensus_queue.cc:260] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:57.966014  7415 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:57.969230  7565 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 4.
I20260709 13:00:57.970397  7457 leader_election.cc:304] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:57.971077  7716 raft_consensus.cc:2804] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:57.971411  7415 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 4.
I20260709 13:00:57.972206  7716 raft_consensus.cc:697] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 4 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:57.972985  7716 consensus_queue.cc:237] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:00:57.979405  7313 catalog_manager.cc:5697] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 3 to 4, leader changed from a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 4 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.982452  7720 raft_consensus.cc:993] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3: : Instructing follower deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:57.982895  7720 raft_consensus.cc:1081] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Signalling peer deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:57.984304  7493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:00:57.984845  7493 raft_consensus.cc:493] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:57.985177  7493 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.990433  7493 raft_consensus.cc:515] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:57.991742  7493 leader_election.cc:290] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 3 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:57.992525  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:57.992758  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:57.993039  7415 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.993211  7565 raft_consensus.cc:3055] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:57.993535  7565 raft_consensus.cc:740] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:00:57.994165  7565 consensus_queue.cc:260] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:57.994933  7565 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.997049  7415 raft_consensus.cc:2468] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 3.
I20260709 13:00:57.998067  7457 leader_election.cc:304] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:57.998847  7565 raft_consensus.cc:2468] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 3.
I20260709 13:00:57.998842  7716 raft_consensus.cc:2804] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:57.999498  7716 raft_consensus.cc:697] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:58.000207  7716 consensus_queue.cc:237] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.001544  7709 raft_consensus.cc:993] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d: : Instructing follower deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:58.001984  7726 raft_consensus.cc:1081] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 LEADER]: Signalling peer deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:58.003638  7493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f379ecb9a89043afa633f851883332f3"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:45608
I20260709 13:00:58.004056  7493 raft_consensus.cc:493] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.004316  7493 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.006481  7313 catalog_manager.cc:5697] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 2 to 3, leader changed from 9e6feb8699754c389392df847f556cf3 (127.7.28.195) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 3 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.008276  7493 raft_consensus.cc:515] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.009776  7493 leader_election.cc:290] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 3 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:58.010463  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f379ecb9a89043afa633f851883332f3" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:58.010790  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f379ecb9a89043afa633f851883332f3" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:58.010996  7415 raft_consensus.cc:3055] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:58.011332  7415 raft_consensus.cc:740] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:58.012105  7415 consensus_queue.cc:260] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.013159  7415 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.011317  7565 raft_consensus.cc:3060] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.017385  7415 raft_consensus.cc:2468] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 3.
I20260709 13:00:58.018337  7457 leader_election.cc:304] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:58.018996  7716 raft_consensus.cc:2804] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:58.019446  7716 raft_consensus.cc:697] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:58.020192  7716 consensus_queue.cc:237] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.021817  7565 raft_consensus.cc:2468] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 3.
I20260709 13:00:58.027144  7313 catalog_manager.cc:5697] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 2 to 3, leader changed from a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 3 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.194720  7710 raft_consensus.cc:993] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3: : Instructing follower deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:58.195180  7720 raft_consensus.cc:1081] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Signalling peer deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:58.196520  7493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:00:58.196954  7493 raft_consensus.cc:493] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.197232  7493 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.202122  7493 raft_consensus.cc:515] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.203447  7493 leader_election.cc:290] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 3 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:58.204416  7415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:58.204458  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:58.204945  7415 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.205008  7565 raft_consensus.cc:3055] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:58.205363  7565 raft_consensus.cc:740] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:00:58.206004  7565 consensus_queue.cc:260] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.206799  7565 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.208923  7415 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 3.
I20260709 13:00:58.209779  7457 leader_election.cc:304] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:58.210490  7716 raft_consensus.cc:2804] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:58.210865  7565 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 3.
I20260709 13:00:58.210983  7716 raft_consensus.cc:697] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:58.211822  7716 consensus_queue.cc:237] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.217759  7313 catalog_manager.cc:5697] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 2 to 3, leader changed from 9e6feb8699754c389392df847f556cf3 (127.7.28.195) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 3 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.509683  7415 raft_consensus.cc:1275] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:58.512368  7726 raft_consensus.cc:993] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d: : Instructing follower deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:58.512687  7417 raft_consensus.cc:1275] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:58.512843  7726 raft_consensus.cc:1081] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Signalling peer deb6f45d505f4393a368cddcde226c37 to start an election
I20260709 13:00:58.580648  7493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "674cc72587aa491da78b367bfc456c43"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
 from {username='slave'} at 127.0.0.1:45608
I20260709 13:00:58.581393  7493 raft_consensus.cc:493] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:00:58.579298  7457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:45277, user_credentials={real_user=slave}} blocked reactor thread for 61501.6us
I20260709 13:00:58.582563  7493 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.586757  7734 consensus_queue.cc:1048] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:58.588754  7565 raft_consensus.cc:1275] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:58.588917  7727 consensus_queue.cc:1048] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:58.594669  7417 raft_consensus.cc:1275] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:58.594669  7565 raft_consensus.cc:1275] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:58.596424  7493 raft_consensus.cc:515] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.598160  7493 leader_election.cc:290] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:00:58.598379  7716 consensus_queue.cc:1048] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:58.598701  7727 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:58.599956  7565 raft_consensus.cc:1275] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:58.602244  7417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:00:58.602890  7417 raft_consensus.cc:3055] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.603210  7417 raft_consensus.cc:740] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:00:58.603168  7727 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:58.604050  7417 consensus_queue.cc:260] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.605233  7417 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.602280  7565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "deb6f45d505f4393a368cddcde226c37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:00:58.606631  7565 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.621937  7417 raft_consensus.cc:2468] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:58.623261  7565 raft_consensus.cc:2468] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deb6f45d505f4393a368cddcde226c37 in term 2.
I20260709 13:00:58.631906  7733 consensus_queue.cc:1048] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:58.632232  7457 leader_election.cc:304] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:00:58.634542  7727 raft_consensus.cc:2804] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.635016  7727 raft_consensus.cc:697] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Becoming Leader. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:00:58.635752  7727 consensus_queue.cc:237] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:00:58.699823  7416 raft_consensus.cc:1275] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:58.693303  7314 catalog_manager.cc:5697] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 reported cstate change: term changed from 1 to 2, leader changed from a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193) to deb6f45d505f4393a368cddcde226c37 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "deb6f45d505f4393a368cddcde226c37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.710843  7565 raft_consensus.cc:1275] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:58.712581  7742 consensus_queue.cc:1048] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:58.715577  7734 consensus_queue.cc:1048] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:59.085355  7416 raft_consensus.cc:1275] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.086789  7727 consensus_queue.cc:1048] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.095016  7567 raft_consensus.cc:1275] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Refusing update from remote peer deb6f45d505f4393a368cddcde226c37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.096629  7716 consensus_queue.cc:1048] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:59.486465  7514 debug-util.cc:398] Leaking SignalData structure 0x7b080012d060 after lost signal to thread 7286
W20260709 13:00:59.487138  7514 debug-util.cc:398] Leaking SignalData structure 0x7b080012d740 after lost signal to thread 7349
W20260709 13:00:59.487804  7514 debug-util.cc:398] Leaking SignalData structure 0x7b080019fa20 after lost signal to thread 7442
W20260709 13:00:59.488505  7514 debug-util.cc:398] Leaking SignalData structure 0x7b08001df520 after lost signal to thread 7517
W20260709 13:00:59.489146  7514 debug-util.cc:398] Leaking SignalData structure 0x7b080014ac40 after lost signal to thread 7591
I20260709 13:01:00.910795  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:00.918738  7493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
mode: GRACEFUL
new_leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:59096
I20260709 13:01:00.919512  7493 raft_consensus.cc:606] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Received request to transfer leadership to TS a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:01:00.922235  7493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674cc72587aa491da78b367bfc456c43"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
mode: GRACEFUL
new_leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:59096
I20260709 13:01:00.922708  7493 raft_consensus.cc:606] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Received request to transfer leadership to TS a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:01:00.925251  7493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
mode: GRACEFUL
new_leader_uuid: "9e6feb8699754c389392df847f556cf3"
 from {username='slave'} at 127.0.0.1:59096
I20260709 13:01:00.925832  7493 raft_consensus.cc:606] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 4 LEADER]: Received request to transfer leadership to TS 9e6feb8699754c389392df847f556cf3
I20260709 13:01:00.928472  7493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
mode: GRACEFUL
new_leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:59096
I20260709 13:01:00.929014  7493 raft_consensus.cc:606] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Received request to transfer leadership to TS a1cadc4ea6604c4083ffe46c2aa3ff4d
I20260709 13:01:00.931564  7493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70"
dest_uuid: "deb6f45d505f4393a368cddcde226c37"
mode: GRACEFUL
new_leader_uuid: "9e6feb8699754c389392df847f556cf3"
 from {username='slave'} at 127.0.0.1:59096
I20260709 13:01:00.932077  7493 raft_consensus.cc:606] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Received request to transfer leadership to TS 9e6feb8699754c389392df847f556cf3
I20260709 13:01:00.933208  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:00.933815  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:01.084326  7716 raft_consensus.cc:993] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37: : Instructing follower a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:01:01.084939  7751 raft_consensus.cc:1081] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Signalling peer a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:01:01.086644  7418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:56150
I20260709 13:01:01.087299  7418 raft_consensus.cc:493] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.087775  7418 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.096306  7418 raft_consensus.cc:515] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.098898  7418 leader_election.cc:290] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 4 election: Requested vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:01:01.099795  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:01:01.100561  7493 raft_consensus.cc:3055] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:01.100476  7567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309a3e144228404182437dfa7ce9e47b" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:01:01.100914  7493 raft_consensus.cc:740] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:01:01.101133  7567 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.101747  7493 consensus_queue.cc:260] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.102759  7493 raft_consensus.cc:3060] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.107595  7493 raft_consensus.cc:2468] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 4.
I20260709 13:01:01.108767  7382 leader_election.cc:304] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1cadc4ea6604c4083ffe46c2aa3ff4d, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:01:01.109086  7567 raft_consensus.cc:2468] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 4.
I20260709 13:01:01.111289  7752 raft_consensus.cc:2804] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:01.112460  7752 raft_consensus.cc:697] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:01:01.113600  7752 consensus_queue.cc:237] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.123072  7315 catalog_manager.cc:5697] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 3 to 4, leader changed from deb6f45d505f4393a368cddcde226c37 (127.7.28.194) to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 4 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.224566  7716 raft_consensus.cc:993] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37: : Instructing follower 9e6feb8699754c389392df847f556cf3 to start an election
I20260709 13:01:01.225093  7751 raft_consensus.cc:1081] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 4 LEADER]: Signalling peer 9e6feb8699754c389392df847f556cf3 to start an election
I20260709 13:01:01.226775  7566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7"
dest_uuid: "9e6feb8699754c389392df847f556cf3"
 from {username='slave'} at 127.0.0.1:35010
I20260709 13:01:01.227361  7566 raft_consensus.cc:493] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.227741  7566 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.235898  7566 raft_consensus.cc:515] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:01:01.238282  7566 leader_election.cc:290] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 5 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:01:01.239394  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:01:01.239394  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2c608bc3864dd0b45393b8f0b652e7" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:01:01.240084  7418 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.240159  7493 raft_consensus.cc:3055] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:01.240548  7493 raft_consensus.cc:740] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:01:01.241349  7493 consensus_queue.cc:260] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:01:01.242553  7493 raft_consensus.cc:3060] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.249097  7493 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 5.
I20260709 13:01:01.249352  7418 raft_consensus.cc:2468] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 5.
I20260709 13:01:01.250636  7531 leader_election.cc:304] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, deb6f45d505f4393a368cddcde226c37; no voters: 
I20260709 13:01:01.251808  7720 raft_consensus.cc:2804] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:01.254376  7720 raft_consensus.cc:697] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 5 LEADER]: Becoming Leader. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:01:01.256174  7720 consensus_queue.cc:237] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } }
I20260709 13:01:01.258004  7751 raft_consensus.cc:993] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37: : Instructing follower a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:01:01.258481  7716 raft_consensus.cc:1081] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Signalling peer a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:01:01.261363  7418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "674cc72587aa491da78b367bfc456c43"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:56150
I20260709 13:01:01.261993  7418 raft_consensus.cc:493] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.262357  7418 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.265127  7315 catalog_manager.cc:5697] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 reported cstate change: term changed from 4 to 5, leader changed from deb6f45d505f4393a368cddcde226c37 (127.7.28.194) to 9e6feb8699754c389392df847f556cf3 (127.7.28.195). New cstate: current_term: 5 leader_uuid: "9e6feb8699754c389392df847f556cf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.267192  7418 raft_consensus.cc:515] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.269665  7418 leader_election.cc:290] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 3 election: Requested vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:01:01.269922  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:01:01.270481  7493 raft_consensus.cc:3055] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.270773  7493 raft_consensus.cc:740] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:01:01.271302  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674cc72587aa491da78b367bfc456c43" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:01:01.271833  7566 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.271469  7493 consensus_queue.cc:260] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.273294  7493 raft_consensus.cc:3060] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.278427  7566 raft_consensus.cc:2468] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 3.
I20260709 13:01:01.279731  7382 leader_election.cc:304] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 
I20260709 13:01:01.280079  7493 raft_consensus.cc:2468] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 3.
I20260709 13:01:01.280539  7752 raft_consensus.cc:2804] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.281039  7752 raft_consensus.cc:697] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:01:01.281980  7752 consensus_queue.cc:237] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.290599  7315 catalog_manager.cc:5697] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 2 to 3, leader changed from deb6f45d505f4393a368cddcde226c37 (127.7.28.194) to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 3 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.328006  7751 raft_consensus.cc:993] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37: : Instructing follower 9e6feb8699754c389392df847f556cf3 to start an election
I20260709 13:01:01.328510  7716 raft_consensus.cc:1081] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Signalling peer 9e6feb8699754c389392df847f556cf3 to start an election
I20260709 13:01:01.330192  7566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70"
dest_uuid: "9e6feb8699754c389392df847f556cf3"
 from {username='slave'} at 127.0.0.1:35010
I20260709 13:01:01.330695  7566 raft_consensus.cc:493] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.331111  7566 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.335799  7566 raft_consensus.cc:515] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.337414  7566 leader_election.cc:290] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 3 election: Requested vote from peers a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277), deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269)
I20260709 13:01:01.338299  7418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
I20260709 13:01:01.338747  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0054161d74c2da4a1edcff37b7c70" candidate_uuid: "9e6feb8699754c389392df847f556cf3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:01:01.338886  7418 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.339382  7493 raft_consensus.cc:3055] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.339663  7493 raft_consensus.cc:740] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:01:01.340349  7493 consensus_queue.cc:260] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.341558  7493 raft_consensus.cc:3060] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.345571  7418 raft_consensus.cc:2468] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 3.
I20260709 13:01:01.346889  7531 leader_election.cc:304] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 
I20260709 13:01:01.347642  7493 raft_consensus.cc:2468] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6feb8699754c389392df847f556cf3 in term 3.
I20260709 13:01:01.347705  7720 raft_consensus.cc:2804] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.348268  7720 raft_consensus.cc:697] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 3 LEADER]: Becoming Leader. State: Replica: 9e6feb8699754c389392df847f556cf3, State: Running, Role: LEADER
I20260709 13:01:01.349144  7720 consensus_queue.cc:237] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.357213  7315 catalog_manager.cc:5697] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 reported cstate change: term changed from 2 to 3, leader changed from deb6f45d505f4393a368cddcde226c37 (127.7.28.194) to 9e6feb8699754c389392df847f556cf3 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "9e6feb8699754c389392df847f556cf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:01.370150  7751 raft_consensus.cc:993] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37: : Instructing follower a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:01:01.370623  7716 raft_consensus.cc:1081] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Signalling peer a1cadc4ea6604c4083ffe46c2aa3ff4d to start an election
I20260709 13:01:01.372059  7418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29"
dest_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d"
 from {username='slave'} at 127.0.0.1:56150
I20260709 13:01:01.372541  7418 raft_consensus.cc:493] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.372840  7418 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.377454  7418 raft_consensus.cc:515] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.379254  7418 leader_election.cc:290] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 4 election: Requested vote from peers deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269), 9e6feb8699754c389392df847f556cf3 (127.7.28.195:42725)
I20260709 13:01:01.380052  7493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "deb6f45d505f4393a368cddcde226c37"
I20260709 13:01:01.380333  7566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4672e8ed904cce9fed3552436b2a29" candidate_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9e6feb8699754c389392df847f556cf3"
I20260709 13:01:01.380717  7493 raft_consensus.cc:3055] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:01.380937  7566 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.381071  7493 raft_consensus.cc:740] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: deb6f45d505f4393a368cddcde226c37, State: Running, Role: LEADER
I20260709 13:01:01.381973  7493 consensus_queue.cc:260] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.383180  7493 raft_consensus.cc:3060] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.387156  7566 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 4.
I20260709 13:01:01.388167  7382 leader_election.cc:304] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6feb8699754c389392df847f556cf3, a1cadc4ea6604c4083ffe46c2aa3ff4d; no voters: 
I20260709 13:01:01.388814  7752 raft_consensus.cc:2804] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:01.389250  7752 raft_consensus.cc:697] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 LEADER]: Becoming Leader. State: Replica: a1cadc4ea6604c4083ffe46c2aa3ff4d, State: Running, Role: LEADER
I20260709 13:01:01.389951  7493 raft_consensus.cc:2468] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1cadc4ea6604c4083ffe46c2aa3ff4d in term 4.
I20260709 13:01:01.390000  7752 consensus_queue.cc:237] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } }
I20260709 13:01:01.397496  7315 catalog_manager.cc:5697] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d reported cstate change: term changed from 3 to 4, leader changed from deb6f45d505f4393a368cddcde226c37 (127.7.28.194) to a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193). New cstate: current_term: 4 leader_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.672895  7418 raft_consensus.cc:1275] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 5 FOLLOWER]: Refusing update from remote peer 9e6feb8699754c389392df847f556cf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:01.674405  7720 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:01.681239  7493 raft_consensus.cc:1275] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:01.682838  7752 consensus_queue.cc:1048] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:01.691337  7567 raft_consensus.cc:1275] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:01.691789  7492 raft_consensus.cc:1275] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 5 FOLLOWER]: Refusing update from remote peer 9e6feb8699754c389392df847f556cf3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:01.692790  7752 consensus_queue.cc:1048] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:01.693811  7760 consensus_queue.cc:1048] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:01.714447  7566 raft_consensus.cc:1275] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:01.716259  7752 consensus_queue.cc:1048] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:01.738994  7491 raft_consensus.cc:1275] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:01.743038  7753 consensus_queue.cc:1048] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.810966  7566 raft_consensus.cc:1275] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:01.812161  7753 consensus_queue.cc:1048] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6feb8699754c389392df847f556cf3" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:01.824061  7492 raft_consensus.cc:1275] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Refusing update from remote peer a1cadc4ea6604c4083ffe46c2aa3ff4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:01.826076  7771 consensus_queue.cc:1048] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:01.886278  7492 raft_consensus.cc:1275] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Refusing update from remote peer 9e6feb8699754c389392df847f556cf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:01.887411  7720 consensus_queue.cc:1048] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb6f45d505f4393a368cddcde226c37" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:01.897080  7418 raft_consensus.cc:1275] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Refusing update from remote peer 9e6feb8699754c389392df847f556cf3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:01.898986  7720 consensus_queue.cc:1048] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1cadc4ea6604c4083ffe46c2aa3ff4d" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:01.934746  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:01.940039  7283 tablet_server.cc:179] TabletServer@127.7.28.193:0 shutting down...
I20260709 13:01:01.964730  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:01.965517  7283 tablet_replica.cc:333] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.966382  7283 raft_consensus.cc:2243] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.966849  7283 raft_consensus.cc:2272] T f379ecb9a89043afa633f851883332f3 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.968976  7283 tablet_replica.cc:333] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.969448  7283 raft_consensus.cc:2243] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.969899  7283 raft_consensus.cc:2272] T 7d702a5f90e84362b6e361346cc27809 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.971477  7283 tablet_replica.cc:333] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.971926  7283 raft_consensus.cc:2243] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:01.972571  7283 raft_consensus.cc:2272] T 309a3e144228404182437dfa7ce9e47b P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.974670  7283 tablet_replica.cc:333] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.975196  7283 raft_consensus.cc:2243] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.975615  7283 raft_consensus.cc:2272] T af3cb382010c48d78a171421cb528b01 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.977221  7283 tablet_replica.cc:333] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.977634  7283 raft_consensus.cc:2243] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:01.978328  7283 raft_consensus.cc:2272] T 674cc72587aa491da78b367bfc456c43 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.980279  7283 tablet_replica.cc:333] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.980719  7283 raft_consensus.cc:2243] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.981083  7283 raft_consensus.cc:2272] T 9d2c608bc3864dd0b45393b8f0b652e7 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.982991  7283 tablet_replica.cc:333] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.983485  7283 raft_consensus.cc:2243] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:01.984172  7283 raft_consensus.cc:2272] T ac4672e8ed904cce9fed3552436b2a29 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.986105  7283 tablet_replica.cc:333] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.986598  7283 raft_consensus.cc:2243] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.987038  7283 raft_consensus.cc:2272] T b9e0054161d74c2da4a1edcff37b7c70 P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.988974  7283 tablet_replica.cc:333] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d: stopping tablet replica
I20260709 13:01:01.989403  7283 raft_consensus.cc:2243] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.989884  7283 raft_consensus.cc:2272] T 91593f09a0c444c0b44986e4f55879cf P a1cadc4ea6604c4083ffe46c2aa3ff4d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:02.084381  7457 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.28.193:45277: connect: Connection refused (error 111)
I20260709 13:01:02.085423  7283 tablet_server.cc:196] TabletServer@127.7.28.193:0 shutdown complete.
W20260709 13:01:02.088279  7457 consensus_peers.cc:597] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 -> Peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Couldn't send request to peer a1cadc4ea6604c4083ffe46c2aa3ff4d. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:45277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.103399  7283 tablet_server.cc:179] TabletServer@127.7.28.194:0 shutting down...
I20260709 13:01:02.130919  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:02.133617  7457 consensus_peers.cc:597] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 -> Peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Couldn't send request to peer a1cadc4ea6604c4083ffe46c2aa3ff4d. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:45277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.134636  7283 tablet_replica.cc:333] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.135490  7283 raft_consensus.cc:2243] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.135958  7283 raft_consensus.cc:2272] T 309a3e144228404182437dfa7ce9e47b P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.138330  7283 tablet_replica.cc:333] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.139140  7283 raft_consensus.cc:2243] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:02.140339  7283 raft_consensus.cc:2272] T 7d702a5f90e84362b6e361346cc27809 P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:02.140311  7531 consensus_peers.cc:597] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 -> Peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Couldn't send request to peer deb6f45d505f4393a368cddcde226c37. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.143035  7283 tablet_replica.cc:333] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.143853  7283 raft_consensus.cc:2243] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:02.143996  7457 consensus_peers.cc:597] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 -> Peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Couldn't send request to peer a1cadc4ea6604c4083ffe46c2aa3ff4d. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:45277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.144371  7283 raft_consensus.cc:2272] T 9d2c608bc3864dd0b45393b8f0b652e7 P deb6f45d505f4393a368cddcde226c37 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.147164  7283 tablet_replica.cc:333] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.147665  7283 raft_consensus.cc:2243] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.148123  7283 raft_consensus.cc:2272] T ac4672e8ed904cce9fed3552436b2a29 P deb6f45d505f4393a368cddcde226c37 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.150882  7283 tablet_replica.cc:333] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.151660  7283 raft_consensus.cc:2243] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.152217  7283 raft_consensus.cc:2272] T af3cb382010c48d78a171421cb528b01 P deb6f45d505f4393a368cddcde226c37 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:02.152740  7531 consensus_peers.cc:597] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 -> Peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Couldn't send request to peer a1cadc4ea6604c4083ffe46c2aa3ff4d. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:45277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.154703  7283 tablet_replica.cc:333] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.155478  7283 raft_consensus.cc:2243] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.155947  7283 raft_consensus.cc:2272] T 674cc72587aa491da78b367bfc456c43 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.158454  7283 tablet_replica.cc:333] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.159117  7283 raft_consensus.cc:2243] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:02.160041  7283 raft_consensus.cc:2272] T 91593f09a0c444c0b44986e4f55879cf P deb6f45d505f4393a368cddcde226c37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.162194  7283 tablet_replica.cc:333] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.162586  7283 raft_consensus.cc:2243] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:02.163242  7283 raft_consensus.cc:2272] T f379ecb9a89043afa633f851883332f3 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.164757  7283 tablet_replica.cc:333] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37: stopping tablet replica
I20260709 13:01:02.165130  7283 raft_consensus.cc:2243] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.165444  7283 raft_consensus.cc:2272] T b9e0054161d74c2da4a1edcff37b7c70 P deb6f45d505f4393a368cddcde226c37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.209780  7283 tablet_server.cc:196] TabletServer@127.7.28.194:0 shutdown complete.
W20260709 13:01:02.210630  7531 consensus_peers.cc:597] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 -> Peer deb6f45d505f4393a368cddcde226c37 (127.7.28.194:36269): Couldn't send request to peer deb6f45d505f4393a368cddcde226c37. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:36269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:02.216377  7531 consensus_peers.cc:597] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 -> Peer a1cadc4ea6604c4083ffe46c2aa3ff4d (127.7.28.193:45277): Couldn't send request to peer a1cadc4ea6604c4083ffe46c2aa3ff4d. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:45277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.228302  7283 tablet_server.cc:179] TabletServer@127.7.28.195:0 shutting down...
I20260709 13:01:02.252377  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:02.253113  7283 tablet_replica.cc:333] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.253733  7283 raft_consensus.cc:2243] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.254298  7283 raft_consensus.cc:2272] T 91593f09a0c444c0b44986e4f55879cf P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.256050  7283 tablet_replica.cc:333] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.256573  7283 raft_consensus.cc:2243] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:02.257284  7283 raft_consensus.cc:2272] T b9e0054161d74c2da4a1edcff37b7c70 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.259294  7283 tablet_replica.cc:333] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.259824  7283 raft_consensus.cc:2243] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.260277  7283 raft_consensus.cc:2272] T f379ecb9a89043afa633f851883332f3 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.261924  7283 tablet_replica.cc:333] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.262395  7283 raft_consensus.cc:2243] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.262807  7283 raft_consensus.cc:2272] T 7d702a5f90e84362b6e361346cc27809 P 9e6feb8699754c389392df847f556cf3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.264405  7283 tablet_replica.cc:333] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.264871  7283 raft_consensus.cc:2243] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.265282  7283 raft_consensus.cc:2272] T 309a3e144228404182437dfa7ce9e47b P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.267429  7283 tablet_replica.cc:333] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.267920  7283 raft_consensus.cc:2243] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.268335  7283 raft_consensus.cc:2272] T ac4672e8ed904cce9fed3552436b2a29 P 9e6feb8699754c389392df847f556cf3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.270414  7283 tablet_replica.cc:333] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.270896  7283 raft_consensus.cc:2243] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:02.271631  7283 raft_consensus.cc:2272] T af3cb382010c48d78a171421cb528b01 P 9e6feb8699754c389392df847f556cf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.273247  7283 tablet_replica.cc:333] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.273690  7283 raft_consensus.cc:2243] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.274168  7283 raft_consensus.cc:2272] T 674cc72587aa491da78b367bfc456c43 P 9e6feb8699754c389392df847f556cf3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.275920  7283 tablet_replica.cc:333] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3: stopping tablet replica
I20260709 13:01:02.276366  7283 raft_consensus.cc:2243] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:01:02.277091  7283 raft_consensus.cc:2272] T 9d2c608bc3864dd0b45393b8f0b652e7 P 9e6feb8699754c389392df847f556cf3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.303905  7283 tablet_server.cc:196] TabletServer@127.7.28.195:0 shutdown complete.
I20260709 13:01:02.320304  7283 master.cc:562] Master@127.7.28.254:34595 shutting down...
I20260709 13:01:02.450958  7283 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:02.451551  7283 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.451918  7283 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7c435cd168624abaa38a341708e352c0: stopping tablet replica
I20260709 13:01:02.471521  7283 master.cc:584] Master@127.7.28.254:34595 shutdown complete.
9e6feb8699754c389392df847f556cf3  1
a1cadc4ea6604c4083ffe46c2aa3ff4d  4
deb6f45d505f4393a368cddcde226c37  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12958 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:01:02.510340  7283 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.28.254:41797
I20260709 13:01:02.511546  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:02.517581  7785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:02.517606  7786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:02.518847  7283 server_base.cc:1061] running on GCE node
W20260709 13:01:02.518798  7788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:02.519977  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:02.520164  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:02.520277  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602062520265 us; error 0 us; skew 500 ppm
I20260709 13:01:02.520725  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:02.526782  7283 webserver.cc:533] Webserver started at http://127.7.28.254:41159/ using document root <none> and password file <none>
I20260709 13:01:02.527235  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:02.527398  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:02.527617  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:02.528680  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/master-0-root/instance:
uuid: "f57ec4aa73434c9fa9bf71527c6eae0d"
format_stamp: "Formatted at 2026-07-09 13:01:02 on dist-test-slave-ll1f"
I20260709 13:01:02.533048  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:02.536501  7793 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.537256  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:02.537588  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/master-0-root
uuid: "f57ec4aa73434c9fa9bf71527c6eae0d"
format_stamp: "Formatted at 2026-07-09 13:01:02 on dist-test-slave-ll1f"
I20260709 13:01:02.537997  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:02.549494  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:02.550839  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:02.589041  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.254:41797
I20260709 13:01:02.589133  7844 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.254:41797 every 8 connection(s)
I20260709 13:01:02.592996  7845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:02.602141  7845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d: Bootstrap starting.
I20260709 13:01:02.606626  7845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:02.610702  7845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d: No bootstrap required, opened a new log
I20260709 13:01:02.612718  7845 raft_consensus.cc:359] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ec4aa73434c9fa9bf71527c6eae0d" member_type: VOTER }
I20260709 13:01:02.613091  7845 raft_consensus.cc:385] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:02.613265  7845 raft_consensus.cc:740] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f57ec4aa73434c9fa9bf71527c6eae0d, State: Initialized, Role: FOLLOWER
I20260709 13:01:02.613873  7845 consensus_queue.cc:260] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ec4aa73434c9fa9bf71527c6eae0d" member_type: VOTER }
I20260709 13:01:02.614319  7845 raft_consensus.cc:399] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:02.614518  7845 raft_consensus.cc:493] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:02.614725  7845 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:02.619444  7845 raft_consensus.cc:515] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ec4aa73434c9fa9bf71527c6eae0d" member_type: VOTER }
I20260709 13:01:02.619931  7845 leader_election.cc:304] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f57ec4aa73434c9fa9bf71527c6eae0d; no voters: 
I20260709 13:01:02.621004  7845 leader_election.cc:290] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:02.621403  7848 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:02.622905  7848 raft_consensus.cc:697] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 1 LEADER]: Becoming Leader. State: Replica: f57ec4aa73434c9fa9bf71527c6eae0d, State: Running, Role: LEADER
I20260709 13:01:02.623536  7848 consensus_queue.cc:237] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ec4aa73434c9fa9bf71527c6eae0d" member_type: VOTER }
I20260709 13:01:02.624042  7845 sys_catalog.cc:565] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:02.628436  7849 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f57ec4aa73434c9fa9bf71527c6eae0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ec4aa73434c9fa9bf71527c6eae0d" member_type: VOTER } }
I20260709 13:01:02.629298  7849 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:02.629019  7850 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f57ec4aa73434c9fa9bf71527c6eae0d. Latest consensus state: current_term: 1 leader_uuid: "f57ec4aa73434c9fa9bf71527c6eae0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ec4aa73434c9fa9bf71527c6eae0d" member_type: VOTER } }
I20260709 13:01:02.629820  7850 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:02.635793  7855 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:02.640985  7855 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:02.642100  7283 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:02.649675  7855 catalog_manager.cc:1383] Generated new cluster ID: ba8967879e2e4fcf8eb2476a27bc5807
I20260709 13:01:02.650107  7855 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:02.677134  7855 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:02.678417  7855 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:02.696815  7855 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d: Generated new TSK 0
I20260709 13:01:02.697459  7855 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:02.708585  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:02.715065  7866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:02.716307  7867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:02.717067  7869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:02.717569  7283 server_base.cc:1061] running on GCE node
I20260709 13:01:02.718487  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:02.718711  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:02.718837  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602062718823 us; error 0 us; skew 500 ppm
I20260709 13:01:02.719273  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:02.721436  7283 webserver.cc:533] Webserver started at http://127.7.28.193:45951/ using document root <none> and password file <none>
I20260709 13:01:02.721959  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:02.722121  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:02.722342  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:02.723305  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-0-root/instance:
uuid: "bbed390f195142aaada345fea2cf4452"
format_stamp: "Formatted at 2026-07-09 13:01:02 on dist-test-slave-ll1f"
I20260709 13:01:02.727696  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:02.732009  7874 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.732999  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:01:02.733441  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "bbed390f195142aaada345fea2cf4452"
format_stamp: "Formatted at 2026-07-09 13:01:02 on dist-test-slave-ll1f"
I20260709 13:01:02.733750  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:02.753517  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:02.755216  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:02.758615  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:02.761979  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:02.762238  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.762545  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:02.762764  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.810148  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:43593
I20260709 13:01:02.810247  7936 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:43593 every 8 connection(s)
I20260709 13:01:02.815171  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:02.822360  7941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:02.824203  7942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:02.828604  7283 server_base.cc:1061] running on GCE node
W20260709 13:01:02.828801  7944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:02.829825  7937 heartbeater.cc:344] Connected to a master server at 127.7.28.254:41797
I20260709 13:01:02.830215  7937 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:02.830242  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:02.830540  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:02.830695  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602062830682 us; error 0 us; skew 500 ppm
I20260709 13:01:02.831136  7937 heartbeater.cc:507] Master 127.7.28.254:41797 requested a full tablet report, sending...
I20260709 13:01:02.831220  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:02.833384  7810 ts_manager.cc:194] Registered new tserver with Master: bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593)
I20260709 13:01:02.834187  7283 webserver.cc:533] Webserver started at http://127.7.28.194:38011/ using document root <none> and password file <none>
I20260709 13:01:02.834764  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:02.834981  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:02.835351  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:02.835598  7810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43956
I20260709 13:01:02.836870  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-1-root/instance:
uuid: "42ca725e1af946e2b5391e518d1ed976"
format_stamp: "Formatted at 2026-07-09 13:01:02 on dist-test-slave-ll1f"
I20260709 13:01:02.842404  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:01:02.845629  7949 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.846468  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:01:02.846776  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-1-root
uuid: "42ca725e1af946e2b5391e518d1ed976"
format_stamp: "Formatted at 2026-07-09 13:01:02 on dist-test-slave-ll1f"
I20260709 13:01:02.847054  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:02.862102  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:02.863332  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:02.864773  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:02.867022  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:02.867251  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.867532  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:02.867717  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.907339  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.194:41711
I20260709 13:01:02.907438  8011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.194:41711 every 8 connection(s)
I20260709 13:01:02.912228  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:02.919330  8015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:02.921541  8016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:02.923280  8018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:02.925307  8012 heartbeater.cc:344] Connected to a master server at 127.7.28.254:41797
I20260709 13:01:02.925801  8012 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:02.926158  7283 server_base.cc:1061] running on GCE node
I20260709 13:01:02.926795  8012 heartbeater.cc:507] Master 127.7.28.254:41797 requested a full tablet report, sending...
I20260709 13:01:02.926910  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:02.927203  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:02.927371  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602062927337 us; error 0 us; skew 500 ppm
I20260709 13:01:02.927920  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:02.929178  7810 ts_manager.cc:194] Registered new tserver with Master: 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:02.930663  7283 webserver.cc:533] Webserver started at http://127.7.28.195:46631/ using document root <none> and password file <none>
I20260709 13:01:02.931001  7810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43970
I20260709 13:01:02.931293  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:02.931552  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:02.931866  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:02.933048  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-2-root/instance:
uuid: "e4f1af5c0177407da186daf0e6abbca2"
format_stamp: "Formatted at 2026-07-09 13:01:02 on dist-test-slave-ll1f"
I20260709 13:01:02.937727  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:01:02.941092  8023 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.941888  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:02.942189  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-2-root
uuid: "e4f1af5c0177407da186daf0e6abbca2"
format_stamp: "Formatted at 2026-07-09 13:01:02 on dist-test-slave-ll1f"
I20260709 13:01:02.942484  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602049386691-7283-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:02.958906  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:02.960073  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:02.961592  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:02.963860  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:02.964084  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:02.964337  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:02.964517  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:03.004372  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.195:35579
I20260709 13:01:03.004478  8085 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.195:35579 every 8 connection(s)
I20260709 13:01:03.018152  8086 heartbeater.cc:344] Connected to a master server at 127.7.28.254:41797
I20260709 13:01:03.018473  8086 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:03.019200  8086 heartbeater.cc:507] Master 127.7.28.254:41797 requested a full tablet report, sending...
I20260709 13:01:03.021045  7810 ts_manager.cc:194] Registered new tserver with Master: e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:03.021165  7283 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013664794s
I20260709 13:01:03.022491  7810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43980
I20260709 13:01:03.046964  7810 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43982:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:03.049731  7810 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:03.116712  8051 tablet_service.cc:1511] Processing CreateTablet for tablet b4089d3ce626419fa26f775052e0b456 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:03.118189  8051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4089d3ce626419fa26f775052e0b456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.119138  8048 tablet_service.cc:1511] Processing CreateTablet for tablet f5ceb4d44f444c839c0f495d7906eb23 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:03.120770  8048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ceb4d44f444c839c0f495d7906eb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.122882  8050 tablet_service.cc:1511] Processing CreateTablet for tablet 59a3f47c2789402fb6d61592f758c361 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:03.124179  8050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a3f47c2789402fb6d61592f758c361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.124366  8049 tablet_service.cc:1511] Processing CreateTablet for tablet da34508e7f9d40d4921206f17d495b61 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:03.125877  8049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da34508e7f9d40d4921206f17d495b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.135905  7977 tablet_service.cc:1511] Processing CreateTablet for tablet b4089d3ce626419fa26f775052e0b456 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:03.137320  7977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4089d3ce626419fa26f775052e0b456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.138814  7976 tablet_service.cc:1511] Processing CreateTablet for tablet 59a3f47c2789402fb6d61592f758c361 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:03.140161  7976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a3f47c2789402fb6d61592f758c361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.144294  7974 tablet_service.cc:1511] Processing CreateTablet for tablet f5ceb4d44f444c839c0f495d7906eb23 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:03.146612  7975 tablet_service.cc:1511] Processing CreateTablet for tablet da34508e7f9d40d4921206f17d495b61 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:03.148487  7974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ceb4d44f444c839c0f495d7906eb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.154234  7975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da34508e7f9d40d4921206f17d495b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.177013  7973 tablet_service.cc:1511] Processing CreateTablet for tablet b5a93e63b0d941cdb6a8039868fcaf29 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:03.178997  8048 tablet_service.cc:1511] Processing CreateTablet for tablet b5a93e63b0d941cdb6a8039868fcaf29 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:03.179610  7973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a93e63b0d941cdb6a8039868fcaf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.180246  8048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a93e63b0d941cdb6a8039868fcaf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.184091  8049 tablet_service.cc:1511] Processing CreateTablet for tablet aad2a4e64209444cb20385d15e2a02ec (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:03.184307  7972 tablet_service.cc:1511] Processing CreateTablet for tablet aad2a4e64209444cb20385d15e2a02ec (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:03.185401  8049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad2a4e64209444cb20385d15e2a02ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.187980  8100 tablet_bootstrap.cc:492] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.185715  7972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad2a4e64209444cb20385d15e2a02ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.200003  7971 tablet_service.cc:1511] Processing CreateTablet for tablet 19e18b06754d4af89bf245d0a4d5e86a (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:03.201467  7971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e18b06754d4af89bf245d0a4d5e86a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.206444  8051 tablet_service.cc:1511] Processing CreateTablet for tablet 19e18b06754d4af89bf245d0a4d5e86a (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:03.208181  8051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e18b06754d4af89bf245d0a4d5e86a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.211229  8100 tablet_bootstrap.cc:654] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.218899  8050 tablet_service.cc:1511] Processing CreateTablet for tablet 2a06c29222fa4ad68cb600acc0641e2e (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:03.230840  8100 tablet_bootstrap.cc:492] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.230995  8050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a06c29222fa4ad68cb600acc0641e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.231447  8100 ts_tablet_manager.cc:1403] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.006s
I20260709 13:01:03.220551  7976 tablet_service.cc:1511] Processing CreateTablet for tablet 2a06c29222fa4ad68cb600acc0641e2e (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:03.234370  8100 raft_consensus.cc:359] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.235190  8100 raft_consensus.cc:385] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.227654  8101 tablet_bootstrap.cc:492] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.240715  7976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a06c29222fa4ad68cb600acc0641e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.245604  7900 tablet_service.cc:1511] Processing CreateTablet for tablet da34508e7f9d40d4921206f17d495b61 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:03.247078  7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da34508e7f9d40d4921206f17d495b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.247936  7902 tablet_service.cc:1511] Processing CreateTablet for tablet b4089d3ce626419fa26f775052e0b456 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:03.248430  7896 tablet_service.cc:1511] Processing CreateTablet for tablet 19e18b06754d4af89bf245d0a4d5e86a (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:03.249322  7902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4089d3ce626419fa26f775052e0b456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.249683  7899 tablet_service.cc:1511] Processing CreateTablet for tablet f5ceb4d44f444c839c0f495d7906eb23 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:03.250900  7895 tablet_service.cc:1511] Processing CreateTablet for tablet 2a06c29222fa4ad68cb600acc0641e2e (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:03.252854  7898 tablet_service.cc:1511] Processing CreateTablet for tablet b5a93e63b0d941cdb6a8039868fcaf29 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:03.253656  7894 tablet_service.cc:1511] Processing CreateTablet for tablet f56a62c0051145c8a65c8675e2c2f4df (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:03.250990  7901 tablet_service.cc:1511] Processing CreateTablet for tablet 59a3f47c2789402fb6d61592f758c361 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:03.256035  8049 tablet_service.cc:1511] Processing CreateTablet for tablet f56a62c0051145c8a65c8675e2c2f4df (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:03.257287  8049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56a62c0051145c8a65c8675e2c2f4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.246695  7897 tablet_service.cc:1511] Processing CreateTablet for tablet aad2a4e64209444cb20385d15e2a02ec (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:03.255088  7896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e18b06754d4af89bf245d0a4d5e86a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.259474  7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a3f47c2789402fb6d61592f758c361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.262162  7897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad2a4e64209444cb20385d15e2a02ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.266126  7898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a93e63b0d941cdb6a8039868fcaf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.266847  7895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a06c29222fa4ad68cb600acc0641e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.270155  7894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56a62c0051145c8a65c8675e2c2f4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.274230  7899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ceb4d44f444c839c0f495d7906eb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.279520  8103 tablet_bootstrap.cc:492] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.235558  8100 raft_consensus.cc:740] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.282411  7977 tablet_service.cc:1511] Processing CreateTablet for tablet f56a62c0051145c8a65c8675e2c2f4df (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:03.284691  7977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56a62c0051145c8a65c8675e2c2f4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.287608  8103 tablet_bootstrap.cc:654] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.283314  8100 consensus_queue.cc:260] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.299185  8086 heartbeater.cc:499] Master 127.7.28.254:41797 was elected leader, sending a full tablet report...
I20260709 13:01:03.241880  8101 tablet_bootstrap.cc:654] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.310411  8100 ts_tablet_manager.cc:1434] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.002s
I20260709 13:01:03.311311  8100 tablet_bootstrap.cc:492] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.319168  8101 tablet_bootstrap.cc:492] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.319191  8103 tablet_bootstrap.cc:492] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.319907  8101 ts_tablet_manager.cc:1403] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.092s	user 0.005s	sys 0.007s
I20260709 13:01:03.320024  8103 ts_tablet_manager.cc:1403] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.024s
I20260709 13:01:03.322956  8101 raft_consensus.cc:359] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.323294  8103 raft_consensus.cc:359] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.323810  8101 raft_consensus.cc:385] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.324102  8103 raft_consensus.cc:385] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.324184  8101 raft_consensus.cc:740] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.324525  8103 raft_consensus.cc:740] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.325158  8100 tablet_bootstrap.cc:654] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.325291  8101 consensus_queue.cc:260] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.325562  8103 consensus_queue.cc:260] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.332058  8103 ts_tablet_manager.cc:1434] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:01:03.332832  7937 heartbeater.cc:499] Master 127.7.28.254:41797 was elected leader, sending a full tablet report...
I20260709 13:01:03.339859  7901 tablet_service.cc:1511] Processing CreateTablet for tablet 92e07d3f5f184133a38c88f8a78d85a7 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:03.341619  7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e07d3f5f184133a38c88f8a78d85a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.342562  7976 tablet_service.cc:1511] Processing CreateTablet for tablet 92e07d3f5f184133a38c88f8a78d85a7 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:03.343786  7976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e07d3f5f184133a38c88f8a78d85a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.354672  8103 tablet_bootstrap.cc:492] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.360685  8100 tablet_bootstrap.cc:492] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.361280  8100 ts_tablet_manager.cc:1403] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.015s
I20260709 13:01:03.361847  8103 tablet_bootstrap.cc:654] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.363237  8012 heartbeater.cc:499] Master 127.7.28.254:41797 was elected leader, sending a full tablet report...
I20260709 13:01:03.364167  8100 raft_consensus.cc:359] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.364872  8100 raft_consensus.cc:385] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.365150  8100 raft_consensus.cc:740] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.365182  8050 tablet_service.cc:1511] Processing CreateTablet for tablet 92e07d3f5f184133a38c88f8a78d85a7 (DEFAULT_TABLE table=test-workload [id=dea0c6473af34143b652305bc523534e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:03.366056  8100 consensus_queue.cc:260] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.366567  8050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e07d3f5f184133a38c88f8a78d85a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:03.368227  8100 ts_tablet_manager.cc:1434] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:01:03.369119  8100 tablet_bootstrap.cc:492] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.375288  8100 tablet_bootstrap.cc:654] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.375692  8101 ts_tablet_manager.cc:1434] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.055s	user 0.013s	sys 0.011s
I20260709 13:01:03.376816  8101 tablet_bootstrap.cc:492] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.383745  8101 tablet_bootstrap.cc:654] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.386554  8100 tablet_bootstrap.cc:492] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.395884  8100 ts_tablet_manager.cc:1403] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 13:01:03.398734  8100 raft_consensus.cc:359] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.399461  8100 raft_consensus.cc:385] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.399749  8100 raft_consensus.cc:740] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.400463  8100 consensus_queue.cc:260] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.402710  8100 ts_tablet_manager.cc:1434] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:01:03.406172  8100 tablet_bootstrap.cc:492] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.410670  8103 tablet_bootstrap.cc:492] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.410686  8101 tablet_bootstrap.cc:492] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.411391  8103 ts_tablet_manager.cc:1403] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.000s
I20260709 13:01:03.411454  8101 ts_tablet_manager.cc:1403] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.001s
I20260709 13:01:03.412812  8100 tablet_bootstrap.cc:654] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.414428  8103 raft_consensus.cc:359] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.415243  8103 raft_consensus.cc:385] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.415092  8101 raft_consensus.cc:359] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.415573  8103 raft_consensus.cc:740] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.415913  8101 raft_consensus.cc:385] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.416393  8103 consensus_queue.cc:260] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.416417  8101 raft_consensus.cc:740] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.418131  8101 consensus_queue.cc:260] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.420030  8101 ts_tablet_manager.cc:1434] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:01:03.420909  8101 tablet_bootstrap.cc:492] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.426537  8103 ts_tablet_manager.cc:1434] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:01:03.427572  8103 tablet_bootstrap.cc:492] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.431334  8101 tablet_bootstrap.cc:654] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.432188  8100 tablet_bootstrap.cc:492] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.432667  8100 ts_tablet_manager.cc:1403] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 13:01:03.434062  8103 tablet_bootstrap.cc:654] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.436965  8100 raft_consensus.cc:359] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.437704  8100 raft_consensus.cc:385] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.438084  8100 raft_consensus.cc:740] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.438917  8100 consensus_queue.cc:260] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.441221  8100 ts_tablet_manager.cc:1434] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:01:03.444079  8100 tablet_bootstrap.cc:492] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.444967  8101 tablet_bootstrap.cc:492] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.445708  8101 ts_tablet_manager.cc:1403] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 13:01:03.450438  8100 tablet_bootstrap.cc:654] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.449959  8101 raft_consensus.cc:359] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.451673  8101 raft_consensus.cc:385] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.452046  8101 raft_consensus.cc:740] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.452819  8101 consensus_queue.cc:260] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.453850  8103 tablet_bootstrap.cc:492] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.454438  8103 ts_tablet_manager.cc:1403] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.005s
I20260709 13:01:03.455116  8101 ts_tablet_manager.cc:1434] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:01:03.456087  8101 tablet_bootstrap.cc:492] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.457484  8103 raft_consensus.cc:359] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.458293  8103 raft_consensus.cc:385] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.458673  8103 raft_consensus.cc:740] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.459520  8103 consensus_queue.cc:260] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.462121  8103 ts_tablet_manager.cc:1434] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:01:03.462749  8101 tablet_bootstrap.cc:654] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.463214  8103 tablet_bootstrap.cc:492] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.466187  8107 raft_consensus.cc:493] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.466691  8107 raft_consensus.cc:515] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.471848  8107 leader_election.cc:290] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579), bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593)
I20260709 13:01:03.486738  8103 tablet_bootstrap.cc:654] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.492276  8100 tablet_bootstrap.cc:492] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.492937  8100 ts_tablet_manager.cc:1403] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.014s
I20260709 13:01:03.496749  8100 raft_consensus.cc:359] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.497758  8100 raft_consensus.cc:385] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.498169  8100 raft_consensus.cc:740] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.499512  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4089d3ce626419fa26f775052e0b456" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452" is_pre_election: true
I20260709 13:01:03.500528  7912 raft_consensus.cc:2468] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 0.
I20260709 13:01:03.502447  7951 leader_election.cc:304] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:03.504580  8107 raft_consensus.cc:2804] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.504941  8107 raft_consensus.cc:493] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.505271  8107 raft_consensus.cc:3060] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.506188  8101 tablet_bootstrap.cc:492] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.506729  8101 ts_tablet_manager.cc:1403] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.021s
I20260709 13:01:03.509634  8101 raft_consensus.cc:359] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.510411  8101 raft_consensus.cc:385] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.510737  8101 raft_consensus.cc:740] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.510869  8100 consensus_queue.cc:260] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.511544  8101 consensus_queue.cc:260] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.513434  8100 ts_tablet_manager.cc:1434] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.006s
I20260709 13:01:03.514742  8100 tablet_bootstrap.cc:492] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.523464  8100 tablet_bootstrap.cc:654] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.523758  8101 ts_tablet_manager.cc:1434] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:01:03.527786  8107 raft_consensus.cc:515] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.531680  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4089d3ce626419fa26f775052e0b456" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:03.532291  7912 raft_consensus.cc:3060] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.539368  8107 leader_election.cc:290] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 election: Requested vote from peers e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579), bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593)
I20260709 13:01:03.540560  8101 tablet_bootstrap.cc:492] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.543064  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4089d3ce626419fa26f775052e0b456" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2" is_pre_election: true
I20260709 13:01:03.543797  8061 raft_consensus.cc:2468] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 0.
I20260709 13:01:03.544417  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4089d3ce626419fa26f775052e0b456" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:03.544991  8060 raft_consensus.cc:3060] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.545713  8100 tablet_bootstrap.cc:492] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.546310  8100 ts_tablet_manager.cc:1403] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.011s
I20260709 13:01:03.547099  8103 tablet_bootstrap.cc:492] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.547595  8103 ts_tablet_manager.cc:1403] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.085s	user 0.027s	sys 0.017s
I20260709 13:01:03.541944  7912 raft_consensus.cc:2468] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 1.
I20260709 13:01:03.542224  8105 raft_consensus.cc:493] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.549153  8105 raft_consensus.cc:515] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.549777  7951 leader_election.cc:304] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:03.549575  8100 raft_consensus.cc:359] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.550462  8100 raft_consensus.cc:385] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.550824  8100 raft_consensus.cc:740] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.550591  8103 raft_consensus.cc:359] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.551375  8103 raft_consensus.cc:385] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.551441  8107 raft_consensus.cc:2804] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.551753  8105 leader_election.cc:290] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.551848  8103 raft_consensus.cc:740] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.552001  8107 raft_consensus.cc:697] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Becoming Leader. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:03.552950  8107 consensus_queue.cc:237] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:03.552877  8103 consensus_queue.cc:260] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.555908  8103 ts_tablet_manager.cc:1434] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:01:03.557263  8060 raft_consensus.cc:2468] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 1.
I20260709 13:01:03.551079  8101 tablet_bootstrap.cc:654] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.558871  8103 tablet_bootstrap.cc:492] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.556869  8100 consensus_queue.cc:260] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.561520  8100 ts_tablet_manager.cc:1434] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:01:03.562497  8100 tablet_bootstrap.cc:492] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.566955  8103 tablet_bootstrap.cc:654] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.576447  8101 tablet_bootstrap.cc:492] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.577064  8101 ts_tablet_manager.cc:1403] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.006s
I20260709 13:01:03.577387  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452" is_pre_election: true
I20260709 13:01:03.578548  8108 raft_consensus.cc:493] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.579097  8025 leader_election.cc:343] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.579855  8100 tablet_bootstrap.cc:654] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.579186  8108 raft_consensus.cc:515] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.588258  8105 raft_consensus.cc:493] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.588950  8105 raft_consensus.cc:515] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.590310  8108 leader_election.cc:290] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:03.591709  8105 leader_election.cc:290] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.595835  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452" is_pre_election: true
I20260709 13:01:03.596721  7912 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.599404  8025 leader_election.cc:304] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:03.600477  8105 raft_consensus.cc:2804] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.600941  8105 raft_consensus.cc:493] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.601365  8105 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.604784  8108 raft_consensus.cc:493] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.605250  8108 raft_consensus.cc:515] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.607425  8108 leader_election.cc:290] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:03.609738  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:03.603292  8101 raft_consensus.cc:359] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.610792  8101 raft_consensus.cc:385] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.610988  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:03.613226  8101 raft_consensus.cc:740] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.613328  7986 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.614622  8101 consensus_queue.cc:260] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.619294  7987 raft_consensus.cc:2468] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.619634  8121 raft_consensus.cc:493] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.620325  8121 raft_consensus.cc:515] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.622014  8103 tablet_bootstrap.cc:492] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.622550  8103 ts_tablet_manager.cc:1403] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.018s
I20260709 13:01:03.624199  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452" is_pre_election: true
I20260709 13:01:03.625017  7912 raft_consensus.cc:2468] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 0.
I20260709 13:01:03.625547  8025 leader_election.cc:304] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: bbed390f195142aaada345fea2cf4452
I20260709 13:01:03.626963  8103 raft_consensus.cc:359] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.628412  8121 leader_election.cc:290] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:03.628760  8103 raft_consensus.cc:385] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.630417  8103 raft_consensus.cc:740] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.627712  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2" is_pre_election: true
I20260709 13:01:03.631122  8060 raft_consensus.cc:2468] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 0.
I20260709 13:01:03.631911  8100 tablet_bootstrap.cc:492] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.627777  8101 ts_tablet_manager.cc:1434] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:01:03.629907  7951 leader_election.cc:304] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:03.632372  8100 ts_tablet_manager.cc:1403] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.031s
I20260709 13:01:03.633066  8101 tablet_bootstrap.cc:492] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.633277  8107 raft_consensus.cc:2804] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.633668  8107 raft_consensus.cc:493] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.634024  8107 raft_consensus.cc:3060] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:03.636116  7858 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:03.631330  8103 consensus_queue.cc:260] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.636503  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:03.637113  7987 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 0.
I20260709 13:01:03.637187  8100 raft_consensus.cc:359] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.637962  8100 raft_consensus.cc:385] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.638259  8100 raft_consensus.cc:740] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.639008  8100 consensus_queue.cc:260] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.639875  8103 ts_tablet_manager.cc:1434] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:01:03.640856  8103 tablet_bootstrap.cc:492] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.644930  8105 raft_consensus.cc:515] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.641093  8132 raft_consensus.cc:2804] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.643419  8101 tablet_bootstrap.cc:654] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.650501  8103 tablet_bootstrap.cc:654] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.651813  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:03.653169  7876 leader_election.cc:304] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:03.654248  8108 raft_consensus.cc:2804] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.654697  8108 raft_consensus.cc:493] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.655107  8108 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.659224  8105 leader_election.cc:290] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.662365  8103 tablet_bootstrap.cc:492] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.662894  8103 ts_tablet_manager.cc:1403] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:01:03.663252  8107 raft_consensus.cc:515] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.664538  7986 raft_consensus.cc:2393] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbed390f195142aaada345fea2cf4452 in current term 1: Already voted for candidate 42ca725e1af946e2b5391e518d1ed976 in this term.
I20260709 13:01:03.666710  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:03.667280  7912 raft_consensus.cc:3060] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.666006  8103 raft_consensus.cc:359] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.672441  8103 raft_consensus.cc:385] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.672823  8103 raft_consensus.cc:740] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.673705  8103 consensus_queue.cc:260] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.674768  7912 raft_consensus.cc:2468] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 1.
I20260709 13:01:03.675124  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:03.675915  8060 raft_consensus.cc:3060] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.676216  7951 leader_election.cc:304] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:03.677107  8121 raft_consensus.cc:2804] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.677145  8108 raft_consensus.cc:515] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.679653  8108 leader_election.cc:290] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:03.682394  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:03.683131  7986 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.686267  8060 raft_consensus.cc:2468] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 1.
I20260709 13:01:03.688541  8107 leader_election.cc:290] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:03.691294  8121 raft_consensus.cc:697] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Becoming Leader. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:03.648504  8132 raft_consensus.cc:493] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.692340  8100 ts_tablet_manager.cc:1434] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.060s	user 0.030s	sys 0.023s
I20260709 13:01:03.627005  7807 catalog_manager.cc:5697] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "42ca725e1af946e2b5391e518d1ed976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.692382  8121 consensus_queue.cc:237] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
W20260709 13:01:03.695971  8025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:41711, user_credentials={real_user=slave}} blocked reactor thread for 70519.5us
I20260709 13:01:03.696231  8103 ts_tablet_manager.cc:1434] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.007s
I20260709 13:01:03.692286  8132 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.697710  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:03.698556  7912 raft_consensus.cc:2393] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4f1af5c0177407da186daf0e6abbca2 in current term 1: Already voted for candidate bbed390f195142aaada345fea2cf4452 in this term.
I20260709 13:01:03.699888  8100 tablet_bootstrap.cc:492] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.705466  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:03.706303  7986 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 1.
I20260709 13:01:03.707685  7876 leader_election.cc:304] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:03.708382  8100 tablet_bootstrap.cc:654] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.708787  8136 raft_consensus.cc:2804] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.709365  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2" is_pre_election: true
I20260709 13:01:03.710202  8060 raft_consensus.cc:2393] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbed390f195142aaada345fea2cf4452 in current term 1: Already voted for candidate e4f1af5c0177407da186daf0e6abbca2 in this term.
I20260709 13:01:03.711122  8101 tablet_bootstrap.cc:492] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.711798  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2" is_pre_election: true
I20260709 13:01:03.712530  8060 raft_consensus.cc:2393] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbed390f195142aaada345fea2cf4452 in current term 1: Already voted for candidate 42ca725e1af946e2b5391e518d1ed976 in this term.
I20260709 13:01:03.712756  8132 raft_consensus.cc:515] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.714658  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:03.715541  8060 raft_consensus.cc:2393] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bbed390f195142aaada345fea2cf4452 in current term 1: Already voted for candidate e4f1af5c0177407da186daf0e6abbca2 in this term.
I20260709 13:01:03.715525  8132 leader_election.cc:290] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.715862  8103 tablet_bootstrap.cc:492] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.716466  8101 ts_tablet_manager.cc:1403] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.016s
I20260709 13:01:03.717024  8025 leader_election.cc:304] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f1af5c0177407da186daf0e6abbca2; no voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452
I20260709 13:01:03.719087  8132 raft_consensus.cc:2749] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:03.720498  7875 leader_election.cc:304] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbed390f195142aaada345fea2cf4452; no voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2
I20260709 13:01:03.721745  8108 raft_consensus.cc:2749] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:03.723434  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:03.727048  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:03.722980  8101 raft_consensus.cc:359] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
W20260709 13:01:03.728204  8025 leader_election.cc:343] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:03.728120  7986 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.730018  8101 raft_consensus.cc:385] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.731388  8101 raft_consensus.cc:740] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.733357  8103 tablet_bootstrap.cc:654] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.734529  8101 consensus_queue.cc:260] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.733639  8136 raft_consensus.cc:697] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:03.737087  8101 ts_tablet_manager.cc:1434] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:01:03.738009  8100 tablet_bootstrap.cc:492] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.738144  8101 tablet_bootstrap.cc:492] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.738545  8100 ts_tablet_manager.cc:1403] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.012s
I20260709 13:01:03.738551  8136 consensus_queue.cc:237] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.740537  7986 raft_consensus.cc:2468] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 1.
I20260709 13:01:03.741750  8025 leader_election.cc:304] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: bbed390f195142aaada345fea2cf4452
I20260709 13:01:03.741549  8100 raft_consensus.cc:359] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.742406  8100 raft_consensus.cc:385] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.742749  8100 raft_consensus.cc:740] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.742920  8132 raft_consensus.cc:2804] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.742980  8140 raft_consensus.cc:493] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.743459  8132 raft_consensus.cc:697] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:03.743503  8140 raft_consensus.cc:515] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.743564  8100 consensus_queue.cc:260] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.744462  8132 consensus_queue.cc:237] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.745980  8100 ts_tablet_manager.cc:1434] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:03.746901  8100 tablet_bootstrap.cc:492] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.747073  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2" is_pre_election: true
I20260709 13:01:03.747306  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:03.747677  8060 raft_consensus.cc:2468] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 0.
I20260709 13:01:03.747979  7987 raft_consensus.cc:2468] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 0.
I20260709 13:01:03.749274  7876 leader_election.cc:304] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:03.750137  8108 raft_consensus.cc:2804] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.750505  8108 raft_consensus.cc:493] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.750880  8108 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.750394  7807 catalog_manager.cc:5697] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "42ca725e1af946e2b5391e518d1ed976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.754294  8100 tablet_bootstrap.cc:654] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.754344  8140 leader_election.cc:290] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:03.759833  8108 raft_consensus.cc:515] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.766363  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:03.767009  7986 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.767153  8103 tablet_bootstrap.cc:492] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.767637  8103 ts_tablet_manager.cc:1403] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.006s
I20260709 13:01:03.770848  8103 raft_consensus.cc:359] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.771621  8103 raft_consensus.cc:385] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.771921  8103 raft_consensus.cc:740] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.773500  8100 tablet_bootstrap.cc:492] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.773423  8103 consensus_queue.cc:260] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.774353  8100 ts_tablet_manager.cc:1403] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.010s
I20260709 13:01:03.776357  8101 tablet_bootstrap.cc:654] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.778674  8103 ts_tablet_manager.cc:1434] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:01:03.778076  8100 raft_consensus.cc:359] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.779202  8100 raft_consensus.cc:385] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.779621  8100 raft_consensus.cc:740] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.779667  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:03.780504  8060 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.779683  8103 tablet_bootstrap.cc:492] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.780920  8100 consensus_queue.cc:260] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.784066  8100 ts_tablet_manager.cc:1434] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:03.785030  8105 raft_consensus.cc:493] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.785567  8105 raft_consensus.cc:515] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.787353  8060 raft_consensus.cc:2468] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 1.
I20260709 13:01:03.787576  8103 tablet_bootstrap.cc:654] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.788137  8108 leader_election.cc:290] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:03.788323  8105 leader_election.cc:290] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.788969  7986 raft_consensus.cc:2468] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 1.
I20260709 13:01:03.790155  7875 leader_election.cc:304] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:03.790323  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452" is_pre_election: true
I20260709 13:01:03.790903  7912 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.791448  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:03.792094  7987 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.792775  8100 tablet_bootstrap.cc:492] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2: Bootstrap starting.
I20260709 13:01:03.792104  8025 leader_election.cc:304] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:03.794440  8105 raft_consensus.cc:2804] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.794940  8105 raft_consensus.cc:493] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.791496  8108 raft_consensus.cc:2804] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.795444  8105 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.795668  8108 raft_consensus.cc:697] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:03.796816  8108 consensus_queue.cc:237] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.807132  8105 raft_consensus.cc:515] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.811149  7807 catalog_manager.cc:5697] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.812697  8101 tablet_bootstrap.cc:492] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.812815  7805 catalog_manager.cc:5697] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.821769  8101 ts_tablet_manager.cc:1403] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.004s
I20260709 13:01:03.815068  8100 tablet_bootstrap.cc:654] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.818424  8105 leader_election.cc:290] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.818614  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:03.825934  7912 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.820153  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:03.828982  7986 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.832158  7912 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 1.
I20260709 13:01:03.833422  8025 leader_election.cc:304] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:03.834502  8105 raft_consensus.cc:2804] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.836542  7986 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 1.
I20260709 13:01:03.820744  8103 tablet_bootstrap.cc:492] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.835009  8105 raft_consensus.cc:697] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:03.841089  8100 tablet_bootstrap.cc:492] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2: No bootstrap required, opened a new log
I20260709 13:01:03.840915  8105 consensus_queue.cc:237] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.841002  8101 raft_consensus.cc:359] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.841810  8100 ts_tablet_manager.cc:1403] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.003s
I20260709 13:01:03.842005  8101 raft_consensus.cc:385] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.842355  8101 raft_consensus.cc:740] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.842729  8103 ts_tablet_manager.cc:1403] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.003s
I20260709 13:01:03.843181  8101 consensus_queue.cc:260] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.844923  8100 raft_consensus.cc:359] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.845639  8100 raft_consensus.cc:385] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.846038  8100 raft_consensus.cc:740] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.845322  8103 raft_consensus.cc:359] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.845688  7807 catalog_manager.cc:5697] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.846838  8100 consensus_queue.cc:260] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.846892  8103 raft_consensus.cc:385] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.848295  8103 raft_consensus.cc:740] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.849462  8100 ts_tablet_manager.cc:1434] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:03.849110  8103 consensus_queue.cc:260] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.851420  8101 ts_tablet_manager.cc:1434] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.004s
I20260709 13:01:03.852555  8101 tablet_bootstrap.cc:492] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.853197  8103 ts_tablet_manager.cc:1434] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:01:03.854108  8103 tablet_bootstrap.cc:492] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.859961  8101 tablet_bootstrap.cc:654] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.859966  8103 tablet_bootstrap.cc:654] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.861657  7808 catalog_manager.cc:5697] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.870153  8101 tablet_bootstrap.cc:492] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.870560  8101 ts_tablet_manager.cc:1403] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 13:01:03.871307  8103 tablet_bootstrap.cc:492] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.871721  8103 ts_tablet_manager.cc:1403] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 13:01:03.872550  8101 raft_consensus.cc:359] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.873063  8101 raft_consensus.cc:385] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.873277  8101 raft_consensus.cc:740] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.873915  8101 consensus_queue.cc:260] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.874233  8103 raft_consensus.cc:359] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.874886  8103 raft_consensus.cc:385] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.875147  8103 raft_consensus.cc:740] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.875411  8101 ts_tablet_manager.cc:1434] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:03.876108  8101 tablet_bootstrap.cc:492] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.875754  8103 consensus_queue.cc:260] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.877669  8103 ts_tablet_manager.cc:1434] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:03.880668  8103 tablet_bootstrap.cc:492] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452: Bootstrap starting.
I20260709 13:01:03.881027  8101 tablet_bootstrap.cc:654] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.886008  8103 tablet_bootstrap.cc:654] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.897543  8103 tablet_bootstrap.cc:492] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452: No bootstrap required, opened a new log
I20260709 13:01:03.898054  8103 ts_tablet_manager.cc:1403] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.012s
I20260709 13:01:03.900271  8103 raft_consensus.cc:359] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.900792  8103 raft_consensus.cc:385] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.901017  8103 raft_consensus.cc:740] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.901571  8103 consensus_queue.cc:260] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.903406  8103 ts_tablet_manager.cc:1434] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:03.904449  8101 tablet_bootstrap.cc:492] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.904907  8101 ts_tablet_manager.cc:1403] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.015s
I20260709 13:01:03.906984  8101 raft_consensus.cc:359] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.907471  8101 raft_consensus.cc:385] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.907686  8101 raft_consensus.cc:740] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.908396  8101 consensus_queue.cc:260] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.910394  8101 ts_tablet_manager.cc:1434] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:01:03.911615  8101 tablet_bootstrap.cc:492] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976: Bootstrap starting.
I20260709 13:01:03.913348  8105 raft_consensus.cc:493] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.913842  8105 raft_consensus.cc:515] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.915787  8105 leader_election.cc:290] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.916827  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452" is_pre_election: true
I20260709 13:01:03.917438  7912 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.918462  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:03.918946  8025 leader_election.cc:304] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:03.919073  7986 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.920258  8105 raft_consensus.cc:2804] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.920413  8101 tablet_bootstrap.cc:654] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:03.920644  8105 raft_consensus.cc:493] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.921011  8105 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.924863  8101 tablet_bootstrap.cc:492] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976: No bootstrap required, opened a new log
I20260709 13:01:03.925231  8101 ts_tablet_manager.cc:1403] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:01:03.926486  8105 raft_consensus.cc:515] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.927496  8101 raft_consensus.cc:359] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.928047  8101 raft_consensus.cc:385] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:03.928161  8105 leader_election.cc:290] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.928318  8101 raft_consensus.cc:740] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Initialized, Role: FOLLOWER
I20260709 13:01:03.929203  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:03.929246  8101 consensus_queue.cc:260] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.929586  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:03.929916  7912 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.930153  7986 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.931020  8101 ts_tablet_manager.cc:1434] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:01:03.936563  7986 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 1.
I20260709 13:01:03.936882  7912 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 1.
I20260709 13:01:03.937682  8025 leader_election.cc:304] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:03.938458  8105 raft_consensus.cc:2804] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:03.938934  8105 raft_consensus.cc:697] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:03.939716  8105 consensus_queue.cc:237] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.946981  7810 catalog_manager.cc:5697] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.986451  8105 raft_consensus.cc:493] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.986958  8105 raft_consensus.cc:515] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.988582  8105 leader_election.cc:290] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.989506  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452" is_pre_election: true
I20260709 13:01:03.989705  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:03.990056  7912 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.990320  7986 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 0.
I20260709 13:01:03.991066  8025 leader_election.cc:304] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:03.991740  8105 raft_consensus.cc:2804] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:03.992094  8105 raft_consensus.cc:493] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.992390  8105 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:03.996701  8105 raft_consensus.cc:515] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:03.998813  8105 leader_election.cc:290] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:03.999595  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:03.999799  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:04.000131  7912 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.000327  7986 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.001032  8121 raft_consensus.cc:493] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.001495  8121 raft_consensus.cc:515] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.003535  8121 leader_election.cc:290] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.004451  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56a62c0051145c8a65c8675e2c2f4df" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452" is_pre_election: true
I20260709 13:01:04.004801  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56a62c0051145c8a65c8675e2c2f4df" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2" is_pre_election: true
I20260709 13:01:04.005195  7911 raft_consensus.cc:2468] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 0.
I20260709 13:01:04.005461  8060 raft_consensus.cc:2468] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 0.
I20260709 13:01:04.006609  7951 leader_election.cc:304] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:04.007149  7986 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 1.
I20260709 13:01:04.007730  8121 raft_consensus.cc:2804] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:04.008083  7912 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 1.
I20260709 13:01:04.008129  8121 raft_consensus.cc:493] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.008263  8025 leader_election.cc:304] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:04.008723  8121 raft_consensus.cc:3060] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.009382  8105 raft_consensus.cc:2804] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:04.009927  8105 raft_consensus.cc:697] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:04.010797  8105 consensus_queue.cc:237] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.015865  8121 raft_consensus.cc:515] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.018424  8121 leader_election.cc:290] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.018553  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56a62c0051145c8a65c8675e2c2f4df" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:04.019203  7912 raft_consensus.cc:3060] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.019414  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56a62c0051145c8a65c8675e2c2f4df" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.019956  8060 raft_consensus.cc:3060] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.020598  7810 catalog_manager.cc:5697] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:04.026032  7912 raft_consensus.cc:2468] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 1.
I20260709 13:01:04.027076  8060 raft_consensus.cc:2468] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 1.
I20260709 13:01:04.027180  7951 leader_election.cc:304] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:04.028062  8121 raft_consensus.cc:2804] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:04.028534  8121 raft_consensus.cc:697] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Becoming Leader. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:04.029332  8121 consensus_queue.cc:237] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.037073  7810 catalog_manager.cc:5697] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "42ca725e1af946e2b5391e518d1ed976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.040620  8121 consensus_queue.cc:1048] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.054339  8121 consensus_queue.cc:1048] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.072043  8108 raft_consensus.cc:493] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.072461  8108 raft_consensus.cc:515] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.073971  8108 leader_election.cc:290] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.074764  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e07d3f5f184133a38c88f8a78d85a7" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:04.075023  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e07d3f5f184133a38c88f8a78d85a7" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2" is_pre_election: true
I20260709 13:01:04.075280  7986 raft_consensus.cc:2468] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 0.
I20260709 13:01:04.075582  8060 raft_consensus.cc:2468] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 0.
I20260709 13:01:04.076370  7876 leader_election.cc:304] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:04.077107  8108 raft_consensus.cc:2804] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:04.077433  8108 raft_consensus.cc:493] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.077649  8108 raft_consensus.cc:3060] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.082091  8108 raft_consensus.cc:515] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.083557  8108 leader_election.cc:290] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.084256  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e07d3f5f184133a38c88f8a78d85a7" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:04.084434  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e07d3f5f184133a38c88f8a78d85a7" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.084875  7986 raft_consensus.cc:3060] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.084908  8060 raft_consensus.cc:3060] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.091447  7986 raft_consensus.cc:2468] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 1.
I20260709 13:01:04.091447  8060 raft_consensus.cc:2468] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 1.
I20260709 13:01:04.092682  7875 leader_election.cc:304] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:04.093360  8108 raft_consensus.cc:2804] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:04.093767  8108 raft_consensus.cc:697] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:04.094444  8108 consensus_queue.cc:237] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.100868  7810 catalog_manager.cc:5697] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.109632  8108 raft_consensus.cc:493] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.110095  8108 raft_consensus.cc:515] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.111744  8108 leader_election.cc:290] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.112465  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ca725e1af946e2b5391e518d1ed976" is_pre_election: true
I20260709 13:01:04.112721  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f1af5c0177407da186daf0e6abbca2" is_pre_election: true
I20260709 13:01:04.113124  7986 raft_consensus.cc:2393] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbed390f195142aaada345fea2cf4452 in current term 1: Already voted for candidate e4f1af5c0177407da186daf0e6abbca2 in this term.
I20260709 13:01:04.114069  7876 leader_election.cc:304] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbed390f195142aaada345fea2cf4452; no voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2
I20260709 13:01:04.114707  8108 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:04.119335  8108 raft_consensus.cc:2749] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:04.127895  8121 consensus_queue.cc:1048] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.138571  8137 consensus_queue.cc:1048] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:04.224203  8108 consensus_queue.cc:1048] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.235477  8108 consensus_queue.cc:1048] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:04.242949  8105 consensus_queue.cc:1048] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.261734  7987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4089d3ce626419fa26f775052e0b456"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:53996
I20260709 13:01:04.262406  7987 raft_consensus.cc:606] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:04.262715  8132 consensus_queue.cc:1048] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.271880  7987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:53996
I20260709 13:01:04.272598  7987 raft_consensus.cc:606] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:04.286679  8060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:01:04.287503  8060 raft_consensus.cc:606] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:04.292618  8060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:01:04.293200  8060 raft_consensus.cc:606] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:04.303685  8136 consensus_queue.cc:1048] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.306752  7912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
mode: GRACEFUL
new_leader_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:37498
I20260709 13:01:04.307370  7912 raft_consensus.cc:606] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Received request to transfer leadership to TS 42ca725e1af946e2b5391e518d1ed976
I20260709 13:01:04.308152  8132 consensus_queue.cc:1048] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.315568  8140 raft_consensus.cc:993] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452: : Instructing follower 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:04.316011  8140 raft_consensus.cc:1081] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Signalling peer 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:04.319365  7986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:53988
I20260709 13:01:04.319785  8061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
mode: GRACEFUL
new_leader_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:01:04.320431  8061 raft_consensus.cc:606] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Received request to transfer leadership to TS 42ca725e1af946e2b5391e518d1ed976
I20260709 13:01:04.321201  8108 consensus_queue.cc:1048] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.319942  7986 raft_consensus.cc:493] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.331178  7986 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.331400  8105 consensus_queue.cc:1048] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.338876  8060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
mode: GRACEFUL
new_leader_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:01:04.338899  7986 raft_consensus.cc:515] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.340010  8060 raft_consensus.cc:606] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Received request to transfer leadership to TS 42ca725e1af946e2b5391e518d1ed976
I20260709 13:01:04.340633  7987 raft_consensus.cc:1240] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Rejecting Update request from peer bbed390f195142aaada345fea2cf4452 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:04.344204  8136 consensus_queue.cc:1059] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.344770  7986 leader_election.cc:290] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 2 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.344949  8136 raft_consensus.cc:3055] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.345324  8136 raft_consensus.cc:740] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:04.345392  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:04.346189  8136 consensus_queue.cc:260] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.347381  8136 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.351884  8132 raft_consensus.cc:993] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:04.352325  8132 raft_consensus.cc:1081] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:04.352492  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.353099  8060 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.354105  7910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:37484
I20260709 13:01:04.354688  7910 raft_consensus.cc:493] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.355053  7910 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.358064  7912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92e07d3f5f184133a38c88f8a78d85a7"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
mode: GRACEFUL
new_leader_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:37498
I20260709 13:01:04.358747  7912 raft_consensus.cc:606] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Received request to transfer leadership to TS e4f1af5c0177407da186daf0e6abbca2
I20260709 13:01:04.360193  8060 raft_consensus.cc:2468] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 2.
I20260709 13:01:04.361260  7950 leader_election.cc:304] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:04.362032  8137 raft_consensus.cc:2804] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.362458  8137 raft_consensus.cc:697] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Becoming Leader. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:04.363265  8137 consensus_queue.cc:237] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.364099  7910 raft_consensus.cc:515] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.366007  7911 raft_consensus.cc:2468] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 2.
I20260709 13:01:04.366277  7910 leader_election.cc:290] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 2 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.367376  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:04.367805  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.368350  8060 raft_consensus.cc:3055] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.368664  8060 raft_consensus.cc:740] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:04.367959  7986 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.369570  8060 consensus_queue.cc:260] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.370877  8060 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.374912  7805 catalog_manager.cc:5697] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 reported cstate change: term changed from 1 to 2, leader changed from bbed390f195142aaada345fea2cf4452 (127.7.28.193) to 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "42ca725e1af946e2b5391e518d1ed976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.376314  7986 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 2.
I20260709 13:01:04.377477  7876 leader_election.cc:304] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:04.377931  8060 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 2.
I20260709 13:01:04.378417  8136 raft_consensus.cc:2804] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.378882  8136 raft_consensus.cc:697] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:04.379695  8136 consensus_queue.cc:237] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.386660  7805 catalog_manager.cc:5697] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 1 to 2, leader changed from e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.406219  8105 consensus_queue.cc:1048] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.412418  8132 raft_consensus.cc:993] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2: : Instructing follower 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:04.413065  8105 raft_consensus.cc:1081] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Signalling peer 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:04.415091  7987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:53982
I20260709 13:01:04.417254  7987 raft_consensus.cc:493] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.417663  7987 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.418725  8182 consensus_queue.cc:1048] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.424870  7987 raft_consensus.cc:515] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.429517  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:04.429854  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.430145  7911 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.430418  8060 raft_consensus.cc:3055] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.430716  8060 raft_consensus.cc:740] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:04.431371  7987 leader_election.cc:290] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 2 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.432811  8060 consensus_queue.cc:260] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.434125  8060 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.438280  7911 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 2.
I20260709 13:01:04.440284  7951 leader_election.cc:304] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:04.441123  8137 raft_consensus.cc:2804] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.441040  8060 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 2.
I20260709 13:01:04.441650  8137 raft_consensus.cc:697] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Becoming Leader. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:04.442541  8137 consensus_queue.cc:237] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.443303  8132 consensus_queue.cc:1048] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.450150  7805 catalog_manager.cc:5697] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 reported cstate change: term changed from 1 to 2, leader changed from e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195) to 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "42ca725e1af946e2b5391e518d1ed976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.455984  8132 consensus_queue.cc:1048] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.465967  8182 raft_consensus.cc:993] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2: : Instructing follower 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:04.466454  8132 raft_consensus.cc:1081] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Signalling peer 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:04.467995  7987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:53982
I20260709 13:01:04.468588  7987 raft_consensus.cc:493] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.469039  7987 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.473896  7987 raft_consensus.cc:515] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.476257  7987 leader_election.cc:290] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 2 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.476940  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.476395  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:04.477532  8060 raft_consensus.cc:3055] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.477877  7911 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.477886  8060 raft_consensus.cc:740] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:04.478808  8060 consensus_queue.cc:260] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.479980  8060 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.484711  7911 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 2.
I20260709 13:01:04.485885  7951 leader_election.cc:304] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:04.486604  8060 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 2.
I20260709 13:01:04.486709  8137 raft_consensus.cc:2804] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.487319  8137 raft_consensus.cc:697] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Becoming Leader. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:04.488095  8137 consensus_queue.cc:237] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.494520  7810 catalog_manager.cc:5697] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 reported cstate change: term changed from 1 to 2, leader changed from e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195) to 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "42ca725e1af946e2b5391e518d1ed976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.532538  8107 raft_consensus.cc:993] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:04.533001  8137 raft_consensus.cc:1081] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:04.534667  7911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4089d3ce626419fa26f775052e0b456"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:44644
I20260709 13:01:04.535205  7911 raft_consensus.cc:493] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.535526  7911 raft_consensus.cc:3060] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.540403  7911 raft_consensus.cc:515] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:04.542070  7911 leader_election.cc:290] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 2 election: Requested vote from peers e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:04.542910  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4089d3ce626419fa26f775052e0b456" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.543094  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4089d3ce626419fa26f775052e0b456" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:04.543401  8060 raft_consensus.cc:3060] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.543625  7987 raft_consensus.cc:3055] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.544006  7987 raft_consensus.cc:740] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:04.544662  7987 consensus_queue.cc:260] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:04.545518  7987 raft_consensus.cc:3060] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.548134  8060 raft_consensus.cc:2468] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 2.
I20260709 13:01:04.549202  7875 leader_election.cc:304] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:04.549916  8136 raft_consensus.cc:2804] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.550381  8136 raft_consensus.cc:697] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:04.550879  7987 raft_consensus.cc:2468] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 2.
I20260709 13:01:04.551241  8136 consensus_queue.cc:237] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } }
I20260709 13:01:04.555186  8137 consensus_queue.cc:1048] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.557631  7810 catalog_manager.cc:5697] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 1 to 2, leader changed from 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:04.570036  8137 consensus_queue.cc:1048] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.603842  8136 consensus_queue.cc:1048] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.615161  8108 consensus_queue.cc:1048] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:04.622351  8140 raft_consensus.cc:993] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452: : Instructing follower e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:04.622793  8108 raft_consensus.cc:1081] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Signalling peer e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:04.624362  8060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92e07d3f5f184133a38c88f8a78d85a7"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:01:04.624927  8060 raft_consensus.cc:493] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.625458  8060 raft_consensus.cc:3060] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.630070  8060 raft_consensus.cc:515] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.631549  8060 leader_election.cc:290] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 2 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:04.632475  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e07d3f5f184133a38c88f8a78d85a7" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:04.632911  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e07d3f5f184133a38c88f8a78d85a7" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:04.633064  7911 raft_consensus.cc:3055] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.633430  7987 raft_consensus.cc:3060] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.633414  7911 raft_consensus.cc:740] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:04.634995  7911 consensus_queue.cc:260] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.636355  7911 raft_consensus.cc:3060] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.641340  7987 raft_consensus.cc:2468] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 2.
I20260709 13:01:04.642673  8025 leader_election.cc:304] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:04.643088  7911 raft_consensus.cc:2468] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 2.
I20260709 13:01:04.643564  8132 raft_consensus.cc:2804] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.644133  8132 raft_consensus.cc:697] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 2 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:04.645056  8132 consensus_queue.cc:237] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.652421  7810 catalog_manager.cc:5697] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 1 to 2, leader changed from bbed390f195142aaada345fea2cf4452 (127.7.28.193) to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:04.696933  8107 raft_consensus.cc:993] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:04.697307  8137 raft_consensus.cc:1081] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:04.698750  7911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:44644
I20260709 13:01:04.699230  7911 raft_consensus.cc:493] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.699537  7911 raft_consensus.cc:3060] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.704005  7911 raft_consensus.cc:515] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.705668  7911 leader_election.cc:290] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 2 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.706694  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.706913  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34508e7f9d40d4921206f17d495b61" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:04.707187  8060 raft_consensus.cc:3060] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.707501  7987 raft_consensus.cc:3055] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.707787  7987 raft_consensus.cc:740] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:04.708454  7987 consensus_queue.cc:260] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.709318  7987 raft_consensus.cc:3060] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.711870  8060 raft_consensus.cc:2468] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 2.
I20260709 13:01:04.712893  7875 leader_election.cc:304] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:04.713544  8108 raft_consensus.cc:2804] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.713785  7987 raft_consensus.cc:2468] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 2.
I20260709 13:01:04.713955  8108 raft_consensus.cc:697] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:04.714805  8108 consensus_queue.cc:237] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.720530  7810 catalog_manager.cc:5697] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 1 to 2, leader changed from 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.826450  8182 raft_consensus.cc:993] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:04.826866  8132 raft_consensus.cc:1081] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:04.828253  7911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:37484
I20260709 13:01:04.828732  7911 raft_consensus.cc:493] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.829061  7911 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.833467  7911 raft_consensus.cc:515] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.835052  7911 leader_election.cc:290] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 2 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:04.836018  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:04.836239  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:04.836627  7987 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.836798  8060 raft_consensus.cc:3055] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:04.837167  8060 raft_consensus.cc:740] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:04.837944  8060 consensus_queue.cc:260] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.838836  8060 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.841687  7987 raft_consensus.cc:2468] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 2.
I20260709 13:01:04.842890  7876 leader_election.cc:304] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:04.843457  8060 raft_consensus.cc:2468] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 2.
I20260709 13:01:04.843688  8108 raft_consensus.cc:2804] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.844251  8108 raft_consensus.cc:697] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:04.845156  8108 consensus_queue.cc:237] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:04.852504  7810 catalog_manager.cc:5697] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 1 to 2, leader changed from e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.860708  8060 raft_consensus.cc:1275] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:04.861955  8137 consensus_queue.cc:1048] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.871160  7911 raft_consensus.cc:1275] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:04.872586  8187 consensus_queue.cc:1048] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.905682  7911 raft_consensus.cc:1275] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:04.907024  8187 consensus_queue.cc:1048] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.914533  8060 raft_consensus.cc:1275] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:04.916054  8107 consensus_queue.cc:1048] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.923151  7987 raft_consensus.cc:1275] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:04.924309  8108 consensus_queue.cc:1048] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.933136  8060 raft_consensus.cc:1275] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:04.934540  8140 consensus_queue.cc:1048] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.973095  7911 raft_consensus.cc:1275] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:04.974320  8107 consensus_queue.cc:1048] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.980978  8060 raft_consensus.cc:1275] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:04.982993  8107 consensus_queue.cc:1048] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.033914  7987 raft_consensus.cc:1275] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.035211  8132 consensus_queue.cc:1048] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.044015  7911 raft_consensus.cc:1275] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.045593  8182 consensus_queue.cc:1048] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.063378  7987 raft_consensus.cc:1275] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.064735  8191 consensus_queue.cc:1048] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.072434  8060 raft_consensus.cc:1275] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.073874  8108 consensus_queue.cc:1048] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.107873  8060 raft_consensus.cc:1275] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.109063  8108 consensus_queue.cc:1048] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.115852  7987 raft_consensus.cc:1275] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.117290  8191 consensus_queue.cc:1048] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.252883  7987 raft_consensus.cc:1275] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.254317  8191 consensus_queue.cc:1048] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.262449  8060 raft_consensus.cc:1275] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.263978  8140 consensus_queue.cc:1048] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:07.389451  7283 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:01:07.390182  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:07.406373  7911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
mode: GRACEFUL
new_leader_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:37510
I20260709 13:01:07.406960  7911 raft_consensus.cc:606] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Received request to transfer leadership to TS e4f1af5c0177407da186daf0e6abbca2
I20260709 13:01:07.409555  7911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
mode: GRACEFUL
new_leader_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:37510
I20260709 13:01:07.410091  7911 raft_consensus.cc:606] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Received request to transfer leadership to TS e4f1af5c0177407da186daf0e6abbca2
I20260709 13:01:07.411257  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:07.411756  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:07.446369  8136 raft_consensus.cc:993] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452: : Instructing follower e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:07.446857  8197 raft_consensus.cc:1081] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Signalling peer e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:07.448324  8060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:01:07.448776  8060 raft_consensus.cc:493] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:07.449062  8060 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.452927  8060 raft_consensus.cc:515] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:07.454628  8060 leader_election.cc:290] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 3 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:07.455482  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:07.455741  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:07.456080  7911 raft_consensus.cc:3055] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:07.456306  7987 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.456521  7911 raft_consensus.cc:740] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:07.457293  7911 consensus_queue.cc:260] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:07.458200  7911 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.461055  7987 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 3.
I20260709 13:01:07.462216  8025 leader_election.cc:304] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:07.462805  7911 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 3.
I20260709 13:01:07.462905  8196 raft_consensus.cc:2804] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:07.463969  8196 raft_consensus.cc:697] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 3 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:07.464704  8196 consensus_queue.cc:237] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:07.471318  7805 catalog_manager.cc:5697] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 2 to 3, leader changed from bbed390f195142aaada345fea2cf4452 (127.7.28.193) to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:07.532037  8136 raft_consensus.cc:993] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452: : Instructing follower e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:07.532537  8197 raft_consensus.cc:1081] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Signalling peer e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:07.534068  8060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:01:07.534529  8060 raft_consensus.cc:493] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:07.534776  8060 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:07.538734  8060 raft_consensus.cc:515] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:07.540225  8060 leader_election.cc:290] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 2 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:07.541071  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:07.541361  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:07.541579  7911 raft_consensus.cc:3055] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:07.541949  7987 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:07.541983  7911 raft_consensus.cc:740] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:07.542773  7911 consensus_queue.cc:260] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:07.543658  7911 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:07.546763  7987 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 2.
I20260709 13:01:07.547871  8025 leader_election.cc:304] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:07.548408  7911 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 2.
I20260709 13:01:07.548566  8196 raft_consensus.cc:2804] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:07.549052  8196 raft_consensus.cc:697] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 2 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:07.549898  8196 consensus_queue.cc:237] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:07.556898  7805 catalog_manager.cc:5697] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 1 to 2, leader changed from bbed390f195142aaada345fea2cf4452 (127.7.28.193) to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:07.849488  7911 raft_consensus.cc:1275] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:07.850721  8196 consensus_queue.cc:1048] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:07.866267  7987 raft_consensus.cc:1275] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:07.867640  8196 consensus_queue.cc:1048] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:07.944859  7987 raft_consensus.cc:1275] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:07.945994  8196 consensus_queue.cc:1048] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:07.954218  7911 raft_consensus.cc:1275] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:07.956306  8196 consensus_queue.cc:1048] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.412544  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:08.426635  8060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:01:08.427145  8060 raft_consensus.cc:606] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 2 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:08.438071  8060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:01:08.438504  8060 raft_consensus.cc:606] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 3 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:08.442797  7987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:53996
I20260709 13:01:08.443235  7987 raft_consensus.cc:606] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:08.448043  7987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:53996
I20260709 13:01:08.448567  7987 raft_consensus.cc:606] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:08.453403  7987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
mode: GRACEFUL
new_leader_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:53996
I20260709 13:01:08.453970  7987 raft_consensus.cc:606] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Received request to transfer leadership to TS bbed390f195142aaada345fea2cf4452
I20260709 13:01:08.465260  8187 raft_consensus.cc:993] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:08.465711  8215 raft_consensus.cc:1081] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:08.467316  7911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:44644
I20260709 13:01:08.467876  7911 raft_consensus.cc:493] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.468227  7911 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.472424  7911 raft_consensus.cc:515] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.473737  7911 leader_election.cc:290] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 3 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:08.474789  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:08.474906  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad2a4e64209444cb20385d15e2a02ec" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:08.475340  7987 raft_consensus.cc:3055] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:08.475383  8060 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.475618  7987 raft_consensus.cc:740] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:08.476326  7987 consensus_queue.cc:260] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.477164  7987 raft_consensus.cc:3060] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.479712  8060 raft_consensus.cc:2468] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 3.
I20260709 13:01:08.480799  7875 leader_election.cc:304] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:08.481320  7987 raft_consensus.cc:2468] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 3.
I20260709 13:01:08.481472  8197 raft_consensus.cc:2804] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:08.482784  8197 raft_consensus.cc:697] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:08.483541  8197 consensus_queue.cc:237] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.489972  7805 catalog_manager.cc:5697] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 2 to 3, leader changed from 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 3 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:08.681115  8200 raft_consensus.cc:993] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:08.681668  8209 raft_consensus.cc:1081] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 3 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:08.683142  7911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:37484
I20260709 13:01:08.683609  7911 raft_consensus.cc:493] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.683893  7911 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.688647  7911 raft_consensus.cc:515] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.690958  7911 leader_election.cc:290] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 4 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:08.691720  7987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:08.692203  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a93e63b0d941cdb6a8039868fcaf29" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:08.692731  8060 raft_consensus.cc:3055] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:08.692977  8060 raft_consensus.cc:740] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:08.693570  8060 consensus_queue.cc:260] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.694432  8060 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.698580  8060 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 4.
I20260709 13:01:08.692212  7987 raft_consensus.cc:3060] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.699779  7875 leader_election.cc:304] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:08.700631  8197 raft_consensus.cc:2804] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:08.701116  8197 raft_consensus.cc:697] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 4 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:08.701925  8197 consensus_queue.cc:237] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.704295  7987 raft_consensus.cc:2468] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 4.
I20260709 13:01:08.708467  7805 catalog_manager.cc:5697] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 3 to 4, leader changed from e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 4 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:08.893478  8060 raft_consensus.cc:1275] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:08.894793  8197 consensus_queue.cc:1048] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:08.907716  7986 raft_consensus.cc:1275] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:08.909229  8216 consensus_queue.cc:1048] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:08.925745  8187 raft_consensus.cc:993] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:08.926225  8215 raft_consensus.cc:1081] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:08.927753  7911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:44644
I20260709 13:01:08.928339  7911 raft_consensus.cc:493] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.928594  7911 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.932742  7911 raft_consensus.cc:515] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.934355  7911 leader_election.cc:290] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 3 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:08.935267  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:08.935770  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:08.935984  7986 raft_consensus.cc:3055] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:08.936370  8060 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.936378  7986 raft_consensus.cc:740] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:08.937727  8200 raft_consensus.cc:993] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:08.937369  7986 consensus_queue.cc:260] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.938207  8209 raft_consensus.cc:1081] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 2 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:08.938925  7986 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.939682  7911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:37484
I20260709 13:01:08.940152  7911 raft_consensus.cc:493] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.940492  7911 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.943771  8060 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 3.
I20260709 13:01:08.944890  7911 raft_consensus.cc:515] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.944958  7875 leader_election.cc:304] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:08.946020  8216 raft_consensus.cc:2804] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:08.946218  7986 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 3.
I20260709 13:01:08.946599  8216 raft_consensus.cc:697] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:08.947686  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:08.947485  8216 consensus_queue.cc:237] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.948236  7986 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.948477  7911 leader_election.cc:290] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 3 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:08.950212  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:08.950706  8060 raft_consensus.cc:3055] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:08.951030  8060 raft_consensus.cc:740] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:08.951874  8060 consensus_queue.cc:260] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.952980  8060 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.956043  7986 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 3.
I20260709 13:01:08.956489  7805 catalog_manager.cc:5697] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 2 to 3, leader changed from 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 3 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:08.957221  7876 leader_election.cc:304] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, bbed390f195142aaada345fea2cf4452; no voters: 
I20260709 13:01:08.958050  8216 raft_consensus.cc:2804] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:08.958240  8060 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 3.
I20260709 13:01:08.958809  8216 raft_consensus.cc:697] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:08.959625  8216 consensus_queue.cc:237] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:08.968736  7805 catalog_manager.cc:5697] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 2 to 3, leader changed from e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 3 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.013096  8187 raft_consensus.cc:993] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976: : Instructing follower bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:09.013525  8187 raft_consensus.cc:1081] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Signalling peer bbed390f195142aaada345fea2cf4452 to start an election
I20260709 13:01:09.014958  7911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
 from {username='slave'} at 127.0.0.1:44644
I20260709 13:01:09.015410  7911 raft_consensus.cc:493] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:09.015686  7911 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.019724  7911 raft_consensus.cc:515] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:09.021111  7911 leader_election.cc:290] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 3 election: Requested vote from peers 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:09.022100  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:09.022001  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "bbed390f195142aaada345fea2cf4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:09.022683  8060 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.022730  7986 raft_consensus.cc:3055] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:09.023138  7986 raft_consensus.cc:740] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:09.023910  7986 consensus_queue.cc:260] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:09.025058  7986 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.028970  8060 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 3.
I20260709 13:01:09.030072  7875 leader_election.cc:304] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbed390f195142aaada345fea2cf4452, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:09.030741  8216 raft_consensus.cc:2804] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:09.031217  8216 raft_consensus.cc:697] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Becoming Leader. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:09.031242  7986 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbed390f195142aaada345fea2cf4452 in term 3.
I20260709 13:01:09.032104  8216 consensus_queue.cc:237] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:09.038740  7805 catalog_manager.cc:5697] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 reported cstate change: term changed from 2 to 3, leader changed from 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194) to bbed390f195142aaada345fea2cf4452 (127.7.28.193). New cstate: current_term: 3 leader_uuid: "bbed390f195142aaada345fea2cf4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.090572  7986 raft_consensus.cc:1275] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:09.091849  8224 consensus_queue.cc:1048] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:09.101025  8060 raft_consensus.cc:1275] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:09.102691  8197 consensus_queue.cc:1048] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:09.373116  8060 raft_consensus.cc:1275] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:09.374388  8197 consensus_queue.cc:1048] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.384711  7986 raft_consensus.cc:1275] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:09.386694  8197 consensus_queue.cc:1048] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.415897  8060 raft_consensus.cc:1275] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:09.417114  8197 consensus_queue.cc:1048] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.426106  7986 raft_consensus.cc:1275] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:09.427714  8197 consensus_queue.cc:1048] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.472751  7986 raft_consensus.cc:1275] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:09.474148  8197 consensus_queue.cc:1048] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.484266  8060 raft_consensus.cc:1275] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Refusing update from remote peer bbed390f195142aaada345fea2cf4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:09.486182  8234 consensus_queue.cc:1048] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:11.462375  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:11.470990  7911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
mode: GRACEFUL
new_leader_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:37510
I20260709 13:01:11.471649  7911 raft_consensus.cc:606] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Received request to transfer leadership to TS 42ca725e1af946e2b5391e518d1ed976
I20260709 13:01:11.474177  7911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
mode: GRACEFUL
new_leader_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:37510
I20260709 13:01:11.474650  7911 raft_consensus.cc:606] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Received request to transfer leadership to TS e4f1af5c0177407da186daf0e6abbca2
I20260709 13:01:11.476927  7911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
mode: GRACEFUL
new_leader_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:37510
I20260709 13:01:11.477353  7911 raft_consensus.cc:606] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Received request to transfer leadership to TS e4f1af5c0177407da186daf0e6abbca2
I20260709 13:01:11.479496  7911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23"
dest_uuid: "bbed390f195142aaada345fea2cf4452"
mode: GRACEFUL
new_leader_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:37510
I20260709 13:01:11.479903  7911 raft_consensus.cc:606] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Received request to transfer leadership to TS 42ca725e1af946e2b5391e518d1ed976
I20260709 13:01:11.480881  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:11.481346  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:11.540998  8224 raft_consensus.cc:993] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452: : Instructing follower 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:11.541594  8239 raft_consensus.cc:1081] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Signalling peer 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:11.543325  7986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:53988
I20260709 13:01:11.543967  7986 raft_consensus.cc:493] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:11.544433  7986 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.549384  7986 raft_consensus.cc:515] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.550982  7986 leader_election.cc:290] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 3 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:11.552024  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:11.552187  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5ceb4d44f444c839c0f495d7906eb23" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:11.552706  7911 raft_consensus.cc:3055] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:11.552809  8060 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.553068  7911 raft_consensus.cc:740] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:11.553771  7911 consensus_queue.cc:260] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.554714  7911 raft_consensus.cc:3060] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.557366  8060 raft_consensus.cc:2468] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 3.
I20260709 13:01:11.558696  7950 leader_election.cc:304] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:11.559533  8187 raft_consensus.cc:2804] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:11.559619  7911 raft_consensus.cc:2468] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 3.
I20260709 13:01:11.560587  8187 raft_consensus.cc:697] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 3 LEADER]: Becoming Leader. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:11.561476  8187 consensus_queue.cc:237] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.567836  7807 catalog_manager.cc:5697] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 reported cstate change: term changed from 2 to 3, leader changed from bbed390f195142aaada345fea2cf4452 (127.7.28.193) to 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194). New cstate: current_term: 3 leader_uuid: "42ca725e1af946e2b5391e518d1ed976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.678548  8224 raft_consensus.cc:993] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452: : Instructing follower e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:11.679086  8239 raft_consensus.cc:1081] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Signalling peer e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:11.680444  8060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:01:11.680871  8060 raft_consensus.cc:493] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:11.681124  8060 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.685120  8060 raft_consensus.cc:515] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.686738  8060 leader_election.cc:290] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 4 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:11.687489  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:11.687785  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a06c29222fa4ad68cb600acc0641e2e" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:11.688046  7911 raft_consensus.cc:3055] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:11.688275  7986 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.688354  7911 raft_consensus.cc:740] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:11.689159  7911 consensus_queue.cc:260] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.690276  7911 raft_consensus.cc:3060] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.694463  7986 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 4.
I20260709 13:01:11.695890  8025 leader_election.cc:304] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:11.696061  7911 raft_consensus.cc:2468] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 4.
I20260709 13:01:11.696724  8209 raft_consensus.cc:2804] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:11.697909  8209 raft_consensus.cc:697] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 4 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:11.698696  8209 consensus_queue.cc:237] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.710974  7807 catalog_manager.cc:5697] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 3 to 4, leader changed from bbed390f195142aaada345fea2cf4452 (127.7.28.193) to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 4 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.775707  8224 raft_consensus.cc:993] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452: : Instructing follower e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:11.776183  8239 raft_consensus.cc:1081] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Signalling peer e4f1af5c0177407da186daf0e6abbca2 to start an election
I20260709 13:01:11.777562  8060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361"
dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
 from {username='slave'} at 127.0.0.1:40768
I20260709 13:01:11.778131  8060 raft_consensus.cc:493] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:11.778414  8060 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.782426  8060 raft_consensus.cc:515] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.783777  8060 leader_election.cc:290] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 4 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194:41711)
I20260709 13:01:11.784667  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:11.784961  7986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3f47c2789402fb6d61592f758c361" candidate_uuid: "e4f1af5c0177407da186daf0e6abbca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
I20260709 13:01:11.785140  7911 raft_consensus.cc:3055] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:11.785455  7986 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.785454  7911 raft_consensus.cc:740] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:11.786330  7911 consensus_queue.cc:260] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.787124  7911 raft_consensus.cc:3060] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.789696  7986 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 4.
I20260709 13:01:11.790627  8025 leader_election.cc:304] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:11.791230  7911 raft_consensus.cc:2468] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f1af5c0177407da186daf0e6abbca2 in term 4.
I20260709 13:01:11.791330  8209 raft_consensus.cc:2804] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:11.791849  8209 raft_consensus.cc:697] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 4 LEADER]: Becoming Leader. State: Replica: e4f1af5c0177407da186daf0e6abbca2, State: Running, Role: LEADER
I20260709 13:01:11.792680  8209 consensus_queue.cc:237] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.798915  7807 catalog_manager.cc:5697] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 reported cstate change: term changed from 3 to 4, leader changed from bbed390f195142aaada345fea2cf4452 (127.7.28.193) to e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195). New cstate: current_term: 4 leader_uuid: "e4f1af5c0177407da186daf0e6abbca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.960248  8224 raft_consensus.cc:993] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452: : Instructing follower 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:11.960685  8239 raft_consensus.cc:1081] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Signalling peer 42ca725e1af946e2b5391e518d1ed976 to start an election
I20260709 13:01:11.962285  7986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a"
dest_uuid: "42ca725e1af946e2b5391e518d1ed976"
 from {username='slave'} at 127.0.0.1:53988
I20260709 13:01:11.962707  7986 raft_consensus.cc:493] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:11.962996  7986 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.966934  7986 raft_consensus.cc:515] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.968377  7986 leader_election.cc:290] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 4 election: Requested vote from peers bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593), e4f1af5c0177407da186daf0e6abbca2 (127.7.28.195:35579)
I20260709 13:01:11.969388  8060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4f1af5c0177407da186daf0e6abbca2"
I20260709 13:01:11.969375  7911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e18b06754d4af89bf245d0a4d5e86a" candidate_uuid: "42ca725e1af946e2b5391e518d1ed976" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bbed390f195142aaada345fea2cf4452"
I20260709 13:01:11.970098  8060 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.970124  7911 raft_consensus.cc:3055] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:11.970606  7911 raft_consensus.cc:740] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bbed390f195142aaada345fea2cf4452, State: Running, Role: LEADER
I20260709 13:01:11.971311  7911 consensus_queue.cc:260] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.972430  7911 raft_consensus.cc:3060] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.976374  8060 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 4.
I20260709 13:01:11.977521  7950 leader_election.cc:304] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42ca725e1af946e2b5391e518d1ed976, e4f1af5c0177407da186daf0e6abbca2; no voters: 
I20260709 13:01:11.978443  8187 raft_consensus.cc:2804] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:11.978583  7911 raft_consensus.cc:2468] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42ca725e1af946e2b5391e518d1ed976 in term 4.
I20260709 13:01:11.979142  8187 raft_consensus.cc:697] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 4 LEADER]: Becoming Leader. State: Replica: 42ca725e1af946e2b5391e518d1ed976, State: Running, Role: LEADER
I20260709 13:01:11.980111  8187 consensus_queue.cc:237] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } }
I20260709 13:01:11.988490  7807 catalog_manager.cc:5697] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 reported cstate change: term changed from 3 to 4, leader changed from bbed390f195142aaada345fea2cf4452 (127.7.28.193) to 42ca725e1af946e2b5391e518d1ed976 (127.7.28.194). New cstate: current_term: 4 leader_uuid: "42ca725e1af946e2b5391e518d1ed976" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.039256  8060 raft_consensus.cc:1275] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:12.040740  8187 consensus_queue.cc:1048] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:12.051554  7911 raft_consensus.cc:1275] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:12.053296  8252 consensus_queue.cc:1048] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:12.113312  7986 raft_consensus.cc:1275] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:12.114622  8209 consensus_queue.cc:1048] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:12.124764  7911 raft_consensus.cc:1275] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:12.126544  8246 consensus_queue.cc:1048] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:12.190229  7986 raft_consensus.cc:1275] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:12.191424  8246 consensus_queue.cc:1048] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ca725e1af946e2b5391e518d1ed976" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:12.202191  7911 raft_consensus.cc:1275] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Refusing update from remote peer e4f1af5c0177407da186daf0e6abbca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:12.204138  8246 consensus_queue.cc:1048] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:12.425863  8060 raft_consensus.cc:1275] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:12.427210  8252 consensus_queue.cc:1048] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f1af5c0177407da186daf0e6abbca2" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:12.436944  7911 raft_consensus.cc:1275] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Refusing update from remote peer 42ca725e1af946e2b5391e518d1ed976: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:12.438330  8187 consensus_queue.cc:1048] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbed390f195142aaada345fea2cf4452" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:12.482213  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:12.488083  7283 tablet_server.cc:179] TabletServer@127.7.28.193:0 shutting down...
I20260709 13:01:12.516661  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:12.517390  7283 tablet_replica.cc:333] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.518132  7283 raft_consensus.cc:2243] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.518666  7283 raft_consensus.cc:2272] T f5ceb4d44f444c839c0f495d7906eb23 P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.521229  7283 tablet_replica.cc:333] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.521859  7283 raft_consensus.cc:2243] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.522289  7283 raft_consensus.cc:2272] T f56a62c0051145c8a65c8675e2c2f4df P bbed390f195142aaada345fea2cf4452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.524022  7283 tablet_replica.cc:333] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.524537  7283 raft_consensus.cc:2243] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.525307  7283 raft_consensus.cc:2272] T b4089d3ce626419fa26f775052e0b456 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.527186  7283 tablet_replica.cc:333] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.527675  7283 raft_consensus.cc:2243] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.528079  7283 raft_consensus.cc:2272] T 19e18b06754d4af89bf245d0a4d5e86a P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.530632  7283 tablet_replica.cc:333] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.531142  7283 raft_consensus.cc:2243] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.531591  7283 raft_consensus.cc:2272] T 92e07d3f5f184133a38c88f8a78d85a7 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.533279  7283 tablet_replica.cc:333] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.533975  7283 raft_consensus.cc:2243] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.534904  7283 raft_consensus.cc:2272] T aad2a4e64209444cb20385d15e2a02ec P bbed390f195142aaada345fea2cf4452 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:12.536163  7951 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 13:01:12.537698  7283 tablet_replica.cc:333] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.538432  7283 raft_consensus.cc:2243] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.539320  7283 raft_consensus.cc:2272] T b5a93e63b0d941cdb6a8039868fcaf29 P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:12.539574  7951 consensus_peers.cc:597] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 -> Peer bbed390f195142aaada345fea2cf4452 (127.7.28.193:43593): Couldn't send request to peer bbed390f195142aaada345fea2cf4452. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:12.541471  7283 tablet_replica.cc:333] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.542048  7283 raft_consensus.cc:2243] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.542451  7283 raft_consensus.cc:2272] T 59a3f47c2789402fb6d61592f758c361 P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.544589  7283 tablet_replica.cc:333] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.545089  7283 raft_consensus.cc:2243] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.545483  7283 raft_consensus.cc:2272] T 2a06c29222fa4ad68cb600acc0641e2e P bbed390f195142aaada345fea2cf4452 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.547314  7283 tablet_replica.cc:333] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452: stopping tablet replica
I20260709 13:01:12.547782  7283 raft_consensus.cc:2243] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.548484  7283 raft_consensus.cc:2272] T da34508e7f9d40d4921206f17d495b61 P bbed390f195142aaada345fea2cf4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.567662  7283 tablet_server.cc:196] TabletServer@127.7.28.193:0 shutdown complete.
I20260709 13:01:12.587826  7283 tablet_server.cc:179] TabletServer@127.7.28.194:0 shutting down...
I20260709 13:01:12.616950  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:12.617697  7283 tablet_replica.cc:333] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.618381  7283 raft_consensus.cc:2243] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.619180  7283 raft_consensus.cc:2272] T f56a62c0051145c8a65c8675e2c2f4df P 42ca725e1af946e2b5391e518d1ed976 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.621069  7283 tablet_replica.cc:333] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.621594  7283 raft_consensus.cc:2243] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.622335  7283 raft_consensus.cc:2272] T 19e18b06754d4af89bf245d0a4d5e86a P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.624418  7283 tablet_replica.cc:333] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.624963  7283 raft_consensus.cc:2243] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.625685  7283 raft_consensus.cc:2272] T f5ceb4d44f444c839c0f495d7906eb23 P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.627741  7283 tablet_replica.cc:333] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.628300  7283 raft_consensus.cc:2243] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.628783  7283 raft_consensus.cc:2272] T 92e07d3f5f184133a38c88f8a78d85a7 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.630664  7283 tablet_replica.cc:333] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.631199  7283 raft_consensus.cc:2243] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.631619  7283 raft_consensus.cc:2272] T b5a93e63b0d941cdb6a8039868fcaf29 P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.633201  7283 tablet_replica.cc:333] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.633687  7283 raft_consensus.cc:2243] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.634171  7283 raft_consensus.cc:2272] T 59a3f47c2789402fb6d61592f758c361 P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.636440  7283 tablet_replica.cc:333] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.636951  7283 raft_consensus.cc:2243] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.637391  7283 raft_consensus.cc:2272] T aad2a4e64209444cb20385d15e2a02ec P 42ca725e1af946e2b5391e518d1ed976 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.639170  7283 tablet_replica.cc:333] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.639665  7283 raft_consensus.cc:2243] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.640102  7283 raft_consensus.cc:2272] T b4089d3ce626419fa26f775052e0b456 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.641968  7283 tablet_replica.cc:333] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.642441  7283 raft_consensus.cc:2243] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.642853  7283 raft_consensus.cc:2272] T 2a06c29222fa4ad68cb600acc0641e2e P 42ca725e1af946e2b5391e518d1ed976 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.644827  7283 tablet_replica.cc:333] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976: stopping tablet replica
I20260709 13:01:12.645287  7283 raft_consensus.cc:2243] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.645704  7283 raft_consensus.cc:2272] T da34508e7f9d40d4921206f17d495b61 P 42ca725e1af946e2b5391e518d1ed976 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.668022  7283 tablet_server.cc:196] TabletServer@127.7.28.194:0 shutdown complete.
I20260709 13:01:12.686422  7283 tablet_server.cc:179] TabletServer@127.7.28.195:0 shutting down...
I20260709 13:01:12.710209  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:12.711202  7283 tablet_replica.cc:333] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.711993  7283 raft_consensus.cc:2243] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.712574  7283 raft_consensus.cc:2272] T f56a62c0051145c8a65c8675e2c2f4df P e4f1af5c0177407da186daf0e6abbca2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.714356  7283 tablet_replica.cc:333] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.714833  7283 raft_consensus.cc:2243] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.715234  7283 raft_consensus.cc:2272] T 19e18b06754d4af89bf245d0a4d5e86a P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.717088  7283 tablet_replica.cc:333] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.717542  7283 raft_consensus.cc:2243] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.718288  7283 raft_consensus.cc:2272] T 92e07d3f5f184133a38c88f8a78d85a7 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.720074  7283 tablet_replica.cc:333] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.720818  7283 raft_consensus.cc:2243] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.721556  7283 raft_consensus.cc:2272] T aad2a4e64209444cb20385d15e2a02ec P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.723882  7283 tablet_replica.cc:333] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.724534  7283 raft_consensus.cc:2243] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.725268  7283 raft_consensus.cc:2272] T 59a3f47c2789402fb6d61592f758c361 P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.727286  7283 tablet_replica.cc:333] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.727730  7283 raft_consensus.cc:2243] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.728083  7283 raft_consensus.cc:2272] T b5a93e63b0d941cdb6a8039868fcaf29 P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.729540  7283 tablet_replica.cc:333] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.730026  7283 raft_consensus.cc:2243] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.730363  7283 raft_consensus.cc:2272] T f5ceb4d44f444c839c0f495d7906eb23 P e4f1af5c0177407da186daf0e6abbca2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.732101  7283 tablet_replica.cc:333] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.732517  7283 raft_consensus.cc:2243] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.733148  7283 raft_consensus.cc:2272] T 2a06c29222fa4ad68cb600acc0641e2e P e4f1af5c0177407da186daf0e6abbca2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.734949  7283 tablet_replica.cc:333] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.735459  7283 raft_consensus.cc:2243] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.735802  7283 raft_consensus.cc:2272] T da34508e7f9d40d4921206f17d495b61 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.737560  7283 tablet_replica.cc:333] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2: stopping tablet replica
I20260709 13:01:12.738030  7283 raft_consensus.cc:2243] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:12.738413  7283 raft_consensus.cc:2272] T b4089d3ce626419fa26f775052e0b456 P e4f1af5c0177407da186daf0e6abbca2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.765712  7283 tablet_server.cc:196] TabletServer@127.7.28.195:0 shutdown complete.
I20260709 13:01:12.783388  7283 master.cc:562] Master@127.7.28.254:41797 shutting down...
I20260709 13:01:12.806499  7283 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:12.807260  7283 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:12.807735  7283 tablet_replica.cc:333] T 00000000000000000000000000000000 P f57ec4aa73434c9fa9bf71527c6eae0d: stopping tablet replica
I20260709 13:01:12.820469  7283 master.cc:584] Master@127.7.28.254:41797 shutdown complete.
42ca725e1af946e2b5391e518d1ed976  4
bbed390f195142aaada345fea2cf4452  5
e4f1af5c0177407da186daf0e6abbca2  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10353 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:01:12.864312  7283 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.28.254:35733
I20260709 13:01:12.865456  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:12.871490  8269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:12.871584  8268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:12.872123  8271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:12.873986  7283 server_base.cc:1061] running on GCE node
I20260709 13:01:12.874761  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:12.874953  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:12.875068  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602072875053 us; error 0 us; skew 500 ppm
I20260709 13:01:12.875515  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:12.878173  7283 webserver.cc:533] Webserver started at http://127.7.28.254:34089/ using document root <none> and password file <none>
I20260709 13:01:12.878625  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:12.878778  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:12.878993  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:12.880050  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/master-0-root/instance:
uuid: "9c29a936330e465e8f9c7de5c6f8056b"
format_stamp: "Formatted at 2026-07-09 13:01:12 on dist-test-slave-ll1f"
I20260709 13:01:12.884287  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:01:12.887557  8276 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:12.888386  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:12.888676  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/master-0-root
uuid: "9c29a936330e465e8f9c7de5c6f8056b"
format_stamp: "Formatted at 2026-07-09 13:01:12 on dist-test-slave-ll1f"
I20260709 13:01:12.888967  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:12.906792  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:12.908042  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:12.947506  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.254:35733
I20260709 13:01:12.947580  8327 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.254:35733 every 8 connection(s)
I20260709 13:01:12.951447  8328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.961086  8328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Bootstrap starting.
I20260709 13:01:12.965914  8328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.970011  8328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: No bootstrap required, opened a new log
I20260709 13:01:12.971995  8328 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c29a936330e465e8f9c7de5c6f8056b" member_type: VOTER }
I20260709 13:01:12.972355  8328 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.972540  8328 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c29a936330e465e8f9c7de5c6f8056b, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.973008  8328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c29a936330e465e8f9c7de5c6f8056b" member_type: VOTER }
I20260709 13:01:12.973417  8328 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:12.973601  8328 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:12.973866  8328 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.977896  8328 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c29a936330e465e8f9c7de5c6f8056b" member_type: VOTER }
I20260709 13:01:12.978374  8328 leader_election.cc:304] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c29a936330e465e8f9c7de5c6f8056b; no voters: 
I20260709 13:01:12.979399  8328 leader_election.cc:290] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:12.979712  8331 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.981046  8331 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 1 LEADER]: Becoming Leader. State: Replica: 9c29a936330e465e8f9c7de5c6f8056b, State: Running, Role: LEADER
I20260709 13:01:12.981743  8331 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c29a936330e465e8f9c7de5c6f8056b" member_type: VOTER }
I20260709 13:01:12.982407  8328 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:12.987020  8332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c29a936330e465e8f9c7de5c6f8056b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c29a936330e465e8f9c7de5c6f8056b" member_type: VOTER } }
I20260709 13:01:12.987772  8332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:12.988022  8333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c29a936330e465e8f9c7de5c6f8056b. Latest consensus state: current_term: 1 leader_uuid: "9c29a936330e465e8f9c7de5c6f8056b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c29a936330e465e8f9c7de5c6f8056b" member_type: VOTER } }
I20260709 13:01:12.988528  8333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:12.989989  8338 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:12.994961  8338 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:12.998708  7283 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:13.003679  8338 catalog_manager.cc:1383] Generated new cluster ID: c724ee0c9e584dffbd00f21e826aea75
I20260709 13:01:13.003978  8338 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:13.017635  8338 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:13.018949  8338 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:13.033288  8338 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Generated new TSK 0
I20260709 13:01:13.033928  8338 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:13.065057  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:13.070990  8349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:13.072115  8350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:13.074321  7283 server_base.cc:1061] running on GCE node
W20260709 13:01:13.074349  8352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:13.075373  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:13.075598  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:13.075767  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602073075749 us; error 0 us; skew 500 ppm
I20260709 13:01:13.076295  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:13.078662  7283 webserver.cc:533] Webserver started at http://127.7.28.193:46791/ using document root <none> and password file <none>
I20260709 13:01:13.079149  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:13.079351  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:13.079624  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:13.080654  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/instance:
uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
format_stamp: "Formatted at 2026-07-09 13:01:13 on dist-test-slave-ll1f"
I20260709 13:01:13.085127  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:13.088335  8357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.089267  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:13.089511  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
format_stamp: "Formatted at 2026-07-09 13:01:13 on dist-test-slave-ll1f"
I20260709 13:01:13.089756  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:13.111811  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:13.113086  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:13.114552  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:13.117085  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:13.117261  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.117590  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:13.117882  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.157332  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:35967
I20260709 13:01:13.157423  8419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:35967 every 8 connection(s)
I20260709 13:01:13.162091  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:13.169395  8424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:13.170605  8425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:13.172614  8427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:13.173426  7283 server_base.cc:1061] running on GCE node
I20260709 13:01:13.174803  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:13.175086  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:13.175279  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602073175243 us; error 0 us; skew 500 ppm
I20260709 13:01:13.175948  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:13.176285  8420 heartbeater.cc:344] Connected to a master server at 127.7.28.254:35733
I20260709 13:01:13.176714  8420 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:13.177577  8420 heartbeater.cc:507] Master 127.7.28.254:35733 requested a full tablet report, sending...
I20260709 13:01:13.178632  7283 webserver.cc:533] Webserver started at http://127.7.28.194:40053/ using document root <none> and password file <none>
I20260709 13:01:13.179221  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:13.179453  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:13.179755  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:13.180068  8293 ts_manager.cc:194] Registered new tserver with Master: 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:01:13.181330  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/instance:
uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
format_stamp: "Formatted at 2026-07-09 13:01:13 on dist-test-slave-ll1f"
I20260709 13:01:13.182497  8293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50728
I20260709 13:01:13.186556  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:01:13.189734  8432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.190615  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:13.190909  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root
uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
format_stamp: "Formatted at 2026-07-09 13:01:13 on dist-test-slave-ll1f"
I20260709 13:01:13.191256  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:13.205746  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:13.207038  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:13.208429  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:13.210613  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:13.210834  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.211079  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:13.211251  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.250803  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.194:32851
I20260709 13:01:13.250931  8494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.194:32851 every 8 connection(s)
I20260709 13:01:13.255478  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:13.262290  8498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:13.263392  8499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:13.267148  8501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:13.267829  7283 server_base.cc:1061] running on GCE node
I20260709 13:01:13.268831  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:13.269099  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:13.269330  8495 heartbeater.cc:344] Connected to a master server at 127.7.28.254:35733
I20260709 13:01:13.269330  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602073269307 us; error 0 us; skew 500 ppm
I20260709 13:01:13.269912  8495 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:13.270295  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:13.270712  8495 heartbeater.cc:507] Master 127.7.28.254:35733 requested a full tablet report, sending...
I20260709 13:01:13.273067  8293 ts_manager.cc:194] Registered new tserver with Master: d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:13.273188  7283 webserver.cc:533] Webserver started at http://127.7.28.195:39015/ using document root <none> and password file <none>
I20260709 13:01:13.273903  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:13.274140  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:13.274431  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:13.274662  8293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50742
I20260709 13:01:13.275861  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/instance:
uuid: "c45599d1dc3b4823b857cf77f276dc7b"
format_stamp: "Formatted at 2026-07-09 13:01:13 on dist-test-slave-ll1f"
I20260709 13:01:13.280652  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:13.284341  8506 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.285188  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:13.285516  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root
uuid: "c45599d1dc3b4823b857cf77f276dc7b"
format_stamp: "Formatted at 2026-07-09 13:01:13 on dist-test-slave-ll1f"
I20260709 13:01:13.285835  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:13.302492  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:13.303740  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:13.305197  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:13.307554  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:13.307792  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.308048  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:13.308224  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:13.347239  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.195:40791
I20260709 13:01:13.347330  8568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.195:40791 every 8 connection(s)
I20260709 13:01:13.361192  8569 heartbeater.cc:344] Connected to a master server at 127.7.28.254:35733
I20260709 13:01:13.361681  8569 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:13.362535  8569 heartbeater.cc:507] Master 127.7.28.254:35733 requested a full tablet report, sending...
I20260709 13:01:13.364604  8293 ts_manager.cc:194] Registered new tserver with Master: c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:13.365088  7283 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014673033s
I20260709 13:01:13.366459  8293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50744
I20260709 13:01:13.392345  8293 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50758:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:13.398744  8293 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:13.594184  8534 tablet_service.cc:1511] Processing CreateTablet for tablet 0c10e3a2e1f044a0a1a78740e279800c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:13.594880  8533 tablet_service.cc:1511] Processing CreateTablet for tablet 7051c4976daf4ac580117a5b9ecb8de4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:13.596818  8384 tablet_service.cc:1511] Processing CreateTablet for tablet 7051c4976daf4ac580117a5b9ecb8de4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:13.598181  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7051c4976daf4ac580117a5b9ecb8de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.600044  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c10e3a2e1f044a0a1a78740e279800c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.608752  8380 tablet_service.cc:1511] Processing CreateTablet for tablet fdd8533706064dd78b4e61de0beb5255 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:13.610153  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd8533706064dd78b4e61de0beb5255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.610962  8530 tablet_service.cc:1511] Processing CreateTablet for tablet d2321e967e3f4695a2563f5d8dacc658 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:13.612363  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2321e967e3f4695a2563f5d8dacc658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.600390  8385 tablet_service.cc:1511] Processing CreateTablet for tablet 0c10e3a2e1f044a0a1a78740e279800c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:13.601401  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 13811dee93af4290bdcf7d73b527d0f4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:13.615321  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c10e3a2e1f044a0a1a78740e279800c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.615926  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13811dee93af4290bdcf7d73b527d0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.618232  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7051c4976daf4ac580117a5b9ecb8de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.602829  8383 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcd5c10366d45e5ab1c8562d806d037 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:13.623310  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcd5c10366d45e5ab1c8562d806d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.603809  8381 tablet_service.cc:1511] Processing CreateTablet for tablet d2321e967e3f4695a2563f5d8dacc658 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:13.627311  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2321e967e3f4695a2563f5d8dacc658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.604677  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcd5c10366d45e5ab1c8562d806d037 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:13.631866  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcd5c10366d45e5ab1c8562d806d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.633905  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 0c10e3a2e1f044a0a1a78740e279800c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:13.605384  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 13811dee93af4290bdcf7d73b527d0f4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:13.635257  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c10e3a2e1f044a0a1a78740e279800c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.636349  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13811dee93af4290bdcf7d73b527d0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.642356  8529 tablet_service.cc:1511] Processing CreateTablet for tablet fdd8533706064dd78b4e61de0beb5255 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:13.643802  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd8533706064dd78b4e61de0beb5255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.644836  8459 tablet_service.cc:1511] Processing CreateTablet for tablet 7051c4976daf4ac580117a5b9ecb8de4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:13.646186  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7051c4976daf4ac580117a5b9ecb8de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.648795  8528 tablet_service.cc:1511] Processing CreateTablet for tablet c8f3b02e50814949b04f7440340f941f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:13.650363  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f3b02e50814949b04f7440340f941f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.650054  8379 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1ecd689cb746dd9dd2359f106c7bac (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:13.651414  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1ecd689cb746dd9dd2359f106c7bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.651026  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcd5c10366d45e5ab1c8562d806d037 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:13.651268  8453 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1ecd689cb746dd9dd2359f106c7bac (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:13.652464  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcd5c10366d45e5ab1c8562d806d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.657120  8456 tablet_service.cc:1511] Processing CreateTablet for tablet d2321e967e3f4695a2563f5d8dacc658 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:13.659716  8455 tablet_service.cc:1511] Processing CreateTablet for tablet fdd8533706064dd78b4e61de0beb5255 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:13.662173  8454 tablet_service.cc:1511] Processing CreateTablet for tablet c8f3b02e50814949b04f7440340f941f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:13.655341  8457 tablet_service.cc:1511] Processing CreateTablet for tablet 13811dee93af4290bdcf7d73b527d0f4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:13.665089  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2321e967e3f4695a2563f5d8dacc658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.667026  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd8533706064dd78b4e61de0beb5255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.668732  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f3b02e50814949b04f7440340f941f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.670521  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13811dee93af4290bdcf7d73b527d0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.672322  8453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1ecd689cb746dd9dd2359f106c7bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.678750  8527 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1ecd689cb746dd9dd2359f106c7bac (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:13.680095  8527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1ecd689cb746dd9dd2359f106c7bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.684058  8452 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcda97cc34546609f91a249f74d8f85 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:13.685393  8452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcda97cc34546609f91a249f74d8f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.688642  8451 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb4baf572744c749edb167ac631aabe (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:13.691395  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcda97cc34546609f91a249f74d8f85 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:13.692299  8451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb4baf572744c749edb167ac631aabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.692688  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcda97cc34546609f91a249f74d8f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.692255  8526 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcda97cc34546609f91a249f74d8f85 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:13.694721  8526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcda97cc34546609f91a249f74d8f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.700081  8378 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb4baf572744c749edb167ac631aabe (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:13.701565  8378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb4baf572744c749edb167ac631aabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.702694  8525 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb4baf572744c749edb167ac631aabe (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:13.711818  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb4baf572744c749edb167ac631aabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.716012  8377 tablet_service.cc:1511] Processing CreateTablet for tablet 3476b7ee17e048f38396353721fa682f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:13.739028  8377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3476b7ee17e048f38396353721fa682f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.760883  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddb6b18052644bcb64034fd9deee9ea (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:13.762748  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb6b18052644bcb64034fd9deee9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.763047  8530 tablet_service.cc:1511] Processing CreateTablet for tablet 3476b7ee17e048f38396353721fa682f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:13.764282  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3476b7ee17e048f38396353721fa682f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.775219  8455 tablet_service.cc:1511] Processing CreateTablet for tablet 3476b7ee17e048f38396353721fa682f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:13.794201  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3476b7ee17e048f38396353721fa682f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.807271  8380 tablet_service.cc:1511] Processing CreateTablet for tablet ded976982870447482c4b84286e6340b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:13.810801  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded976982870447482c4b84286e6340b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.816383  8532 tablet_service.cc:1511] Processing CreateTablet for tablet f58095c0d8fc462d8edd0f9f658b3eac (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:13.816489  8530 tablet_service.cc:1511] Processing CreateTablet for tablet ef4deccb7c274fec97786db5d6131514 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:13.817936  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58095c0d8fc462d8edd0f9f658b3eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.817675  8384 tablet_service.cc:1511] Processing CreateTablet for tablet c8f3b02e50814949b04f7440340f941f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:13.819010  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f3b02e50814949b04f7440340f941f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.819059  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 412c0e548a4d4e3f90555631b28d234b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:13.820420  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412c0e548a4d4e3f90555631b28d234b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.836683  8584 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:13.837078  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef4deccb7c274fec97786db5d6131514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.842566  8585 tablet_bootstrap.cc:492] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:13.842729  8527 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddb6b18052644bcb64034fd9deee9ea (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:13.845638  8527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb6b18052644bcb64034fd9deee9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.846048  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 1ddb6b18052644bcb64034fd9deee9ea (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:13.847348  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb6b18052644bcb64034fd9deee9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.850001  8526 tablet_service.cc:1511] Processing CreateTablet for tablet ded976982870447482c4b84286e6340b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:13.852746  8531 tablet_service.cc:1511] Processing CreateTablet for tablet e345f8303cfb4ede8a2072d0adb8061a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:13.853642  8526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded976982870447482c4b84286e6340b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.863603  8381 tablet_service.cc:1511] Processing CreateTablet for tablet f58095c0d8fc462d8edd0f9f658b3eac (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:13.866935  8385 tablet_service.cc:1511] Processing CreateTablet for tablet ef4deccb7c274fec97786db5d6131514 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:13.865576  8455 tablet_service.cc:1511] Processing CreateTablet for tablet f58095c0d8fc462d8edd0f9f658b3eac (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:13.868240  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef4deccb7c274fec97786db5d6131514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.869124  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58095c0d8fc462d8edd0f9f658b3eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.870471  8383 tablet_service.cc:1511] Processing CreateTablet for tablet e345f8303cfb4ede8a2072d0adb8061a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:13.874634  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e345f8303cfb4ede8a2072d0adb8061a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.871426  8379 tablet_service.cc:1511] Processing CreateTablet for tablet 412c0e548a4d4e3f90555631b28d234b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:13.868343  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58095c0d8fc462d8edd0f9f658b3eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.870949  8584 tablet_bootstrap.cc:654] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.874801  8534 tablet_service.cc:1511] Processing CreateTablet for tablet 687c062d8bc14ccabafd4083b9bbf0e7 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:13.875620  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e345f8303cfb4ede8a2072d0adb8061a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.880780  8533 tablet_service.cc:1511] Processing CreateTablet for tablet 48eb2b2d1e724640bdcade4f8baa0375 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:13.890441  8586 tablet_bootstrap.cc:492] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:13.889881  8527 tablet_service.cc:1511] Processing CreateTablet for tablet 89b5930e207e40d28682b42cd831b68a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:13.890579  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48eb2b2d1e724640bdcade4f8baa0375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.893961  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687c062d8bc14ccabafd4083b9bbf0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.897022  8586 tablet_bootstrap.cc:654] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.894390  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412c0e548a4d4e3f90555631b28d234b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.902129  8527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b5930e207e40d28682b42cd831b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.907409  8585 tablet_bootstrap.cc:654] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.919466  8380 tablet_service.cc:1511] Processing CreateTablet for tablet 48eb2b2d1e724640bdcade4f8baa0375 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:13.920825  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48eb2b2d1e724640bdcade4f8baa0375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.924655  8378 tablet_service.cc:1511] Processing CreateTablet for tablet 89b5930e207e40d28682b42cd831b68a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:13.926201  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 687c062d8bc14ccabafd4083b9bbf0e7 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:13.928395  8376 tablet_service.cc:1511] Processing CreateTablet for tablet cefa63b714fc469d8c98138fb7dd26f4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:13.930141  8453 tablet_service.cc:1511] Processing CreateTablet for tablet ded976982870447482c4b84286e6340b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:13.931676  8453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded976982870447482c4b84286e6340b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.935969  8532 tablet_service.cc:1511] Processing CreateTablet for tablet cefa63b714fc469d8c98138fb7dd26f4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:13.937294  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefa63b714fc469d8c98138fb7dd26f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.943929  8459 tablet_service.cc:1511] Processing CreateTablet for tablet 412c0e548a4d4e3f90555631b28d234b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:13.945291  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412c0e548a4d4e3f90555631b28d234b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.937240  8451 tablet_service.cc:1511] Processing CreateTablet for tablet ef4deccb7c274fec97786db5d6131514 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:13.946691  8451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef4deccb7c274fec97786db5d6131514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.953425  8454 tablet_service.cc:1511] Processing CreateTablet for tablet e345f8303cfb4ede8a2072d0adb8061a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:13.955013  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e345f8303cfb4ede8a2072d0adb8061a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.967073  8457 tablet_service.cc:1511] Processing CreateTablet for tablet 687c062d8bc14ccabafd4083b9bbf0e7 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:13.968457  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687c062d8bc14ccabafd4083b9bbf0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.968904  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 48eb2b2d1e724640bdcade4f8baa0375 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:13.972997  8526 tablet_service.cc:1511] Processing CreateTablet for tablet e460bf5e53b8462ebab2155c88820c11 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:13.973538  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687c062d8bc14ccabafd4083b9bbf0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.974345  8378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b5930e207e40d28682b42cd831b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.974382  8526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e460bf5e53b8462ebab2155c88820c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.980211  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefa63b714fc469d8c98138fb7dd26f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:13.989122  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 89b5930e207e40d28682b42cd831b68a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 13:01:13.994580  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:14.003157  8381 tablet_service.cc:1511] Processing CreateTablet for tablet e460bf5e53b8462ebab2155c88820c11 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:14.004536  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e460bf5e53b8462ebab2155c88820c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.006546  8584 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:14.007028  8584 ts_tablet_manager.cc:1403] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.010s
I20260709 13:01:14.007473  8585 tablet_bootstrap.cc:492] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:14.009581  8530 tablet_service.cc:1511] Processing CreateTablet for tablet 157886d313c14dff8294260f4377baf4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:14.009740  8379 tablet_service.cc:1511] Processing CreateTablet for tablet 157886d313c14dff8294260f4377baf4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:14.010928  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157886d313c14dff8294260f4377baf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.010607  8584 raft_consensus.cc:359] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.011155  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157886d313c14dff8294260f4377baf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.011344  8584 raft_consensus.cc:385] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.011747  8584 raft_consensus.cc:740] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.011466  8533 tablet_service.cc:1511] Processing CreateTablet for tablet 278b4d554f0647ff885c963daff7931d (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:14.013866  8585 ts_tablet_manager.cc:1403] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.000s
I20260709 13:01:14.012806  8584 consensus_queue.cc:260] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.020310  8455 tablet_service.cc:1511] Processing CreateTablet for tablet 278b4d554f0647ff885c963daff7931d (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:14.021808  8377 tablet_service.cc:1511] Processing CreateTablet for tablet e3d5b84b382e4f0caa0dbe8c50c7cfc7 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:14.024199  8532 tablet_service.cc:1511] Processing CreateTablet for tablet e3d5b84b382e4f0caa0dbe8c50c7cfc7 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:14.029013  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8845af07904ef3b3861c0999f3cd1b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:14.023233  8458 tablet_service.cc:1511] Processing CreateTablet for tablet e460bf5e53b8462ebab2155c88820c11 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:14.037882  8377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d5b84b382e4f0caa0dbe8c50c7cfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.012943  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278b4d554f0647ff885c963daff7931d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.016877  8585 raft_consensus.cc:359] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:14.042152  8585 raft_consensus.cc:385] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.042183  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8845af07904ef3b3861c0999f3cd1b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:14.042619  8585 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.043713  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8845af07904ef3b3861c0999f3cd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.050107  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d5b84b382e4f0caa0dbe8c50c7cfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.030586  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48eb2b2d1e724640bdcade4f8baa0375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.045200  8585 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:14.059150  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8845af07904ef3b3861c0999f3cd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.033227  8452 tablet_service.cc:1511] Processing CreateTablet for tablet cefa63b714fc469d8c98138fb7dd26f4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:14.069703  8384 tablet_service.cc:1511] Processing CreateTablet for tablet 278b4d554f0647ff885c963daff7931d (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:14.071058  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278b4d554f0647ff885c963daff7931d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.074942  8534 tablet_service.cc:1511] Processing CreateTablet for tablet 21a9e66431b042b89cf88391ec860de6 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:14.076344  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a9e66431b042b89cf88391ec860de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.086311  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e460bf5e53b8462ebab2155c88820c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.101222  8452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefa63b714fc469d8c98138fb7dd26f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.108364  8586 tablet_bootstrap.cc:492] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:14.108884  8586 ts_tablet_manager.cc:1403] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.219s	user 0.000s	sys 0.013s
I20260709 13:01:14.109771  8585 ts_tablet_manager.cc:1434] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.011s
I20260709 13:01:14.111766  8569 heartbeater.cc:499] Master 127.7.28.254:35733 was elected leader, sending a full tablet report...
I20260709 13:01:14.113298  8527 tablet_service.cc:1511] Processing CreateTablet for tablet 58f1670d75c14f7588691908d7b2f1cf (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:14.114632  8527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f1670d75c14f7588691908d7b2f1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.115877  8586 raft_consensus.cc:359] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:14.116703  8586 raft_consensus.cc:385] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.117055  8586 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.119494  8529 tablet_service.cc:1511] Processing CreateTablet for tablet a30077f266a34706854bc7e6a95ad805 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:14.122640  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30077f266a34706854bc7e6a95ad805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.122421  8586 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:14.119494  8525 tablet_service.cc:1511] Processing CreateTablet for tablet bb0e47b92cf24b70b2ddbf9bafbadc3b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:14.128386  8420 heartbeater.cc:499] Master 127.7.28.254:35733 was elected leader, sending a full tablet report...
I20260709 13:01:14.129087  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0e47b92cf24b70b2ddbf9bafbadc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.132691  8585 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:14.134935  8530 tablet_service.cc:1511] Processing CreateTablet for tablet 00dd397b27604d3c902569919fcf6a04 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:14.143318  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dd397b27604d3c902569919fcf6a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.147542  8385 tablet_service.cc:1511] Processing CreateTablet for tablet 21a9e66431b042b89cf88391ec860de6 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:14.148965  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a9e66431b042b89cf88391ec860de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.125018  8531 tablet_service.cc:1511] Processing CreateTablet for tablet a8ce611680844f5b9bbe7f4813048f1b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:14.166740  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ce611680844f5b9bbe7f4813048f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.170588  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b5930e207e40d28682b42cd831b68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.174342  8584 ts_tablet_manager.cc:1434] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.167s	user 0.017s	sys 0.021s
I20260709 13:01:14.176615  8451 tablet_service.cc:1511] Processing CreateTablet for tablet 157886d313c14dff8294260f4377baf4 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:14.177704  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278b4d554f0647ff885c963daff7931d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.180583  8451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157886d313c14dff8294260f4377baf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.187176  8534 tablet_service.cc:1511] Processing CreateTablet for tablet 01bec3d6263846f6bc87510cf2213e1e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:14.188742  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bec3d6263846f6bc87510cf2213e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.203037  8453 tablet_service.cc:1511] Processing CreateTablet for tablet e3d5b84b382e4f0caa0dbe8c50c7cfc7 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:14.219516  8453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d5b84b382e4f0caa0dbe8c50c7cfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.215022  8585 tablet_bootstrap.cc:654] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.219691  8533 tablet_service.cc:1511] Processing CreateTablet for tablet 6595c51b9ae043699167a92b109f328e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:14.220124  8451 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8845af07904ef3b3861c0999f3cd1b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:14.228919  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595c51b9ae043699167a92b109f328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.232074  8584 tablet_bootstrap.cc:492] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:14.234273  8451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8845af07904ef3b3861c0999f3cd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.238451  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 58f1670d75c14f7588691908d7b2f1cf (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:14.240784  8382 tablet_service.cc:1511] Processing CreateTablet for tablet bb0e47b92cf24b70b2ddbf9bafbadc3b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:14.241331  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f1670d75c14f7588691908d7b2f1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.243248  8528 tablet_service.cc:1511] Processing CreateTablet for tablet c6de9f8d6e504e40b0a5e555abe5c0c0 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:14.244566  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6de9f8d6e504e40b0a5e555abe5c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.247496  8377 tablet_service.cc:1511] Processing CreateTablet for tablet 01bec3d6263846f6bc87510cf2213e1e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:14.223322  8534 tablet_service.cc:1511] Processing CreateTablet for tablet 448878eafac247d592f6889cb1e26a56 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:14.255314  8591 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.256058  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448878eafac247d592f6889cb1e26a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.255787  8591 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:14.207727  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 55bf07df55b74bb7a74bd894b869faef (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:14.226166  8376 tablet_service.cc:1511] Processing CreateTablet for tablet a8ce611680844f5b9bbe7f4813048f1b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:14.247946  8380 tablet_service.cc:1511] Processing CreateTablet for tablet a30077f266a34706854bc7e6a95ad805 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:14.248950  8529 tablet_service.cc:1511] Processing CreateTablet for tablet f0cfe6c1fd994d86a76a6c9fa9428fd6 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:14.273460  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0cfe6c1fd994d86a76a6c9fa9428fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.249120  8457 tablet_service.cc:1511] Processing CreateTablet for tablet a8ce611680844f5b9bbe7f4813048f1b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:14.274499  8591 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:14.275331  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ce611680844f5b9bbe7f4813048f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.222883  8454 tablet_service.cc:1511] Processing CreateTablet for tablet 21a9e66431b042b89cf88391ec860de6 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:14.260213  8586 ts_tablet_manager.cc:1434] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.151s	user 0.011s	sys 0.000s
I20260709 13:01:14.260571  8584 tablet_bootstrap.cc:654] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.282056  8495 heartbeater.cc:499] Master 127.7.28.254:35733 was elected leader, sending a full tablet report...
I20260709 13:01:14.262916  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 58f1670d75c14f7588691908d7b2f1cf (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:14.270251  8590 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.286269  8590 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.288779  8586 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:14.288897  8590 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:14.275921  8383 tablet_service.cc:1511] Processing CreateTablet for tablet 00dd397b27604d3c902569919fcf6a04 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:14.315864  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f1670d75c14f7588691908d7b2f1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.318018  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bf07df55b74bb7a74bd894b869faef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.325191  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a9e66431b042b89cf88391ec860de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.341866  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0e47b92cf24b70b2ddbf9bafbadc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.314704  8379 tablet_service.cc:1511] Processing CreateTablet for tablet 448878eafac247d592f6889cb1e26a56 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:14.346678  8585 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:14.347311  8585 ts_tablet_manager.cc:1403] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.216s	user 0.014s	sys 0.020s
I20260709 13:01:14.350158  8378 tablet_service.cc:1511] Processing CreateTablet for tablet c6de9f8d6e504e40b0a5e555abe5c0c0 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:14.351567  8377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bec3d6263846f6bc87510cf2213e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.359439  8385 tablet_service.cc:1511] Processing CreateTablet for tablet 55bf07df55b74bb7a74bd894b869faef (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:14.360764  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bf07df55b74bb7a74bd894b869faef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.362300  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dd397b27604d3c902569919fcf6a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.363169  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448878eafac247d592f6889cb1e26a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.363955  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ce611680844f5b9bbe7f4813048f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.366727  8378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6de9f8d6e504e40b0a5e555abe5c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.368939  8586 tablet_bootstrap.cc:654] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.370788  8585 raft_consensus.cc:359] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.392019  8384 tablet_service.cc:1511] Processing CreateTablet for tablet 6595c51b9ae043699167a92b109f328e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:14.395702  8585 raft_consensus.cc:385] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:14.402837  8277 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 51392.2us
I20260709 13:01:14.401605  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30077f266a34706854bc7e6a95ad805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.411289  8452 tablet_service.cc:1511] Processing CreateTablet for tablet bb0e47b92cf24b70b2ddbf9bafbadc3b (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:14.401515  8585 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.418311  8585 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.420435  8585 ts_tablet_manager.cc:1434] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 13:01:14.421403  8585 tablet_bootstrap.cc:492] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:14.426084  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595c51b9ae043699167a92b109f328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.415091  8452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0e47b92cf24b70b2ddbf9bafbadc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.447057  8584 tablet_bootstrap.cc:492] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:14.447669  8584 ts_tablet_manager.cc:1403] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.216s	user 0.021s	sys 0.002s
I20260709 13:01:14.450742  8584 raft_consensus.cc:359] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.453918  8584 raft_consensus.cc:385] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.454743  8584 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.455215  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:14.455060  8529 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2dbc87d7bb4fd1a21aae4da276631c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:14.464435  8451 tablet_service.cc:1511] Processing CreateTablet for tablet 00dd397b27604d3c902569919fcf6a04 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:01:14.462554  8507 leader_election.cc:343] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.456749  8456 tablet_service.cc:1511] Processing CreateTablet for tablet a30077f266a34706854bc7e6a95ad805 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:14.464841  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2dbc87d7bb4fd1a21aae4da276631c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.463977  8585 tablet_bootstrap.cc:654] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.468843  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 01bec3d6263846f6bc87510cf2213e1e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:14.465750  8451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dd397b27604d3c902569919fcf6a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.467273  8377 tablet_service.cc:1511] Processing CreateTablet for tablet f0cfe6c1fd994d86a76a6c9fa9428fd6 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:14.486747  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2dbc87d7bb4fd1a21aae4da276631c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:14.488137  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2dbc87d7bb4fd1a21aae4da276631c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.492633  8455 tablet_service.cc:1511] Processing CreateTablet for tablet 55bf07df55b74bb7a74bd894b869faef (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:14.496222  8379 tablet_service.cc:1511] Processing CreateTablet for tablet e4e26f5f342c48648f0433b885576c00 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:14.503954  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bec3d6263846f6bc87510cf2213e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.510285  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:14.516016  8470 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:14.517305  8377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0cfe6c1fd994d86a76a6c9fa9428fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.517489  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:14.518682  8591 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:14.519063  8591 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.519414  8591 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.527025  8591 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:14.529847  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:14.531257  8507 leader_election.cc:343] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.538902  8533 tablet_service.cc:1511] Processing CreateTablet for tablet e4e26f5f342c48648f0433b885576c00 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:14.540361  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e26f5f342c48648f0433b885576c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.545608  8531 tablet_service.cc:1511] Processing CreateTablet for tablet ac2457ce91f84cd3860bea5672ef0ab8 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:14.546963  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2457ce91f84cd3860bea5672ef0ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.510140  8453 tablet_service.cc:1511] Processing CreateTablet for tablet 6595c51b9ae043699167a92b109f328e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:14.552249  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:14.553917  8359 leader_election.cc:343] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.555784  8454 tablet_service.cc:1511] Processing CreateTablet for tablet 448878eafac247d592f6889cb1e26a56 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:14.558188  8591 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:14.560555  8459 tablet_service.cc:1511] Processing CreateTablet for tablet c6de9f8d6e504e40b0a5e555abe5c0c0 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:14.562014  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:14.562652  8469 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.481060  8584 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.568041  8584 ts_tablet_manager.cc:1434] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.001s
I20260709 13:01:14.573856  8457 tablet_service.cc:1511] Processing CreateTablet for tablet f0cfe6c1fd994d86a76a6c9fa9428fd6 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:14.575785  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2dbc87d7bb4fd1a21aae4da276631c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:14.570919  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30077f266a34706854bc7e6a95ad805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.577109  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2dbc87d7bb4fd1a21aae4da276631c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.577479  8586 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:14.577994  8586 ts_tablet_manager.cc:1403] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.289s	user 0.016s	sys 0.004s
I20260709 13:01:14.579545  8591 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.580399  8453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595c51b9ae043699167a92b109f328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.580138  8591 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.580916  8586 raft_consensus.cc:359] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.581606  8586 raft_consensus.cc:385] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.582026  8586 raft_consensus.cc:740] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.582904  8586 consensus_queue.cc:260] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.583837  8591 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:14.584929  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:14.585194  8586 ts_tablet_manager.cc:1434] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:01:14.586295  8508 leader_election.cc:343] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.586910  8586 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:14.586643  8458 tablet_service.cc:1511] Processing CreateTablet for tablet e4e26f5f342c48648f0433b885576c00 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:14.583668  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bf07df55b74bb7a74bd894b869faef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.588893  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e26f5f342c48648f0433b885576c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.589515  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448878eafac247d592f6889cb1e26a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.594777  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0cfe6c1fd994d86a76a6c9fa9428fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.594463  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd965dafa3a4024b05decfd805a2903 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:14.595369  8383 tablet_service.cc:1511] Processing CreateTablet for tablet ac2457ce91f84cd3860bea5672ef0ab8 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:14.595661  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:14.596709  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2457ce91f84cd3860bea5672ef0ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.595906  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd965dafa3a4024b05decfd805a2903. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:14.598672  8507 leader_election.cc:343] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.599138  8507 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:14.599591  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd965dafa3a4024b05decfd805a2903 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:14.600255  8591 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.599229  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6de9f8d6e504e40b0a5e555abe5c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.606889  8584 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:14.613186  8469 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:14.614312  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:14.614755  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:14.615446  8591 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:14.616642  8358 leader_election.cc:343] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.617110  8358 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:14.618196  8590 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.619446  8585 tablet_bootstrap.cc:492] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:14.619262  8452 tablet_service.cc:1511] Processing CreateTablet for tablet ac2457ce91f84cd3860bea5672ef0ab8 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:14.619947  8585 ts_tablet_manager.cc:1403] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.199s	user 0.037s	sys 0.039s
I20260709 13:01:14.620827  8452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2457ce91f84cd3860bea5672ef0ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.630128  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e26f5f342c48648f0433b885576c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.630752  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 04d76276a90a4f889ff8e98f46e90227 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:14.632001  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d76276a90a4f889ff8e98f46e90227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.634106  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd965dafa3a4024b05decfd805a2903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.641382  8586 tablet_bootstrap.cc:654] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.642936  8451 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd965dafa3a4024b05decfd805a2903 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:14.644500  8451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd965dafa3a4024b05decfd805a2903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.647625  8590 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.648119  8590 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.649101  8529 tablet_service.cc:1511] Processing CreateTablet for tablet 04d76276a90a4f889ff8e98f46e90227 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:14.650130  8590 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:14.650398  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d76276a90a4f889ff8e98f46e90227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.652659  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:14.654213  8358 leader_election.cc:343] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.655145  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:14.656457  8359 leader_election.cc:343] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.656881  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:14.662309  8590 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.643069  8585 raft_consensus.cc:359] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.663383  8585 raft_consensus.cc:385] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.663769  8585 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.666975  8585 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.668507  8584 tablet_bootstrap.cc:654] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.680461  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 668db691226f4f9884a460b2a17f021c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:14.681878  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668db691226f4f9884a460b2a17f021c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.684656  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 04d76276a90a4f889ff8e98f46e90227 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:14.695633  8586 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:14.696292  8586 ts_tablet_manager.cc:1403] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.002s
I20260709 13:01:14.685997  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d76276a90a4f889ff8e98f46e90227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.703222  8585 ts_tablet_manager.cc:1434] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.083s	user 0.012s	sys 0.003s
I20260709 13:01:14.704449  8585 tablet_bootstrap.cc:492] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:14.708606  8459 tablet_service.cc:1511] Processing CreateTablet for tablet 668db691226f4f9884a460b2a17f021c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:14.710642  8584 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:14.711251  8584 ts_tablet_manager.cc:1403] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.010s
I20260709 13:01:14.713040  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 668db691226f4f9884a460b2a17f021c (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:14.714367  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668db691226f4f9884a460b2a17f021c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.718600  8586 raft_consensus.cc:359] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.719374  8586 raft_consensus.cc:385] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.719691  8586 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.720417  8586 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.728816  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668db691226f4f9884a460b2a17f021c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.737212  8585 tablet_bootstrap.cc:654] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.740001  8455 tablet_service.cc:1511] Processing CreateTablet for tablet a9bdd97906c140e29b99343177f05dc2 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:14.740669  8533 tablet_service.cc:1511] Processing CreateTablet for tablet a9bdd97906c140e29b99343177f05dc2 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:14.741317  8591 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:14.741389  8376 tablet_service.cc:1511] Processing CreateTablet for tablet a9bdd97906c140e29b99343177f05dc2 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:14.747723  8586 ts_tablet_manager.cc:1434] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:01:14.750412  8584 raft_consensus.cc:359] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.751329  8377 tablet_service.cc:1511] Processing CreateTablet for tablet dbbf8012591a4011b3ae6451802bb12a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:14.754406  8591 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:14.756458  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bdd97906c140e29b99343177f05dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.762832  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bdd97906c140e29b99343177f05dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.764950  8456 tablet_service.cc:1511] Processing CreateTablet for tablet dbbf8012591a4011b3ae6451802bb12a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:14.766613  8377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbf8012591a4011b3ae6451802bb12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.770900  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 4395bd6ec2454867a133e2c678bcd570 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:14.772104  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bdd97906c140e29b99343177f05dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.771927  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 4395bd6ec2454867a133e2c678bcd570 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:14.773170  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4395bd6ec2454867a133e2c678bcd570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.778744  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 4395bd6ec2454867a133e2c678bcd570 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:14.780907  8586 tablet_bootstrap.cc:492] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:14.781297  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4395bd6ec2454867a133e2c678bcd570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.771144  8584 raft_consensus.cc:385] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.783300  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4395bd6ec2454867a133e2c678bcd570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.783423  8584 raft_consensus.cc:740] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.785158  8584 consensus_queue.cc:260] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.785306  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 36596de3826e4546a5476f7471fdbf37 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:14.786717  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36596de3826e4546a5476f7471fdbf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.788281  8584 ts_tablet_manager.cc:1434] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 13:01:14.789413  8584 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:14.782526  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbf8012591a4011b3ae6451802bb12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.786288  8529 tablet_service.cc:1511] Processing CreateTablet for tablet dbbf8012591a4011b3ae6451802bb12a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:14.812681  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbf8012591a4011b3ae6451802bb12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.813874  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 36596de3826e4546a5476f7471fdbf37 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:14.815274  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36596de3826e4546a5476f7471fdbf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.818302  8586 tablet_bootstrap.cc:654] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.826920  8605 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.831254  8455 tablet_service.cc:1511] Processing CreateTablet for tablet 16a45e4473e5464880e36c3f7edc9b4e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:14.826121  8291 catalog_manager.cc:5697] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.832646  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a45e4473e5464880e36c3f7edc9b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.826787  8459 tablet_service.cc:1511] Processing CreateTablet for tablet 36596de3826e4546a5476f7471fdbf37 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:14.831214  8605 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.834700  8605 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:14.837235  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:14.829134  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 16a45e4473e5464880e36c3f7edc9b4e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:14.838653  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a45e4473e5464880e36c3f7edc9b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.838542  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:14.839861  8584 tablet_bootstrap.cc:654] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:14.840253  8508 leader_election.cc:343] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:14.841508  8507 leader_election.cc:343] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.841992  8507 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:14.843137  8605 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.844986  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36596de3826e4546a5476f7471fdbf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.845176  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 16a45e4473e5464880e36c3f7edc9b4e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:14.847221  8379 tablet_service.cc:1511] Processing CreateTablet for tablet dc7cbb87d4de484e83c3b5c2d4674239 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:14.848090  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a45e4473e5464880e36c3f7edc9b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.848503  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7cbb87d4de484e83c3b5c2d4674239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.862733  8592 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.863384  8585 tablet_bootstrap.cc:492] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:14.863951  8585 ts_tablet_manager.cc:1403] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.030s
I20260709 13:01:14.863284  8592 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.867606  8454 tablet_service.cc:1511] Processing CreateTablet for tablet dc7cbb87d4de484e83c3b5c2d4674239 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:14.869249  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7cbb87d4de484e83c3b5c2d4674239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.871234  8592 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:14.878070  8533 tablet_service.cc:1511] Processing CreateTablet for tablet dc7cbb87d4de484e83c3b5c2d4674239 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:14.879356  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7cbb87d4de484e83c3b5c2d4674239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.896804  8381 tablet_service.cc:1511] Processing CreateTablet for tablet c0c4c676aa374fb6b2efb71a3de7e4bd (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:14.892918  8585 raft_consensus.cc:359] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.898379  8585 raft_consensus.cc:385] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.898768  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c4c676aa374fb6b2efb71a3de7e4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.904465  8586 tablet_bootstrap.cc:492] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:14.905086  8586 ts_tablet_manager.cc:1403] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.017s
I20260709 13:01:14.908210  8586 raft_consensus.cc:359] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.909040  8586 raft_consensus.cc:385] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.909392  8586 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.910175  8586 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.912621  8584 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:14.913144  8584 ts_tablet_manager.cc:1403] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.007s
I20260709 13:01:14.913183  8586 ts_tablet_manager.cc:1434] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:01:14.914497  8590 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.914973  8590 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.915262  8458 tablet_service.cc:1511] Processing CreateTablet for tablet c0c4c676aa374fb6b2efb71a3de7e4bd (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:14.898813  8585 raft_consensus.cc:740] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.917075  8590 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:14.918735  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:14.919819  8585 consensus_queue.cc:260] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:14.920871  8358 leader_election.cc:343] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.922367  8585 ts_tablet_manager.cc:1434] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:01:14.923360  8585 tablet_bootstrap.cc:492] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:14.923372  8584 raft_consensus.cc:359] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.924410  8584 raft_consensus.cc:385] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.924703  8584 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.925560  8584 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.932502  8531 tablet_service.cc:1511] Processing CreateTablet for tablet c0c4c676aa374fb6b2efb71a3de7e4bd (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:14.933831  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c4c676aa374fb6b2efb71a3de7e4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.934684  8584 ts_tablet_manager.cc:1434] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.007s
I20260709 13:01:14.935529  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:14.936875  8359 leader_election.cc:343] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.937340  8359 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:14.938519  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c4c676aa374fb6b2efb71a3de7e4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.938619  8590 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.943822  8584 tablet_bootstrap.cc:492] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:14.944945  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:14.945617  8395 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:14.947218  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:14.948470  8586 tablet_bootstrap.cc:492] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:14.948124  8381 tablet_service.cc:1511] Processing CreateTablet for tablet ad98149b9fc3438b96dcbd03688e8bb1 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:14.949393  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad98149b9fc3438b96dcbd03688e8bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.950537  8592 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:14.950914  8592 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.951249  8592 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.954936  8584 tablet_bootstrap.cc:654] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.954998  8586 tablet_bootstrap.cc:654] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.965622  8586 tablet_bootstrap.cc:492] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:14.966341  8586 ts_tablet_manager.cc:1403] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:01:14.966174  8532 tablet_service.cc:1511] Processing CreateTablet for tablet ad98149b9fc3438b96dcbd03688e8bb1 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:14.972612  8585 tablet_bootstrap.cc:654] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.984534  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad98149b9fc3438b96dcbd03688e8bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.976392  8584 tablet_bootstrap.cc:492] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:14.986312  8584 ts_tablet_manager.cc:1403] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.004s
I20260709 13:01:14.977399  8586 raft_consensus.cc:359] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.978714  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:14.987546  8586 raft_consensus.cc:385] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.987917  8586 raft_consensus.cc:740] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
W20260709 13:01:14.988588  8433 leader_election.cc:343] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.988668  8586 consensus_queue.cc:260] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.989598  8585 tablet_bootstrap.cc:492] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:14.990167  8585 ts_tablet_manager.cc:1403] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.006s
I20260709 13:01:14.978820  8458 tablet_service.cc:1511] Processing CreateTablet for tablet ad98149b9fc3438b96dcbd03688e8bb1 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:14.990551  8584 raft_consensus.cc:359] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.994169  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad98149b9fc3438b96dcbd03688e8bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:14.993230  8585 raft_consensus.cc:359] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.982959  8592 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:14.994053  8584 raft_consensus.cc:385] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:14.998554  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:14.999706  8592 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.001224  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.001902  8395 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.004544  8584 raft_consensus.cc:740] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.997574  8585 raft_consensus.cc:385] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.005895  8585 raft_consensus.cc:740] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.006196  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:15.008647  8585 consensus_queue.cc:260] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:15.012413  8433 leader_election.cc:343] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.015563  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 936de44ff6404ac7b9d585ab45c933f9 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:15.016775  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936de44ff6404ac7b9d585ab45c933f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.016844  8395 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:15.018087  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:15.019179  8592 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.019636  8592 raft_consensus.cc:697] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:15.020426  8592 consensus_queue.cc:237] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.016006  8585 ts_tablet_manager.cc:1434] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:01:15.006739  8584 consensus_queue.cc:260] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.036823  8585 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.038229  8454 tablet_service.cc:1511] Processing CreateTablet for tablet 936de44ff6404ac7b9d585ab45c933f9 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:15.042842  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936de44ff6404ac7b9d585ab45c933f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.043704  8291 catalog_manager.cc:5697] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.046569  8585 tablet_bootstrap.cc:654] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.051438  8590 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.051935  8590 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.054433  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 936de44ff6404ac7b9d585ab45c933f9 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:15.056224  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936de44ff6404ac7b9d585ab45c933f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.058646  8590 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.060499  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.061473  8544 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:15.062851  8358 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:15.063836  8590 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.064234  8590 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.066841  8590 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.100324  8592 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.101087  8592 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.103897  8592 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.106092  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.107203  8455 tablet_service.cc:1511] Processing CreateTablet for tablet 7219cc411cf6498f8f250f689007874f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:15.109018  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7219cc411cf6498f8f250f689007874f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.068112  8584 ts_tablet_manager.cc:1434] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 13:01:15.110764  8584 tablet_bootstrap.cc:492] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.112365  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.113034  8544 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:15.114511  8592 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.118850  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.125584  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 7219cc411cf6498f8f250f689007874f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:15.125993  8622 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.126446  8622 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.126804  8622 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.127008  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7219cc411cf6498f8f250f689007874f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.126832  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 6becd976429a45a3874a10895b19b63e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:15.127451  8584 tablet_bootstrap.cc:654] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.128245  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6becd976429a45a3874a10895b19b63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.130702  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 7219cc411cf6498f8f250f689007874f (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:15.131798  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7219cc411cf6498f8f250f689007874f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.134824  8586 ts_tablet_manager.cc:1434] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.168s	user 0.042s	sys 0.063s
I20260709 13:01:15.134627  8622 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.135885  8586 tablet_bootstrap.cc:492] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.120793  8592 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.152761  8592 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.153599  8622 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.154717  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 6becd976429a45a3874a10895b19b63e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:15.156064  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6becd976429a45a3874a10895b19b63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.156363  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.157739  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:15.158389  8543 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:15.159659  8433 leader_election.cc:343] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.160997  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 6becd976429a45a3874a10895b19b63e (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:15.162166  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6becd976429a45a3874a10895b19b63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.162267  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.163615  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.164228  8393 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:15.156368  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.170126  8584 tablet_bootstrap.cc:492] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.158797  8454 tablet_service.cc:1511] Processing CreateTablet for tablet b79a5acddc004781bbeac307ae4e58d1 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:15.171010  8584 ts_tablet_manager.cc:1403] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.007s
I20260709 13:01:15.171427  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79a5acddc004781bbeac307ae4e58d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.166793  8469 raft_consensus.cc:2393] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:15.175026  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:15.175843  8622 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.173962  8584 raft_consensus.cc:359] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:15.176265  8622 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.176473  8584 raft_consensus.cc:385] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.176688  8622 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.175761  8528 tablet_service.cc:1511] Processing CreateTablet for tablet b79a5acddc004781bbeac307ae4e58d1 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:15.178015  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79a5acddc004781bbeac307ae4e58d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.176834  8584 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.178889  8584 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:15.181391  8584 ts_tablet_manager.cc:1434] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:15.182411  8584 tablet_bootstrap.cc:492] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.183753  8586 tablet_bootstrap.cc:654] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.183725  8622 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.188380  8592 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.188726  8584 tablet_bootstrap.cc:654] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.188884  8592 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.189262  8622 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.191072  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.192319  8393 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.193262  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:15.195622  8433 leader_election.cc:343] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.197671  8381 tablet_service.cc:1511] Processing CreateTablet for tablet b79a5acddc004781bbeac307ae4e58d1 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:15.198824  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79a5acddc004781bbeac307ae4e58d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.200183  8590 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.200644  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.206434  8395 raft_consensus.cc:2393] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 1: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:15.208401  8605 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.213961  8379 tablet_service.cc:1511] Processing CreateTablet for tablet c257a516245f4698b8937b228b23d23a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:15.215281  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c257a516245f4698b8937b228b23d23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.216018  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:15.218627  8433 leader_election.cc:343] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.221019  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.201570  8592 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:15.223321  8433 leader_election.cc:343] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.224009  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:15.225499  8592 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.225903  8590 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.228768  8543 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:15.239359  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:15.239800  8585 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.240506  8586 tablet_bootstrap.cc:492] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.240372  8592 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.241004  8586 ts_tablet_manager.cc:1403] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.023s
I20260709 13:01:15.241302  8592 raft_consensus.cc:697] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:15.241451  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:15.217461  8393 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:15.246220  8585 ts_tablet_manager.cc:1403] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.210s	user 0.017s	sys 0.013s
I20260709 13:01:15.247938  8586 raft_consensus.cc:359] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.248695  8586 raft_consensus.cc:385] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.248981  8586 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.245966  8592 consensus_queue.cc:237] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.250964  8586 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.252678  8585 raft_consensus.cc:359] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.253763  8586 ts_tablet_manager.cc:1434] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:01:15.254541  8531 tablet_service.cc:1511] Processing CreateTablet for tablet c257a516245f4698b8937b228b23d23a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:15.258145  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c257a516245f4698b8937b228b23d23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.256433  8585 raft_consensus.cc:385] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.259268  8585 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.259506  8586 tablet_bootstrap.cc:492] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.260037  8585 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.262550  8585 ts_tablet_manager.cc:1434] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:01:15.262874  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.263505  8585 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.263622  8590 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.269999  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:15.270999  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6226d3e14545daa1ff24f4a0384182 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:15.271778  8622 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.272154  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6226d3e14545daa1ff24f4a0384182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.273059  8458 tablet_service.cc:1511] Processing CreateTablet for tablet c257a516245f4698b8937b228b23d23a (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:15.274221  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c257a516245f4698b8937b228b23d23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.273362  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 2e60e73cf17e48a2998c2d82eafcb1e3 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:15.275740  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e60e73cf17e48a2998c2d82eafcb1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.278869  8459 tablet_service.cc:1511] Processing CreateTablet for tablet 2e60e73cf17e48a2998c2d82eafcb1e3 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:15.278776  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6226d3e14545daa1ff24f4a0384182 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:15.280920  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e60e73cf17e48a2998c2d82eafcb1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.270190  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 2e60e73cf17e48a2998c2d82eafcb1e3 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:15.284997  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e60e73cf17e48a2998c2d82eafcb1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.287078  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6226d3e14545daa1ff24f4a0384182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.293963  8584 tablet_bootstrap.cc:492] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.305075  8622 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:15.308398  8586 tablet_bootstrap.cc:654] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.310678  8622 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.311869  8590 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.317000  8590 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.319123  8590 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.311407  8584 ts_tablet_manager.cc:1403] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.016s
I20260709 13:01:15.325086  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.326076  8543 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:15.326467  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.325146  8393 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:15.329106  8359 leader_election.cc:343] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.330770  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6226d3e14545daa1ff24f4a0384182 (DEFAULT_TABLE table=test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:15.331741  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6226d3e14545daa1ff24f4a0384182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:15.334430  8584 raft_consensus.cc:359] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.336722  8358 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.337977  8590 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.338353  8590 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.338665  8590 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.335453  8585 tablet_bootstrap.cc:654] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.336311  8584 raft_consensus.cc:385] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.351967  8584 raft_consensus.cc:740] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.353384  8584 consensus_queue.cc:260] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.355960  8584 ts_tablet_manager.cc:1434] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:01:15.358610  8584 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.360628  8586 tablet_bootstrap.cc:492] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.361819  8591 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.365404  8590 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.367764  8590 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.368260  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:15.369292  8359 leader_election.cc:343] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.371182  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:15.371938  8543 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.361464  8586 ts_tablet_manager.cc:1403] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.006s
I20260709 13:01:15.374432  8585 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.374905  8585 ts_tablet_manager.cc:1403] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.001s
I20260709 13:01:15.375135  8584 tablet_bootstrap.cc:654] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.378252  8586 raft_consensus.cc:359] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.378983  8586 raft_consensus.cc:385] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.379256  8586 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.380137  8586 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.382522  8586 ts_tablet_manager.cc:1434] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:01:15.382332  8543 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:15.383589  8586 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.383906  8358 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.385090  8590 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.385576  8590 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:15.386528  8590 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.383021  8585 raft_consensus.cc:359] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.390841  8585 raft_consensus.cc:385] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.392362  8584 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.392803  8584 ts_tablet_manager.cc:1403] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.002s
I20260709 13:01:15.394073  8585 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.395650  8584 raft_consensus.cc:359] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.396332  8584 raft_consensus.cc:385] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.396596  8584 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.398751  8586 tablet_bootstrap.cc:654] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.401612  8584 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.403716  8584 ts_tablet_manager.cc:1434] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:01:15.404608  8584 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.404630  8586 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.405228  8586 ts_tablet_manager.cc:1403] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.022s	user 0.002s	sys 0.011s
I20260709 13:01:15.406991  8585 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.407207  8291 catalog_manager.cc:5697] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.409499  8291 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.410847  8584 tablet_bootstrap.cc:654] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.407817  8586 raft_consensus.cc:359] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.412377  8586 raft_consensus.cc:385] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.412696  8586 raft_consensus.cc:740] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.415668  8585 ts_tablet_manager.cc:1434] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:01:15.415544  8586 consensus_queue.cc:260] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.416792  8585 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.418005  8586 ts_tablet_manager.cc:1434] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:01:15.421419  8586 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.421846  8584 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.422303  8584 ts_tablet_manager.cc:1403] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:01:15.424957  8584 raft_consensus.cc:359] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.425632  8584 raft_consensus.cc:385] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.426025  8584 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.417157  8293 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.426991  8584 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.427412  8585 tablet_bootstrap.cc:654] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.427412  8586 tablet_bootstrap.cc:654] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.429301  8584 ts_tablet_manager.cc:1434] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:15.430254  8584 tablet_bootstrap.cc:492] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.432708  8585 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.433198  8585 ts_tablet_manager.cc:1403] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:01:15.435691  8584 tablet_bootstrap.cc:654] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.438628  8622 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.438796  8585 raft_consensus.cc:359] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.439800  8585 raft_consensus.cc:385] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.439381  8622 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.440169  8585 raft_consensus.cc:740] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.443599  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.444492  8393 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:15.448153  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.450170  8585 consensus_queue.cc:260] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.463450  8585 ts_tablet_manager.cc:1434] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.006s
I20260709 13:01:15.464726  8585 tablet_bootstrap.cc:492] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.454635  8605 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.466349  8605 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.469241  8631 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.451789  8592 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.472652  8592 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.475796  8592 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.469744  8631 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.477470  8585 tablet_bootstrap.cc:654] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.474771  8622 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.481995  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.481943  8622 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.482409  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.482882  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.483018  8543 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:15.483520  8393 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
W20260709 13:01:15.483568  8508 leader_election.cc:343] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.484810  8507 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.485670  8591 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.486056  8591 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.486485  8591 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.487094  8631 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.488732  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.488977  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.491070  8605 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:15.491923  8586 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.492550  8586 ts_tablet_manager.cc:1403] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.018s
I20260709 13:01:15.496065  8586 raft_consensus.cc:359] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.496984  8586 raft_consensus.cc:385] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.497323  8586 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
W20260709 13:01:15.497967  8433 leader_election.cc:343] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:15.498672  8433 leader_election.cc:343] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.498574  8586 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.499222  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:15.501374  8586 ts_tablet_manager.cc:1434] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:01:15.501914  8631 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.501391  8592 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.503752  8584 tablet_bootstrap.cc:492] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.504307  8584 ts_tablet_manager.cc:1403] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.006s
I20260709 13:01:15.507074  8631 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.507587  8631 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.509586  8631 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.511066  8586 tablet_bootstrap.cc:492] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.510377  8584 raft_consensus.cc:359] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.512311  8584 raft_consensus.cc:385] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.512512  8584 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.512970  8584 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.510761  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.511976  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.514537  8543 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
W20260709 13:01:15.514988  8433 leader_election.cc:343] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.515642  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:15.516238  8631 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.516566  8631 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.516770  8631 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.519239  8592 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.521250  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.521631  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:15.521908  8393 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.522234  8543 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.523414  8584 ts_tablet_manager.cc:1434] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:01:15.524730  8584 tablet_bootstrap.cc:492] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.528980  8393 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:15.529155  8543 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:15.530489  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.531404  8592 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.532104  8592 raft_consensus.cc:697] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:15.497364  8591 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.535487  8584 tablet_bootstrap.cc:654] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.537081  8592 consensus_queue.cc:237] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.539849  8586 tablet_bootstrap.cc:654] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.541281  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.541989  8395 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.548671  8631 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.552842  8585 tablet_bootstrap.cc:492] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.553027  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:15.559916  8585 ts_tablet_manager.cc:1403] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.006s
W20260709 13:01:15.560730  8508 leader_election.cc:343] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.553256  8395 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:15.561614  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.562284  8507 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.562618  8585 raft_consensus.cc:359] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.555517  8591 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:15.562973  8631 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.563282  8585 raft_consensus.cc:385] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.563292  8605 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.559401  8584 tablet_bootstrap.cc:492] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.564149  8605 raft_consensus.cc:697] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:15.564263  8584 ts_tablet_manager.cc:1403] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 13:01:15.560590  8291 catalog_manager.cc:5697] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.565052  8605 consensus_queue.cc:237] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.567189  8584 raft_consensus.cc:359] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.567775  8584 raft_consensus.cc:385] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.568187  8584 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.568377  8585 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.568977  8584 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.569227  8585 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.571475  8585 ts_tablet_manager.cc:1434] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
W20260709 13:01:15.567209  8433 consensus_peers.cc:597] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.572379  8585 tablet_bootstrap.cc:492] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.567533  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:15.572969  8543 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.580267  8586 tablet_bootstrap.cc:492] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
W20260709 13:01:15.572407  8433 leader_election.cc:343] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.580732  8586 ts_tablet_manager.cc:1403] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.010s
I20260709 13:01:15.584254  8585 tablet_bootstrap.cc:654] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.583272  8586 raft_consensus.cc:359] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.587751  8586 raft_consensus.cc:385] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.588016  8584 ts_tablet_manager.cc:1434] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 13:01:15.588043  8586 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.589069  8584 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.589241  8586 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.591558  8586 ts_tablet_manager.cc:1434] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:01:15.592432  8586 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.595314  8584 tablet_bootstrap.cc:654] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.596349  8543 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:15.597759  8586 tablet_bootstrap.cc:654] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.597555  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:15.598532  8649 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.598997  8649 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:15.599802  8649 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.604717  8585 tablet_bootstrap.cc:492] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.605206  8585 ts_tablet_manager.cc:1403] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 13:01:15.607905  8585 raft_consensus.cc:359] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.608628  8585 raft_consensus.cc:385] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.607632  8291 catalog_manager.cc:5697] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:15.608924  8585 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.610517  8585 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.613025  8585 ts_tablet_manager.cc:1434] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:01:15.615217  8585 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.615815  8584 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.616252  8584 ts_tablet_manager.cc:1403] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 13:01:15.618808  8584 raft_consensus.cc:359] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.619450  8584 raft_consensus.cc:385] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.619717  8584 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.620347  8584 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.622340  8584 ts_tablet_manager.cc:1434] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:15.623173  8584 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.624773  8586 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.625684  8586 ts_tablet_manager.cc:1403] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.005s
I20260709 13:01:15.628257  8586 raft_consensus.cc:359] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.627571  8293 catalog_manager.cc:5697] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.625236  8585 tablet_bootstrap.cc:654] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.631708  8586 raft_consensus.cc:385] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.632081  8586 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.632803  8586 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.635069  8586 ts_tablet_manager.cc:1434] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:01:15.635848  8585 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.636009  8586 tablet_bootstrap.cc:492] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.636294  8585 ts_tablet_manager.cc:1403] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:01:15.638656  8584 tablet_bootstrap.cc:654] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.638855  8585 raft_consensus.cc:359] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.639614  8585 raft_consensus.cc:385] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.639925  8585 raft_consensus.cc:740] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.640771  8585 consensus_queue.cc:260] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.642560  8586 tablet_bootstrap.cc:654] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.642760  8585 ts_tablet_manager.cc:1434] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:15.643702  8585 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.650436  8585 tablet_bootstrap.cc:654] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.651846  8584 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.652305  8584 ts_tablet_manager.cc:1403] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:01:15.652742  8586 tablet_bootstrap.cc:492] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.653318  8586 ts_tablet_manager.cc:1403] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:01:15.654906  8584 raft_consensus.cc:359] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.655617  8584 raft_consensus.cc:385] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.655887  8584 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.656565  8584 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.657413  8586 raft_consensus.cc:359] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.658401  8586 raft_consensus.cc:385] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.658819  8586 raft_consensus.cc:740] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.659643  8586 consensus_queue.cc:260] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.662472  8649 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.664835  8586 ts_tablet_manager.cc:1434] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:15.664683  8590 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.665979  8586 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.666076  8590 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.668473  8590 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.669232  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.670989  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:15.672093  8359 leader_election.cc:343] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:15.673117  8358 leader_election.cc:343] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.673571  8358 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.658557  8584 ts_tablet_manager.cc:1434] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:15.677624  8584 tablet_bootstrap.cc:492] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.679785  8586 tablet_bootstrap.cc:654] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.681818  8649 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.684722  8590 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.685745  8622 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.690659  8649 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.691255  8590 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.691717  8590 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.693149  8649 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.695020  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:15.696290  8358 leader_election.cc:343] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.696770  8590 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.699373  8605 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.699833  8605 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.701933  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.702704  8393 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 1: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:15.703415  8584 tablet_bootstrap.cc:654] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.703756  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.704473  8394 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:15.705197  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.706468  8507 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:15.707432  8591 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.707777  8591 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.708230  8591 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.708843  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.711288  8584 tablet_bootstrap.cc:492] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.711781  8584 ts_tablet_manager.cc:1403] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.004s
I20260709 13:01:15.705516  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.714270  8469 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:15.714365  8584 raft_consensus.cc:359] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.715010  8584 raft_consensus.cc:385] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.715296  8584 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.701776  8605 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:15.715945  8584 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:15.716745  8359 leader_election.cc:343] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.717187  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.717516  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:15.718045  8584 ts_tablet_manager.cc:1434] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:15.718369  8625 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.718631  8631 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.718997  8584 tablet_bootstrap.cc:492] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.720695  8591 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.689079  8585 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.727655  8585 ts_tablet_manager.cc:1403] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.012s
I20260709 13:01:15.729707  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.730479  8395 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.730665  8585 raft_consensus.cc:359] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.731545  8585 raft_consensus.cc:385] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.731889  8585 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.739619  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:15.740270  8469 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.740293  8631 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.741369  8585 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.746109  8590 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.748167  8585 ts_tablet_manager.cc:1434] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:01:15.748085  8469 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:15.746665  8590 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.749253  8585 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.749498  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.750465  8605 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.751286  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.751911  8470 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:15.753489  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.754428  8625 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.754761  8625 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.755059  8625 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.755484  8585 tablet_bootstrap.cc:654] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.760900  8584 tablet_bootstrap.cc:654] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.762226  8590 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.762419  8591 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:15.763010  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.763680  8543 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:15.765407  8395 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:15.765636  8625 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.767840  8585 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.768311  8585 ts_tablet_manager.cc:1403] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:01:15.768756  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:15.774121  8469 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.777529  8585 raft_consensus.cc:359] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.778410  8585 raft_consensus.cc:385] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.778717  8585 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.779974  8625 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.780488  8585 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.782281  8586 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.782153  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:15.782409  8585 ts_tablet_manager.cc:1434] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:01:15.782732  8586 ts_tablet_manager.cc:1403] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.028s
I20260709 13:01:15.782766  8543 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.783317  8585 tablet_bootstrap.cc:492] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.786046  8586 raft_consensus.cc:359] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.786698  8586 raft_consensus.cc:385] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.786966  8586 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.788046  8605 raft_consensus.cc:697] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:15.788539  8631 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.789000  8631 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.789191  8605 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.791218  8631 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.791770  8586 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.787609  8469 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:15.793463  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.794095  8544 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:15.795061  8585 tablet_bootstrap.cc:654] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.795701  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.796747  8631 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.797210  8631 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.797631  8631 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.798187  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.799206  8625 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.799679  8625 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:15.800499  8625 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.808779  8586 ts_tablet_manager.cc:1434] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:01:15.810122  8586 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.810416  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.811093  8395 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:15.813206  8585 tablet_bootstrap.cc:492] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.813649  8585 ts_tablet_manager.cc:1403] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:01:15.814694  8292 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:15.816346  8585 raft_consensus.cc:359] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.819813  8543 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:15.820698  8584 tablet_bootstrap.cc:492] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.810834  8631 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.821201  8584 ts_tablet_manager.cc:1403] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.012s
I20260709 13:01:15.822738  8631 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.824005  8584 raft_consensus.cc:359] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.824772  8584 raft_consensus.cc:385] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.825059  8584 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.825723  8584 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.827354  8584 ts_tablet_manager.cc:1434] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:15.828225  8584 tablet_bootstrap.cc:492] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.820091  8586 tablet_bootstrap.cc:654] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.829898  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.830492  8395 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.831619  8293 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.833053  8585 raft_consensus.cc:385] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.833400  8585 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.834322  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:15.834477  8605 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.834887  8543 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.834965  8605 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.837181  8605 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:15.838965  8584 tablet_bootstrap.cc:654] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.840337  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.840975  8394 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:15.838742  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:15.843693  8508 leader_election.cc:343] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.844790  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.845993  8605 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.834118  8585 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.846396  8605 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.846822  8605 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.847643  8586 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.848126  8586 ts_tablet_manager.cc:1403] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.002s
I20260709 13:01:15.849238  8585 ts_tablet_manager.cc:1434] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:01:15.853134  8585 tablet_bootstrap.cc:492] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:15.850703  8586 raft_consensus.cc:359] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.853703  8586 raft_consensus.cc:385] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.851634  8543 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:15.854023  8586 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.850891  8395 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:15.854720  8586 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.855767  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.857728  8543 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.859670  8649 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.860194  8649 raft_consensus.cc:697] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:15.861052  8649 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.861722  8605 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.863842  8605 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:15.865896  8586 ts_tablet_manager.cc:1434] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:01:15.866494  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:15.866858  8586 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.866932  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:15.867242  8395 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.867584  8469 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.876164  8469 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:15.877434  8508 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.878235  8586 tablet_bootstrap.cc:654] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.878527  8605 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.879788  8605 raft_consensus.cc:697] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:15.881668  8591 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.882424  8591 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.885937  8585 tablet_bootstrap.cc:654] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.887014  8395 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:15.887631  8649 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.889441  8591 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:15.893203  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.880686  8605 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.896255  8291 catalog_manager.cc:5697] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.900589  8649 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:15.905280  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.908885  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:15.911717  8591 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.916833  8584 tablet_bootstrap.cc:492] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:15.917390  8584 ts_tablet_manager.cc:1403] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.018s
I20260709 13:01:15.920821  8584 raft_consensus.cc:359] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.921890  8584 raft_consensus.cc:385] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.922277  8584 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.924177  8584 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.928893  8584 ts_tablet_manager.cc:1434] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:01:15.930344  8584 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:15.940214  8584 tablet_bootstrap.cc:654] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.941179  8586 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:15.941735  8586 ts_tablet_manager.cc:1403] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.003s
I20260709 13:01:15.944577  8586 raft_consensus.cc:359] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.945261  8586 raft_consensus.cc:385] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.945539  8586 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.946316  8586 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.949640  8586 ts_tablet_manager.cc:1434] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:15.950564  8586 tablet_bootstrap.cc:492] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:15.954640  8622 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.955318  8622 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.956394  8586 tablet_bootstrap.cc:654] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.957983  8469 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.959290  8591 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.959646  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.959760  8591 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.959977  8622 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:15.960892  8622 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:15.963032  8591 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:15.963228  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:15.963831  8470 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:15.964783  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:15.965518  8544 raft_consensus.cc:2393] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 1: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:15.968940  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:15.970157  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:15.970943  8394 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:15.972597  8591 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.972987  8591 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.973328  8591 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.976294  8585 tablet_bootstrap.cc:492] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:15.976780  8585 ts_tablet_manager.cc:1403] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.000s
I20260709 13:01:15.980093  8585 raft_consensus.cc:359] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.980782  8585 raft_consensus.cc:385] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.984154  8585 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.985692  8625 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.972272  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:15.987459  8592 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.990082  8625 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.996816  8585 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.997511  8293 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:15.999503  8585 ts_tablet_manager.cc:1434] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:01:16.018247  8666 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.019238  8585 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:16.018989  8666 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.999605  8591 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:15.999894  8592 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.029634  8591 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:16.031781  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:16.038367  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:16.032465  8395 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.041754  8666 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:16.053138  8605 consensus_queue.cc:1048] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.054164  8592 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.054713  8592 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.062369  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:16.062458  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:16.095530  8584 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:16.098228  8584 ts_tablet_manager.cc:1403] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.168s	user 0.064s	sys 0.067s
I20260709 13:01:16.061848  8592 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.098726  8469 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.061838  8395 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:16.090238  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:16.090647  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:16.102339  8590 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.105366  8470 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:16.105505  8590 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.068151  8666 consensus_queue.cc:1048] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:01:16.106731  8508 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:16.107671  8590 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.110845  8685 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.111307  8685 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.111698  8685 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.112604  8469 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:16.113909  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:16.103649  8586 tablet_bootstrap.cc:492] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:16.104656  8585 tablet_bootstrap.cc:654] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.118343  8586 ts_tablet_manager.cc:1403] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.168s	user 0.005s	sys 0.034s
W20260709 13:01:16.102336  8433 leader_election.cc:343] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.121877  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:16.119112  8394 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:16.123663  8584 raft_consensus.cc:359] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.124323  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:16.124747  8584 raft_consensus.cc:385] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.125056  8543 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:16.125281  8584 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.126520  8584 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.129323  8584 ts_tablet_manager.cc:1434] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:01:16.130183  8631 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.130714  8584 tablet_bootstrap.cc:492] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:16.119740  8605 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:16.132046  8433 leader_election.cc:343] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.132149  8605 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:16.133134  8605 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.143167  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:16.144568  8590 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.145117  8590 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.145649  8590 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.141114  8433 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:16.137698  8393 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.151055  8592 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.179383  8590 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.193717  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:16.204134  8585 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:16.204069  8590 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.204691  8585 ts_tablet_manager.cc:1403] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.186s	user 0.013s	sys 0.006s
I20260709 13:01:16.208918  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:16.209084  8586 raft_consensus.cc:359] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.209539  8540 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.209712  8586 raft_consensus.cc:385] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.210649  8586 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.211279  8586 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.208247  8542 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.200321  8685 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:16.212772  8359 leader_election.cc:343] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.214478  8586 ts_tablet_manager.cc:1434] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.095s	user 0.002s	sys 0.008s
I20260709 13:01:16.215643  8586 tablet_bootstrap.cc:492] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:16.224704  8585 raft_consensus.cc:359] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.226048  8585 raft_consensus.cc:385] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.211872  8631 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:01:16.226899  8585 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.228093  8585 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.233305  8585 ts_tablet_manager.cc:1434] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:01:16.234519  8585 tablet_bootstrap.cc:492] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:16.226439  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:16.242282  8359 leader_election.cc:343] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.242903  8291 catalog_manager.cc:5697] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.247189  8584 tablet_bootstrap.cc:654] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.253211  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:16.253872  8393 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.255759  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:16.256518  8469 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.270279  8393 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:16.270699  8666 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.272082  8507 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:16.273268  8591 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.296463  8585 tablet_bootstrap.cc:654] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.263351  8685 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:16.345327  8649 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.345896  8590 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.346100  8649 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.346452  8590 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.348802  8649 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.384712  8625 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.385282  8625 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.390760  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:16.391633  8468 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:16.395064  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:16.387498  8625 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.389879  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:16.397226  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:16.399246  8591 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:16.412994  8359 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:16.445686  8433 leader_election.cc:343] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.445397  8591 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.419499  8543 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
W20260709 13:01:16.472782  8433 leader_election.cc:343] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.432826  8625 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.471976  8592 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:16.478319  8625 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.462891  8469 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:16.482577  8625 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.483985  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:16.493352  8590 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.493904  8540 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
W20260709 13:01:16.496604  8676 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.197s	user 0.019s	sys 0.004s
I20260709 13:01:16.476382  8586 tablet_bootstrap.cc:654] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:16.509516  8690 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.254s	user 0.027s	sys 0.014s
I20260709 13:01:16.499560  8631 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.512547  8585 tablet_bootstrap.cc:492] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:16.512957  8585 ts_tablet_manager.cc:1403] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.279s	user 0.014s	sys 0.000s
I20260709 13:01:16.517995  8585 raft_consensus.cc:359] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.518849  8585 raft_consensus.cc:385] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.519157  8585 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.520823  8585 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.519601  8696 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:01:16.524586  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:16.525588  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:16.527729  8590 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.529942  8585 ts_tablet_manager.cc:1434] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:01:16.530983  8585 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:16.533107  8584 tablet_bootstrap.cc:492] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:16.537860  8584 ts_tablet_manager.cc:1403] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.407s	user 0.024s	sys 0.014s
W20260709 13:01:16.529273  8358 leader_election.cc:343] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.546751  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:16.547722  8584 raft_consensus.cc:359] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.554203  8584 raft_consensus.cc:385] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.554596  8584 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.556538  8586 tablet_bootstrap.cc:492] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:16.556951  8586 ts_tablet_manager.cc:1403] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.341s	user 0.014s	sys 0.016s
I20260709 13:01:16.556780  8584 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.560225  8590 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:16.558135  8697 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:01:16.566684  8666 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:16.573269  8590 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.568333  8698 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:01:16.579283  8649 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:16.588981  8625 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.599480  8585 tablet_bootstrap.cc:654] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.603793  8291 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.607352  8584 ts_tablet_manager.cc:1434] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.069s	user 0.017s	sys 0.010s
W20260709 13:01:16.610286  8359 leader_election.cc:343] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.610776  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:16.618549  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:16.619052  8696 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.619401  8540 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.601779  8625 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.627785  8584 tablet_bootstrap.cc:492] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:16.640128  8605 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.642925  8591 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:16.645557  8540 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:16.652071  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:16.652876  8698 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.653546  8698 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:16.654400  8698 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.665740  8696 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.669310  8591 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.670228  8591 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.670787  8696 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.674544  8586 raft_consensus.cc:359] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.675386  8586 raft_consensus.cc:385] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.675833  8586 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.676508  8586 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.678372  8591 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:16.682574  8586 ts_tablet_manager.cc:1434] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.001s
I20260709 13:01:16.683525  8586 tablet_bootstrap.cc:492] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:16.686319  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:16.688679  8585 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:16.689209  8585 ts_tablet_manager.cc:1403] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.002s
W20260709 13:01:16.693275  8704 log.cc:927] Time spent T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:16.692538  8585 raft_consensus.cc:359] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.697054  8605 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.697906  8696 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.698302  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:16.703614  8508 leader_election.cc:343] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.699468  8585 raft_consensus.cc:385] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.706046  8585 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.722594  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:16.724318  8507 leader_election.cc:343] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.724649  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:16.720971  8468 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:16.729085  8712 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:01:16.703500  8290 catalog_manager.cc:5697] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:16.730587  8709 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.054s	user 0.004s	sys 0.000s
I20260709 13:01:16.731434  8585 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.730943  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:16.734089  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:16.738356  8584 tablet_bootstrap.cc:654] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:16.741530  8358 leader_election.cc:343] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:16.745262  8359 leader_election.cc:343] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.745720  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:16.747162  8696 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.747524  8585 ts_tablet_manager.cc:1434] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.058s	user 0.013s	sys 0.007s
I20260709 13:01:16.748787  8585 tablet_bootstrap.cc:492] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:16.749686  8695 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:16.751786  8706 log.cc:927] Time spent T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:16.808835  8586 tablet_bootstrap.cc:654] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.816962  8468 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:16.823660  8584 tablet_bootstrap.cc:492] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:16.824095  8584 ts_tablet_manager.cc:1403] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.197s	user 0.014s	sys 0.000s
I20260709 13:01:16.828038  8585 tablet_bootstrap.cc:654] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.827863  8584 raft_consensus.cc:359] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.829018  8584 raft_consensus.cc:385] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.829475  8584 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.832541  8584 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.836632  8584 ts_tablet_manager.cc:1434] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:16.837500  8584 tablet_bootstrap.cc:492] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:16.857342  8290 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.860644  8586 tablet_bootstrap.cc:492] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:16.861145  8586 ts_tablet_manager.cc:1403] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.178s	user 0.017s	sys 0.024s
I20260709 13:01:16.863742  8586 raft_consensus.cc:359] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.867976  8584 tablet_bootstrap.cc:654] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.868064  8585 tablet_bootstrap.cc:492] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:16.868690  8585 ts_tablet_manager.cc:1403] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.120s	user 0.022s	sys 0.004s
I20260709 13:01:16.871659  8585 raft_consensus.cc:359] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.872394  8585 raft_consensus.cc:385] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.872679  8585 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.873421  8585 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.876015  8585 ts_tablet_manager.cc:1434] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:16.876955  8585 tablet_bootstrap.cc:492] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:16.882638  8585 tablet_bootstrap.cc:654] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.864461  8586 raft_consensus.cc:385] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.883317  8586 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.889922  8586 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.910802  8586 ts_tablet_manager.cc:1434] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.006s
I20260709 13:01:16.911465  8649 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.912150  8649 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.916706  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:16.917599  8392 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:16.919428  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:16.920614  8592 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.921101  8592 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.921547  8592 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.923691  8649 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.925593  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:16.929008  8586 tablet_bootstrap.cc:492] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
W20260709 13:01:16.928916  8433 leader_election.cc:343] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.936134  8592 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.937551  8586 tablet_bootstrap.cc:654] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.940279  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:16.942049  8433 leader_election.cc:343] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.941604  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:16.942934  8392 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.944157  8584 tablet_bootstrap.cc:492] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:16.945438  8584 ts_tablet_manager.cc:1403] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.108s	user 0.032s	sys 0.041s
I20260709 13:01:16.938169  8592 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:16.945955  8697 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.948239  8584 raft_consensus.cc:359] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.948968  8584 raft_consensus.cc:385] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.949291  8584 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.949965  8392 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:16.950032  8584 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.951169  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:16.952307  8592 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.952530  8584 ts_tablet_manager.cc:1434] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:16.952865  8592 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:16.954437  8584 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:16.954128  8592 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.963086  8585 tablet_bootstrap.cc:492] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:16.963614  8585 ts_tablet_manager.cc:1403] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.026s
I20260709 13:01:16.965866  8584 tablet_bootstrap.cc:654] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.966140  8585 raft_consensus.cc:359] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.966732  8586 tablet_bootstrap.cc:492] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:16.966861  8585 raft_consensus.cc:385] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.967177  8586 ts_tablet_manager.cc:1403] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.004s
I20260709 13:01:16.967136  8585 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.968106  8585 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.971017  8585 ts_tablet_manager.cc:1434] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:16.971900  8585 tablet_bootstrap.cc:492] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:16.972931  8685 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.975060  8586 raft_consensus.cc:359] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.975708  8586 raft_consensus.cc:385] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.975261  8291 catalog_manager.cc:5697] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.975972  8586 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.976608  8586 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.977914  8585 tablet_bootstrap.cc:654] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.979525  8586 ts_tablet_manager.cc:1434] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:01:16.980428  8586 tablet_bootstrap.cc:492] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:16.980906  8584 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:16.981376  8584 ts_tablet_manager.cc:1403] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.011s
I20260709 13:01:16.984539  8584 raft_consensus.cc:359] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.985294  8584 raft_consensus.cc:385] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.985620  8584 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.986430  8586 tablet_bootstrap.cc:654] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.986331  8584 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:16.988569  8584 ts_tablet_manager.cc:1434] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:01:16.988901  8359 consensus_peers.cc:597] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:16.993609  8584 tablet_bootstrap.cc:492] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:16.999208  8585 tablet_bootstrap.cc:492] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:16.999737  8585 ts_tablet_manager.cc:1403] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.005s
I20260709 13:01:17.002451  8585 raft_consensus.cc:359] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.008877  8585 raft_consensus.cc:385] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.009354  8585 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.010246  8585 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.013250  8584 tablet_bootstrap.cc:654] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.016158  8585 ts_tablet_manager.cc:1434] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:01:17.017107  8585 tablet_bootstrap.cc:492] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.020888  8586 tablet_bootstrap.cc:492] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.021358  8586 ts_tablet_manager.cc:1403] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.015s
I20260709 13:01:17.026854  8585 tablet_bootstrap.cc:654] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.026494  8586 raft_consensus.cc:359] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.027429  8586 raft_consensus.cc:385] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.027799  8586 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.028704  8698 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.029338  8698 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.033147  8698 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.028677  8586 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.035203  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.033535  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.037379  8586 ts_tablet_manager.cc:1434] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
W20260709 13:01:17.038465  8358 leader_election.cc:343] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:17.039351  8359 leader_election.cc:343] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.039826  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.040439  8592 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.040902  8592 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.043021  8592 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.043557  8698 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.044298  8685 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.044795  8685 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.045746  8586 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.046855  8685 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.047640  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.048265  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.048477  8392 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:17.048875  8466 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:17.050246  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:17.053546  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.054646  8541 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:17.054833  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.057355  8586 tablet_bootstrap.cc:654] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.057914  8685 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.062005  8685 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.062398  8685 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:17.061059  8433 leader_election.cc:343] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.070421  8586 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.071079  8586 ts_tablet_manager.cc:1403] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.009s
W20260709 13:01:17.074164  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:17.076354  8586 raft_consensus.cc:359] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.076928  8586 raft_consensus.cc:385] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.077207  8586 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.074203  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:17.078197  8622 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.077945  8586 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.078540  8622 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.078868  8622 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.080313  8586 ts_tablet_manager.cc:1434] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:17.081202  8586 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.081291  8685 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.085866  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:17.086695  8392 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.087606  8586 tablet_bootstrap.cc:654] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.095554  8622 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.096693  8392 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:17.098502  8685 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.098971  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:17.102238  8466 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.102677  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:17.103283  8685 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.104265  8666 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.104733  8666 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:17.105154  8622 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.105578  8666 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.106489  8586 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.107013  8586 ts_tablet_manager.cc:1403] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:01:17.103788  8685 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.110021  8685 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.109716  8586 raft_consensus.cc:359] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.110512  8586 raft_consensus.cc:385] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.110837  8586 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.111512  8586 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.113253  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.113643  8586 ts_tablet_manager.cc:1434] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:17.114701  8586 tablet_bootstrap.cc:492] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
W20260709 13:01:17.115185  8507 leader_election.cc:343] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.111747  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.115942  8468 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:17.117194  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:17.120798  8685 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.122514  8685 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.122709  8586 tablet_bootstrap.cc:654] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.122937  8685 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.123219  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:17.120193  8466 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:17.135432  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:17.136292  8541 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.137498  8584 tablet_bootstrap.cc:492] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:17.138041  8584 ts_tablet_manager.cc:1403] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.145s	user 0.051s	sys 0.042s
I20260709 13:01:17.144256  8698 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:17.147027  8433 leader_election.cc:343] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.147666  8685 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.148178  8291 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.150375  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:17.152357  8507 leader_election.cc:343] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.161327  8541 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:17.167372  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:17.168196  8466 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.166316  8685 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.176036  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:17.176627  8584 raft_consensus.cc:359] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.177842  8584 raft_consensus.cc:385] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.178098  8584 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.176920  8622 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.180044  8622 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:17.180385  8698 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.182919  8622 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.184557  8584 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.187134  8584 ts_tablet_manager.cc:1434] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.006s
I20260709 13:01:17.188084  8585 tablet_bootstrap.cc:492] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:17.188524  8585 ts_tablet_manager.cc:1403] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.172s	user 0.021s	sys 0.023s
I20260709 13:01:17.188665  8584 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:17.193859  8586 tablet_bootstrap.cc:492] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.198122  8466 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:17.200901  8698 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.202222  8585 raft_consensus.cc:359] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.203130  8585 raft_consensus.cc:385] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.203462  8585 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.204401  8666 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.204857  8666 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.204859  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:17.206943  8666 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.207437  8666 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.208554  8586 ts_tablet_manager.cc:1403] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.037s
I20260709 13:01:17.209229  8585 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.214371  8585 ts_tablet_manager.cc:1434] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:01:17.215539  8585 tablet_bootstrap.cc:492] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.208201  8666 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:17.221824  8666 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.218225  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.232575  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.233446  8392 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:17.234845  8586 raft_consensus.cc:359] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.236182  8586 raft_consensus.cc:385] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.236644  8586 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.239748  8290 catalog_manager.cc:5697] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.242391  8586 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.244354  8685 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.245057  8685 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.248490  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.249604  8605 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.250106  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.255714  8585 tablet_bootstrap.cc:654] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.266322  8685 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.267441  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.268122  8469 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:17.269358  8508 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:17.270025  8507 leader_election.cc:343] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.271792  8685 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.272181  8685 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.274091  8586 ts_tablet_manager.cc:1434] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:01:17.275105  8586 tablet_bootstrap.cc:492] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.272578  8685 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.278046  8293 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.284349  8605 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.280495  8666 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.299120  8666 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.297742  8685 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.301990  8685 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.302827  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:17.297526  8584 tablet_bootstrap.cc:654] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.305298  8586 tablet_bootstrap.cc:654] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.308416  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:17.303517  8469 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:17.314554  8507 leader_election.cc:343] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.315729  8625 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.316573  8469 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:17.316401  8625 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.317598  8666 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.319173  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.320138  8468 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:17.320848  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.321812  8466 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:17.321990  8508 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:17.317327  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.324141  8394 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:17.326782  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:17.328068  8696 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.328583  8696 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.329071  8696 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.323348  8666 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.334146  8666 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.334625  8666 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.335664  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:17.337291  8358 leader_election.cc:343] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.337987  8625 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.339151  8585 tablet_bootstrap.cc:492] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:17.339586  8585 ts_tablet_manager.cc:1403] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.009s
I20260709 13:01:17.341621  8585 raft_consensus.cc:359] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.342409  8585 raft_consensus.cc:385] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.342705  8585 raft_consensus.cc:740] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.342758  8508 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:17.343827  8586 tablet_bootstrap.cc:492] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.343515  8585 consensus_queue.cc:260] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.343533  8696 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.344135  8685 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.344574  8586 ts_tablet_manager.cc:1403] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.006s
I20260709 13:01:17.344718  8685 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:17.345824  8685 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.346817  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:17.347476  8466 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.347302  8666 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.349694  8666 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.349510  8586 raft_consensus.cc:359] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.350414  8586 raft_consensus.cc:385] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.350723  8586 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.346724  8585 ts_tablet_manager.cc:1434] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:01:17.351357  8696 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.346720  8584 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:17.352793  8584 ts_tablet_manager.cc:1403] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.012s
I20260709 13:01:17.352414  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:17.353444  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:17.353598  8469 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.352033  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:17.354897  8358 leader_election.cc:343] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.355014  8394 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.356210  8584 raft_consensus.cc:359] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.357045  8584 raft_consensus.cc:385] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.357303  8584 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.358083  8584 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.359138  8625 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.359644  8625 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.360225  8685 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.360800  8586 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.360915  8685 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.363335  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.364075  8468 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:17.364284  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.365485  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:17.365857  8507 leader_election.cc:343] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.365181  8290 catalog_manager.cc:5697] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.360337  8584 ts_tablet_manager.cc:1434] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:01:17.352433  8585 tablet_bootstrap.cc:492] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.366710  8698 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.367187  8698 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.367568  8698 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.368161  8584 tablet_bootstrap.cc:492] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:17.375131  8466 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:17.376307  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.376545  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:17.380087  8508 leader_election.cc:343] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.380585  8508 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.381202  8590 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.381739  8590 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:17.381995  8625 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.382406  8585 tablet_bootstrap.cc:654] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.377965  8586 ts_tablet_manager.cc:1434] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:01:17.382654  8590 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.383107  8394 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:17.385438  8586 tablet_bootstrap.cc:492] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.375840  8685 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.395749  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.399219  8507 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:17.400193  8358 leader_election.cc:343] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.403292  8584 tablet_bootstrap.cc:654] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.404237  8697 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.394888  8469 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:17.404917  8697 raft_consensus.cc:697] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:17.405872  8697 consensus_queue.cc:237] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.411146  8586 tablet_bootstrap.cc:654] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.412467  8622 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.414191  8291 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.388820  8666 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.429946  8622 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.437705  8584 tablet_bootstrap.cc:492] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:17.438602  8698 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.442436  8586 tablet_bootstrap.cc:492] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.442957  8586 ts_tablet_manager.cc:1403] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.020s
I20260709 13:01:17.443724  8698 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.444646  8584 ts_tablet_manager.cc:1403] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.007s
I20260709 13:01:17.446866  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:17.447923  8586 raft_consensus.cc:359] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.448684  8586 raft_consensus.cc:385] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:17.448843  8358 leader_election.cc:343] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.448983  8586 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.449918  8585 tablet_bootstrap.cc:492] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:17.450443  8585 ts_tablet_manager.cc:1403] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.013s
I20260709 13:01:17.451433  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:17.452036  8469 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.449815  8586 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.458662  8586 ts_tablet_manager.cc:1434] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:01:17.459681  8586 tablet_bootstrap.cc:492] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.466346  8586 tablet_bootstrap.cc:654] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.471581  8585 raft_consensus.cc:359] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.475796  8585 raft_consensus.cc:385] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.476239  8585 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.477023  8585 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.474998  8584 raft_consensus.cc:359] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.478729  8584 raft_consensus.cc:385] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.479167  8584 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.474280  8469 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:17.479276  8290 catalog_manager.cc:5697] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.480664  8584 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.481485  8586 tablet_bootstrap.cc:492] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.481992  8586 ts_tablet_manager.cc:1403] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:01:17.483253  8584 ts_tablet_manager.cc:1434] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 13:01:17.484253  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:17.486837  8584 tablet_bootstrap.cc:492] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:17.486909  8698 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.487777  8698 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:17.488617  8698 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.486822  8586 raft_consensus.cc:359] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.494300  8584 tablet_bootstrap.cc:654] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.495589  8586 raft_consensus.cc:385] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.496290  8586 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.486069  8585 ts_tablet_manager.cc:1434] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:01:17.498957  8585 tablet_bootstrap.cc:492] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.498584  8586 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.501921  8586 ts_tablet_manager.cc:1434] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:01:17.504812  8586 tablet_bootstrap.cc:492] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.507488  8585 tablet_bootstrap.cc:654] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.514626  8584 tablet_bootstrap.cc:492] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:17.514760  8695 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.515134  8584 ts_tablet_manager.cc:1403] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.003s
I20260709 13:01:17.517261  8586 tablet_bootstrap.cc:654] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.519433  8584 raft_consensus.cc:359] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.520202  8584 raft_consensus.cc:385] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.520586  8584 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.521351  8584 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.523913  8584 ts_tablet_manager.cc:1434] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:17.524876  8584 tablet_bootstrap.cc:492] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:17.529145  8586 tablet_bootstrap.cc:492] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.529647  8586 ts_tablet_manager.cc:1403] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.006s
I20260709 13:01:17.530112  8685 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.531077  8622 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.531577  8622 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.532411  8586 raft_consensus.cc:359] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.533128  8586 raft_consensus.cc:385] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.533402  8586 raft_consensus.cc:740] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.533718  8622 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.534087  8586 consensus_queue.cc:260] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.535246  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.535702  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.536020  8394 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:17.537632  8584 tablet_bootstrap.cc:654] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.539127  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:17.540176  8433 leader_election.cc:343] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.540625  8586 ts_tablet_manager.cc:1434] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:01:17.541658  8586 tablet_bootstrap.cc:492] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.541779  8649 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.542389  8649 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.542883  8649 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.549189  8586 tablet_bootstrap.cc:654] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.555802  8585 tablet_bootstrap.cc:492] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:17.555635  8649 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.556282  8585 ts_tablet_manager.cc:1403] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.000s
I20260709 13:01:17.557441  8649 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.558625  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:17.559026  8585 raft_consensus.cc:359] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.559823  8585 raft_consensus.cc:385] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.560231  8585 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
W20260709 13:01:17.560418  8433 leader_election.cc:343] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.561214  8585 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.563014  8584 tablet_bootstrap.cc:492] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:17.564862  8584 ts_tablet_manager.cc:1403] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.000s
I20260709 13:01:17.567839  8584 raft_consensus.cc:359] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.568696  8584 raft_consensus.cc:385] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.558991  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:17.570900  8392 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.563704  8585 ts_tablet_manager.cc:1434] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:17.575486  8586 tablet_bootstrap.cc:492] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.575968  8586 ts_tablet_manager.cc:1403] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.003s
I20260709 13:01:17.578598  8585 tablet_bootstrap.cc:492] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.578327  8586 raft_consensus.cc:359] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.579032  8586 raft_consensus.cc:385] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.579329  8586 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.580216  8586 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.570248  8584 raft_consensus.cc:740] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.584060  8586 ts_tablet_manager.cc:1434] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:01:17.585091  8586 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.584738  8584 consensus_queue.cc:260] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.588502  8584 ts_tablet_manager.cc:1434] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:01:17.589514  8584 tablet_bootstrap.cc:492] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:17.591894  8586 tablet_bootstrap.cc:654] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.595934  8585 tablet_bootstrap.cc:654] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.598628  8590 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.599176  8590 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.600315  8392 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:17.602661  8584 tablet_bootstrap.cc:654] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.602588  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:17.603150  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.603847  8649 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.604029  8541 raft_consensus.cc:2393] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:17.604651  8649 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:17.605440  8585 tablet_bootstrap.cc:492] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:17.606182  8585 ts_tablet_manager.cc:1403] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.003s
I20260709 13:01:17.605647  8649 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.601565  8590 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.610142  8585 raft_consensus.cc:359] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.611147  8585 raft_consensus.cc:385] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.613068  8666 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.613145  8585 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.611678  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.613682  8666 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.614344  8585 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.616544  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.617764  8666 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.618476  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.618548  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.619417  8469 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 1: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:17.620179  8590 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.617594  8585 ts_tablet_manager.cc:1434] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:01:17.621129  8508 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.622066  8685 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.622315  8585 tablet_bootstrap.cc:492] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.623391  8584 tablet_bootstrap.cc:492] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:17.623860  8584 ts_tablet_manager.cc:1403] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.012s
I20260709 13:01:17.627566  8584 raft_consensus.cc:359] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.628314  8584 raft_consensus.cc:385] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.628628  8584 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.629240  8585 tablet_bootstrap.cc:654] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.629475  8584 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.630123  8698 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.628407  8293 catalog_manager.cc:5697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.630661  8698 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.634250  8622 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.633496  8666 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:17.637120  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.641973  8698 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.646487  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.631856  8584 ts_tablet_manager.cc:1434] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:01:17.646593  8590 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.649092  8685 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.653558  8584 tablet_bootstrap.cc:492] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:17.667510  8696 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.669942  8696 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.654551  8392 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.677203  8696 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.652839  8622 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.678539  8622 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.657135  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.649663  8592 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.684326  8622 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.684253  8592 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.756383  8584 tablet_bootstrap.cc:654] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.752702  8585 tablet_bootstrap.cc:492] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:17.766424  8585 ts_tablet_manager.cc:1403] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.026s
I20260709 13:01:17.708698  8685 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:01:17.705282  8625 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.769299  8585 raft_consensus.cc:359] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.755379  8586 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.772396  8586 ts_tablet_manager.cc:1403] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.188s	user 0.013s	sys 0.016s
I20260709 13:01:17.780124  8592 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.688205  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.782528  8542 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
W20260709 13:01:17.743829  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 86979.4us
I20260709 13:01:17.785017  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.770772  8585 raft_consensus.cc:385] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.787268  8585 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.788100  8585 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.789948  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:17.791419  8696 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.791605  8585 ts_tablet_manager.cc:1434] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:01:17.791839  8696 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.792238  8696 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.792639  8585 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.784727  8586 raft_consensus.cc:359] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.796986  8586 raft_consensus.cc:385] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.797981  8586 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.798113  8698 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.799260  8698 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.801432  8698 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.802450  8586 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.804908  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.809446  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.810732  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.812168  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.819130  8586 ts_tablet_manager.cc:1434] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.005s
I20260709 13:01:17.823110  8586 tablet_bootstrap.cc:492] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.826145  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.831892  8468 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:17.834961  8696 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.837869  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.838894  8468 raft_consensus.cc:2393] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:17.839109  8685 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.841540  8586 tablet_bootstrap.cc:654] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.844610  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:17.845530  8468 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.847666  8585 tablet_bootstrap.cc:654] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:17.858415  8433 leader_election.cc:343] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.858716  8586 tablet_bootstrap.cc:492] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.859612  8586 ts_tablet_manager.cc:1403] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.010s
I20260709 13:01:17.865607  8696 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.872257  8685 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.872437  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.872911  8685 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.874336  8590 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.875137  8625 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.879626  8685 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.875389  8586 raft_consensus.cc:359] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.880028  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:17.880420  8586 raft_consensus.cc:385] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.880671  8542 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.880905  8586 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.881700  8685 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.882067  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.882576  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.882005  8586 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:17.883567  8507 leader_election.cc:343] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.884287  8469 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:17.884974  8586 ts_tablet_manager.cc:1434] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:01:17.885288  8625 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.886160  8586 tablet_bootstrap.cc:492] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.882275  8685 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.886844  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:17.887941  8666 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.888322  8666 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.888676  8666 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.889353  8685 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.890130  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:17.891659  8507 leader_election.cc:343] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.882192  8649 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.893266  8649 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.895264  8649 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:17.894577  8289 catalog_manager.cc:5697] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.892544  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:17.897142  8508 leader_election.cc:343] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.897636  8508 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.899309  8697 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.901343  8666 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.902935  8586 tablet_bootstrap.cc:654] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.904206  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:17.906118  8649 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.907500  8666 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.908782  8584 tablet_bootstrap.cc:492] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:17.909276  8584 ts_tablet_manager.cc:1403] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.256s	user 0.044s	sys 0.102s
I20260709 13:01:17.910936  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:17.911139  8697 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.912184  8542 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:17.911926  8584 raft_consensus.cc:359] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:17.912365  8507 leader_election.cc:343] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.912662  8468 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:17.912690  8584 raft_consensus.cc:385] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.913699  8584 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.914389  8584 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.915692  8586 tablet_bootstrap.cc:492] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:17.916133  8586 ts_tablet_manager.cc:1403] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 13:01:17.916252  8584 ts_tablet_manager.cc:1434] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:01:17.916721  8649 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.918303  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:17.918946  8468 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.918660  8586 raft_consensus.cc:359] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.919387  8586 raft_consensus.cc:385] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.919660  8586 raft_consensus.cc:740] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.858793  8585 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:17.928452  8585 ts_tablet_manager.cc:1403] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.000s
W20260709 13:01:17.928479  8433 leader_election.cc:343] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.928671  8468 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:17.929304  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:17.930117  8649 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.930567  8685 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.931262  8585 raft_consensus.cc:359] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.931951  8585 raft_consensus.cc:385] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.931713  8586 consensus_queue.cc:260] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.932325  8585 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.932468  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:17.933115  8585 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.935173  8695 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.935667  8695 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:17.936491  8695 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.939723  8585 ts_tablet_manager.cc:1434] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:17.940657  8585 tablet_bootstrap.cc:492] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.941741  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:17.942727  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.944537  8395 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:17.945151  8696 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.945169  8466 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.945715  8696 raft_consensus.cc:697] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:17.946914  8584 tablet_bootstrap.cc:492] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:17.946599  8696 consensus_queue.cc:237] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.947618  8585 tablet_bootstrap.cc:654] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.949887  8697 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.950348  8697 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.952378  8697 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:17.955549  8666 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.956207  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:17.956892  8541 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:17.958024  8584 tablet_bootstrap.cc:654] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.960422  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:17.964221  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:17.960711  8585 tablet_bootstrap.cc:492] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:17.967794  8585 ts_tablet_manager.cc:1403] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 13:01:17.968466  8507 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:17.969575  8697 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.971364  8585 raft_consensus.cc:359] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.972322  8585 raft_consensus.cc:385] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.972662  8585 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.973613  8585 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:17.976644  8585 ts_tablet_manager.cc:1434] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:17.977890  8585 tablet_bootstrap.cc:492] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:17.979279  8586 ts_tablet_manager.cc:1434] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 13:01:17.982084  8586 tablet_bootstrap.cc:492] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:17.988794  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:17.990636  8649 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.991086  8649 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.991314  8586 tablet_bootstrap.cc:654] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.991449  8649 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.104629  8585 tablet_bootstrap.cc:654] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.114933  8622 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.115523  8622 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.116794  8586 tablet_bootstrap.cc:492] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:18.117228  8586 ts_tablet_manager.cc:1403] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.014s
I20260709 13:01:18.117460  8622 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.120316  8586 raft_consensus.cc:359] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.120976  8586 raft_consensus.cc:385] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.121258  8586 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.126153  8586 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.134003  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:18.145069  8791 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:18.150722  8433 leader_election.cc:343] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.158852  8585 tablet_bootstrap.cc:492] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:18.159507  8585 ts_tablet_manager.cc:1403] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.182s	user 0.021s	sys 0.028s
I20260709 13:01:18.171648  8584 tablet_bootstrap.cc:492] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:18.172179  8584 ts_tablet_manager.cc:1403] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.225s	user 0.018s	sys 0.021s
I20260709 13:01:18.182070  8584 raft_consensus.cc:359] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.183056  8584 raft_consensus.cc:385] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.183372  8584 raft_consensus.cc:740] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.183972  8584 consensus_queue.cc:260] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.184657  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:18.202776  8622 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.186335  8289 catalog_manager.cc:5697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.205716  8584 ts_tablet_manager.cc:1434] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:01:18.206964  8584 tablet_bootstrap.cc:492] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:18.213452  8586 ts_tablet_manager.cc:1434] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.096s	user 0.015s	sys 0.017s
I20260709 13:01:18.215958  8586 tablet_bootstrap.cc:492] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:18.218868  8622 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.221182  8622 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.224179  8622 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.206043  8649 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.225142  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:18.226342  8649 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.227065  8544 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:18.227075  8433 leader_election.cc:343] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:18.227730  8779 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:18.228046  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:18.231288  8433 leader_election.cc:343] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.231771  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:18.232417  8790 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.234108  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:18.234690  8541 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.235179  8791 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.241735  8543 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.245919  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:18.247071  8395 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.246140  8541 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:18.251200  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:18.252117  8790 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.252530  8625 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.253116  8790 raft_consensus.cc:697] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:18.253980  8790 consensus_queue.cc:237] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.255191  8395 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
W20260709 13:01:18.258071  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:18.257560  8585 raft_consensus.cc:359] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.259850  8585 raft_consensus.cc:385] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.260133  8585 raft_consensus.cc:740] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.262276  8584 tablet_bootstrap.cc:654] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.262101  8791 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.264588  8585 consensus_queue.cc:260] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.264250  8622 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.265540  8542 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:18.268005  8585 ts_tablet_manager.cc:1434] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.001s
I20260709 13:01:18.268999  8585 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:18.269380  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:18.275098  8788 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.276566  8788 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.278862  8788 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.277835  8290 catalog_manager.cc:5697] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.281250  8767 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.281900  8767 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.291721  8767 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.275784  8791 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.298130  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:18.299785  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:18.300781  8433 leader_election.cc:343] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:18.301986  8433 leader_election.cc:343] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.302376  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:18.306813  8791 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.308007  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:18.310940  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:18.308535  8622 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.313407  8468 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:18.315831  8586 tablet_bootstrap.cc:654] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.318840  8358 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:18.319926  8792 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.320348  8585 tablet_bootstrap.cc:654] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.305572  8788 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.348933  8584 tablet_bootstrap.cc:492] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:18.349463  8584 ts_tablet_manager.cc:1403] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.005s
I20260709 13:01:18.352077  8584 raft_consensus.cc:359] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.352777  8584 raft_consensus.cc:385] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.353010  8584 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.354292  8584 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.357354  8584 ts_tablet_manager.cc:1434] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:18.361351  8584 tablet_bootstrap.cc:492] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:18.357339  8792 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.370509  8585 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:18.372130  8788 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.373054  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:18.373057  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:18.373832  8544 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.374162  8393 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.370968  8585 ts_tablet_manager.cc:1403] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.017s
I20260709 13:01:18.378079  8585 raft_consensus.cc:359] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.378762  8585 raft_consensus.cc:385] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.379038  8585 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.380622  8544 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:18.380622  8393 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:18.382301  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:18.383005  8788 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.383502  8788 raft_consensus.cc:697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:18.384308  8788 consensus_queue.cc:237] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.382177  8585 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.395192  8584 tablet_bootstrap.cc:654] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.417938  8586 tablet_bootstrap.cc:492] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:18.418397  8586 ts_tablet_manager.cc:1403] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.203s	user 0.011s	sys 0.008s
I20260709 13:01:18.420406  8585 ts_tablet_manager.cc:1434] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 13:01:18.421387  8585 tablet_bootstrap.cc:492] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:18.404897  8288 catalog_manager.cc:5697] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.422240  8695 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.424233  8586 raft_consensus.cc:359] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.424924  8586 raft_consensus.cc:385] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.425171  8586 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.390202  8789 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:01:18.425931  8586 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.428362  8586 ts_tablet_manager.cc:1434] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:01:18.429454  8586 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:18.435770  8789 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.441216  8685 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.441973  8586 tablet_bootstrap.cc:654] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.442140  8585 tablet_bootstrap.cc:654] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.446321  8584 tablet_bootstrap.cc:492] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:18.446877  8584 ts_tablet_manager.cc:1403] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.012s
I20260709 13:01:18.452518  8584 raft_consensus.cc:359] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.453176  8584 raft_consensus.cc:385] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.453500  8584 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.455031  8584 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.457002  8584 ts_tablet_manager.cc:1434] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:18.458091  8584 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:18.473372  8584 tablet_bootstrap.cc:654] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.475147  8586 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:18.475606  8586 ts_tablet_manager.cc:1403] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.046s	user 0.005s	sys 0.008s
I20260709 13:01:18.479403  8586 raft_consensus.cc:359] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.480073  8586 raft_consensus.cc:385] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.480353  8586 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.481040  8586 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.483836  8586 ts_tablet_manager.cc:1434] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:18.484951  8586 tablet_bootstrap.cc:492] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:18.483870  8585 tablet_bootstrap.cc:492] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:18.488240  8585 ts_tablet_manager.cc:1403] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.009s
I20260709 13:01:18.492126  8585 raft_consensus.cc:359] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.492915  8585 raft_consensus.cc:385] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.493183  8585 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.493884  8585 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.494673  8586 tablet_bootstrap.cc:654] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.499428  8585 ts_tablet_manager.cc:1434] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:18.500401  8585 tablet_bootstrap.cc:492] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:18.507272  8585 tablet_bootstrap.cc:654] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.511339  8584 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:18.511831  8584 ts_tablet_manager.cc:1403] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.007s
I20260709 13:01:18.513918  8685 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.514436  8685 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.514670  8584 raft_consensus.cc:359] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.516106  8585 tablet_bootstrap.cc:492] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:18.516187  8584 raft_consensus.cc:385] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.516607  8585 ts_tablet_manager.cc:1403] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 13:01:18.516640  8584 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.518622  8685 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:18.518577  8584 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.519335  8585 raft_consensus.cc:359] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.520226  8585 raft_consensus.cc:385] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.520510  8585 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.521256  8585 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.523229  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:18.523651  8585 ts_tablet_manager.cc:1434] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:01:18.523841  8393 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:18.524531  8585 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:18.528287  8507 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:18.529255  8666 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.529609  8666 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.529966  8666 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.529876  8698 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.530673  8698 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.531548  8585 tablet_bootstrap.cc:654] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.537892  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:18.539494  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:18.540398  8544 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:18.542203  8358 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:18.543551  8698 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.543916  8649 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.544253  8698 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.544786  8698 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.544628  8649 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.545329  8698 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.547453  8649 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.550835  8584 ts_tablet_manager.cc:1434] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 13:01:18.551671  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:18.539899  8468 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:18.562461  8584 tablet_bootstrap.cc:492] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:18.564494  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:18.564538  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:18.575713  8289 catalog_manager.cc:5697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:18.576977  8359 leader_election.cc:343] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:18.582772  8433 leader_election.cc:343] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:18.597036  8433 leader_election.cc:343] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.605703  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:18.611720  8788 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.618340  8584 tablet_bootstrap.cc:654] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.587092  8666 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.594048  8698 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.622834  8698 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.624958  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:18.625839  8544 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.641045  8584 tablet_bootstrap.cc:492] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:18.641727  8584 ts_tablet_manager.cc:1403] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.009s
I20260709 13:01:18.645373  8584 raft_consensus.cc:359] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.646309  8584 raft_consensus.cc:385] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.646679  8584 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.647637  8584 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.651435  8544 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:18.667240  8584 ts_tablet_manager.cc:1434] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:01:18.687337  8584 tablet_bootstrap.cc:492] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:18.699901  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:18.704973  8666 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:18.705263  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:18.710896  8467 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.712380  8789 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.712836  8585 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:18.712826  8789 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.713531  8585 ts_tablet_manager.cc:1403] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.189s	user 0.071s	sys 0.107s
I20260709 13:01:18.706377  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:18.714286  8393 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.715222  8789 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.708299  8586 tablet_bootstrap.cc:492] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:18.716409  8586 ts_tablet_manager.cc:1403] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.232s	user 0.077s	sys 0.116s
I20260709 13:01:18.717449  8798 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.717967  8798 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.718410  8358 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:18.719161  8698 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.719657  8698 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:18.720144  8585 raft_consensus.cc:359] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.720921  8585 raft_consensus.cc:385] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.720777  8698 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.721252  8585 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.722023  8585 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.724004  8584 tablet_bootstrap.cc:654] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.724087  8585 ts_tablet_manager.cc:1434] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:01:18.725135  8585 tablet_bootstrap.cc:492] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:18.719638  8467 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:18.728847  8508 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:18.729676  8666 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.731851  8798 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.736550  8585 tablet_bootstrap.cc:654] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.737913  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:18.746163  8544 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:18.747875  8622 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.745167  8666 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:18.754053  8359 leader_election.cc:343] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.776182  8666 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.764791  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:18.768663  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:18.779454  8544 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:18.769227  8358 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:18.779729  8586 raft_consensus.cc:359] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.780413  8586 raft_consensus.cc:385] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.780699  8586 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.774585  8788 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.781839  8791 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.782207  8791 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.782534  8791 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.781308  8586 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.798789  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:18.806361  8586 ts_tablet_manager.cc:1434] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 13:01:18.807603  8586 tablet_bootstrap.cc:492] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:18.745252  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:18.810815  8433 leader_election.cc:343] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:18.801424  8798 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.814931  8798 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.815194  8466 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:18.827589  8584 tablet_bootstrap.cc:492] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:18.828100  8584 ts_tablet_manager.cc:1403] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.141s	user 0.036s	sys 0.048s
I20260709 13:01:18.823622  8798 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.847357  8585 tablet_bootstrap.cc:492] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:18.848021  8585 ts_tablet_manager.cc:1403] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.123s	user 0.025s	sys 0.042s
I20260709 13:01:18.886319  8584 raft_consensus.cc:359] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.891240  8584 raft_consensus.cc:385] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.891548  8584 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.893092  8584 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:18.894381  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46471.4us
I20260709 13:01:18.896099  8584 ts_tablet_manager.cc:1434] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 13:01:18.897013  8584 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:18.895658  8289 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.899413  8789 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.899935  8789 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.903626  8789 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.903501  8592 consensus_queue.cc:1048] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.905593  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:18.910914  8544 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:18.911223  8288 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.912115  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:18.912822  8698 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:18.913170  8698 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.913508  8698 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.913341  8585 raft_consensus.cc:359] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.914034  8585 raft_consensus.cc:385] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:18.914302  8585 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:18.910482  8586 tablet_bootstrap.cc:654] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.914911  8585 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.920085  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:18.924552  8585 ts_tablet_manager.cc:1434] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.076s	user 0.003s	sys 0.014s
I20260709 13:01:18.929554  8585 tablet_bootstrap.cc:492] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:18.931835  8698 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.936517  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:18.937093  8542 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.937594  8798 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.938788  8466 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:18.944496  8584 tablet_bootstrap.cc:654] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:18.947253  8698 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.947050  8393 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:18.955302  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:18.956063  8466 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:18.956907  8798 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.957506  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:18.957715  8791 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:18.958278  8395 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 1: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:18.958640  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:18.959607  8791 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:18.962340  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:18.963877  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:18.963276  8542 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:18.966183  8468 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.966634  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:18.964493  8798 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.973286  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:18.972041  8543 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.975060  8792 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:18.985680  8792 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:18.986543  8792 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.003409  8289 catalog_manager.cc:5697] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.009090  8468 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:19.018330  8543 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:19.016271  8798 consensus_queue.cc:1048] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:19.013566  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.022048  8792 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.022845  8792 raft_consensus.cc:697] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:19.023777  8792 consensus_queue.cc:237] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.035131  8585 tablet_bootstrap.cc:654] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.052703  8586 tablet_bootstrap.cc:492] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.053234  8586 ts_tablet_manager.cc:1403] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.246s	user 0.023s	sys 0.025s
I20260709 13:01:19.057137  8586 raft_consensus.cc:359] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.058279  8586 raft_consensus.cc:385] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.058640  8586 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.059391  8586 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.061767  8586 ts_tablet_manager.cc:1434] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:01:19.066475  8584 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:19.067011  8584 ts_tablet_manager.cc:1403] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.000s
I20260709 13:01:19.068035  8815 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.068498  8815 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.069670  8586 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:19.070302  8584 raft_consensus.cc:359] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.071036  8584 raft_consensus.cc:385] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.071300  8584 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.072119  8815 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:19.072065  8584 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.073757  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.074321  8584 ts_tablet_manager.cc:1434] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:01:19.075179  8507 leader_election.cc:343] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.076659  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.077266  8466 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:19.081153  8508 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:19.081516  8584 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:19.083981  8586 tablet_bootstrap.cc:654] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.084638  8666 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.085125  8666 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.085503  8666 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.086318  8290 catalog_manager.cc:5697] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.088470  8584 tablet_bootstrap.cc:654] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.098521  8585 tablet_bootstrap.cc:492] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:19.098976  8585 ts_tablet_manager.cc:1403] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.010s
I20260709 13:01:19.099870  8586 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.100359  8586 ts_tablet_manager.cc:1403] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.007s
I20260709 13:01:19.101403  8585 raft_consensus.cc:359] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.102146  8585 raft_consensus.cc:385] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.102411  8585 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.103035  8586 raft_consensus.cc:359] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.103047  8585 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.103863  8586 raft_consensus.cc:385] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.104195  8586 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.104876  8586 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.105997  8697 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.106491  8792 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.106667  8585 ts_tablet_manager.cc:1434] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:19.107090  8586 ts_tablet_manager.cc:1434] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:19.107016  8792 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.107647  8585 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:19.108345  8586 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:19.108243  8666 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.109107  8792 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.111757  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.114133  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.114756  8466 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:19.115154  8585 tablet_bootstrap.cc:654] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.116148  8586 tablet_bootstrap.cc:654] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.118216  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:19.118541  8666 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:19.119673  8507 leader_election.cc:343] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.120317  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.106554  8697 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.121155  8792 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.122623  8697 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:19.123615  8544 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:19.127616  8792 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.128052  8792 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.128757  8586 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.129246  8586 ts_tablet_manager.cc:1403] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 13:01:19.132202  8586 raft_consensus.cc:359] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.133035  8586 raft_consensus.cc:385] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.133160  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.133253  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:19.133400  8586 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.134069  8466 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.134433  8586 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.136787  8586 ts_tablet_manager.cc:1434] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:19.138154  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.138775  8468 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:19.139915  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.141079  8466 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:19.142072  8697 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.142536  8697 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.142928  8697 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.142547  8508 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:19.144023  8792 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.145009  8666 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.146145  8395 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 1: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:19.146847  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:19.147408  8468 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.145669  8666 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:19.150588  8666 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.152007  8586 tablet_bootstrap.cc:492] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:19.154559  8468 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:19.155843  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.156637  8789 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.156777  8584 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:19.157116  8789 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:19.157991  8789 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.159109  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:19.159793  8792 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.165737  8586 tablet_bootstrap.cc:654] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.151093  8697 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.168370  8815 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.168680  8544 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:19.168906  8815 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.171020  8815 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:19.171293  8697 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:19.157235  8584 ts_tablet_manager.cc:1403] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.009s
I20260709 13:01:19.174464  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.174772  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:19.176064  8507 leader_election.cc:343] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.175675  8290 catalog_manager.cc:5697] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.179282  8584 raft_consensus.cc:359] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.180015  8584 raft_consensus.cc:385] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.180284  8584 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.182142  8584 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.184530  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:19.185607  8470 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 1: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:19.185551  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.186676  8466 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:19.187063  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:19.188030  8666 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.184684  8584 ts_tablet_manager.cc:1434] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:01:19.189670  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:19.190824  8584 tablet_bootstrap.cc:492] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:19.191501  8585 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:19.191922  8585 ts_tablet_manager.cc:1403] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.005s
I20260709 13:01:19.192746  8697 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.193135  8697 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.193490  8697 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.188242  8586 tablet_bootstrap.cc:492] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.196452  8586 ts_tablet_manager.cc:1403] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.004s
I20260709 13:01:19.196075  8289 catalog_manager.cc:5697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.199007  8585 raft_consensus.cc:359] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.199111  8586 raft_consensus.cc:359] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.199682  8585 raft_consensus.cc:385] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.199815  8586 raft_consensus.cc:385] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.199990  8585 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.200203  8586 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.200680  8585 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.200922  8586 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.203210  8586 ts_tablet_manager.cc:1434] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:01:19.204352  8586 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:19.205459  8697 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.208791  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:19.209393  8395 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.210445  8697 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:19.214895  8586 tablet_bootstrap.cc:654] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.214920  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:19.218043  8466 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.223263  8584 tablet_bootstrap.cc:654] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.225281  8395 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:19.226352  8466 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:19.226673  8507 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:19.227684  8666 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.228432  8666 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:19.229261  8666 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.235576  8584 tablet_bootstrap.cc:492] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:19.235792  8585 ts_tablet_manager.cc:1434] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:01:19.236052  8584 ts_tablet_manager.cc:1403] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.011s
I20260709 13:01:19.237372  8585 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:19.238667  8584 raft_consensus.cc:359] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.239418  8584 raft_consensus.cc:385] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.239691  8584 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.240304  8584 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.243070  8584 ts_tablet_manager.cc:1434] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:01:19.244067  8584 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:19.250061  8584 tablet_bootstrap.cc:654] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.258844  8584 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:19.258948  8586 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.259389  8584 ts_tablet_manager.cc:1403] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:01:19.259661  8586 ts_tablet_manager.cc:1403] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.014s
I20260709 13:01:19.252750  8288 catalog_manager.cc:5697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.261947  8584 raft_consensus.cc:359] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.262259  8586 raft_consensus.cc:359] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.262666  8584 raft_consensus.cc:385] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.263057  8586 raft_consensus.cc:385] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.263101  8584 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.263543  8586 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.264026  8584 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.264348  8586 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.266759  8586 ts_tablet_manager.cc:1434] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:01:19.268527  8586 tablet_bootstrap.cc:492] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
W20260709 13:01:19.272971  8359 consensus_peers.cc:597] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.275596  8586 tablet_bootstrap.cc:654] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.276602  8585 tablet_bootstrap.cc:654] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.276839  8584 ts_tablet_manager.cc:1434] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:01:19.278739  8584 tablet_bootstrap.cc:492] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:19.288112  8584 tablet_bootstrap.cc:654] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.303598  8585 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:19.304112  8585 ts_tablet_manager.cc:1403] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.002s
I20260709 13:01:19.305627  8792 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.310549  8586 tablet_bootstrap.cc:492] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.311028  8586 ts_tablet_manager.cc:1403] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.014s
I20260709 13:01:19.309352  8585 raft_consensus.cc:359] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.313337  8585 raft_consensus.cc:385] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.313736  8585 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.314033  8586 raft_consensus.cc:359] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.314707  8586 raft_consensus.cc:385] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.314951  8592 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.315606  8592 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.315055  8586 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.317449  8586 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.317814  8592 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.318894  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.319556  8392 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:19.320052  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.320559  8697 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.319556  8586 ts_tablet_manager.cc:1434] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:01:19.323114  8433 leader_election.cc:343] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.323776  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:19.325230  8586 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:19.326346  8649 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.326787  8649 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.327164  8649 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.314575  8585 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.332260  8586 tablet_bootstrap.cc:654] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.338506  8585 ts_tablet_manager.cc:1434] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:01:19.339253  8586 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.339432  8585 tablet_bootstrap.cc:492] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:19.339812  8586 ts_tablet_manager.cc:1403] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:01:19.341861  8666 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.345873  8586 raft_consensus.cc:359] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.346935  8586 raft_consensus.cc:385] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.347280  8586 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.347968  8586 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.350191  8586 ts_tablet_manager.cc:1434] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:19.351140  8586 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:19.357039  8586 tablet_bootstrap.cc:654] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.362640  8585 tablet_bootstrap.cc:654] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.363665  8584 tablet_bootstrap.cc:492] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:19.364166  8584 ts_tablet_manager.cc:1403] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.004s
W20260709 13:01:19.367865  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:19.384779  8584 raft_consensus.cc:359] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.385835  8584 raft_consensus.cc:385] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.386147  8584 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.387998  8584 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.390575  8584 ts_tablet_manager.cc:1434] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:01:19.391623  8584 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:19.401265  8592 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.401867  8592 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.402617  8649 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.404224  8592 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.404716  8649 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.408890  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.410516  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:19.412106  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:19.412724  8395 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:19.423118  8433 leader_election.cc:343] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.444856  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.452111  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:19.453716  8592 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.459546  8584 tablet_bootstrap.cc:654] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.461985  8585 tablet_bootstrap.cc:492] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:19.462474  8585 ts_tablet_manager.cc:1403] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.123s	user 0.033s	sys 0.047s
I20260709 13:01:19.464959  8585 raft_consensus.cc:359] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.465615  8585 raft_consensus.cc:385] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.465915  8585 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.466681  8585 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.452523  8395 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:19.469949  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:19.471148  8585 ts_tablet_manager.cc:1434] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:19.471872  8649 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.471894  8792 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:19.472523  8649 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:19.473393  8649 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.476042  8586 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.476567  8586 ts_tablet_manager.cc:1403] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.055s
I20260709 13:01:19.477748  8792 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.478289  8792 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.479591  8789 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.480765  8792 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.480943  8584 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:19.481606  8584 ts_tablet_manager.cc:1403] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.006s
I20260709 13:01:19.481863  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.482460  8466 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:19.482383  8586 raft_consensus.cc:359] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.483135  8586 raft_consensus.cc:385] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.483421  8586 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.483558  8359 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.484369  8792 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.484722  8792 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.484627  8584 raft_consensus.cc:359] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.485231  8792 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.486582  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.487213  8543 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:19.486907  8586 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.490248  8586 ts_tablet_manager.cc:1434] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:01:19.491485  8586 tablet_bootstrap.cc:492] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:19.493661  8789 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.494241  8789 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.496006  8584 raft_consensus.cc:385] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.496332  8584 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.497079  8584 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.498329  8585 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:19.498996  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.500082  8466 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:19.501230  8789 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.502388  8792 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.503079  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.505867  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:19.506454  8466 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.504943  8792 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.509150  8792 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.509568  8792 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.511521  8792 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.512965  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.513672  8544 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:19.514608  8586 tablet_bootstrap.cc:654] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.517453  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:19.518077  8544 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.525660  8585 tablet_bootstrap.cc:654] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.538610  8859 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:19.540512  8792 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.550146  8859 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.550733  8859 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.550585  8289 catalog_manager.cc:5697] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.553354  8792 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.554893  8585 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:19.555475  8585 ts_tablet_manager.cc:1403] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.005s
I20260709 13:01:19.557819  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:19.558950  8467 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.562156  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.562989  8469 raft_consensus.cc:2393] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:19.557947  8789 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:19.561932  8585 raft_consensus.cc:359] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.552820  8859 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.568272  8585 raft_consensus.cc:385] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.568831  8585 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.569892  8585 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.572088  8585 ts_tablet_manager.cc:1434] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:01:19.572407  8466 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:19.573302  8798 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.573613  8585 tablet_bootstrap.cc:492] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:19.574003  8798 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.576232  8798 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.581291  8467 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:19.583355  8585 tablet_bootstrap.cc:654] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.587203  8359 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.589344  8789 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.590139  8789 raft_consensus.cc:697] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:19.591475  8789 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.587459  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.594213  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.602620  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.603493  8625 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:19.604216  8625 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:19.605665  8625 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.577404  8544 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:19.618693  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.648736  8584 ts_tablet_manager.cc:1434] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.167s	user 0.029s	sys 0.026s
I20260709 13:01:19.650328  8584 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:19.688356  8584 tablet_bootstrap.cc:654] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.689638  8815 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.691208  8433 leader_election.cc:343] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.693488  8358 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:19.694032  8798 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.695597  8798 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.698585  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:19.701470  8542 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.694006  8815 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.704636  8815 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:19.698769  8666 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:01:19.711458  8592 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.720057  8798 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.720443  8586 tablet_bootstrap.cc:492] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:19.720918  8586 ts_tablet_manager.cc:1403] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.230s	user 0.017s	sys 0.026s
I20260709 13:01:19.698989  8858 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.708454  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.726509  8815 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:19.730129  8585 tablet_bootstrap.cc:492] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:19.730799  8585 ts_tablet_manager.cc:1403] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.157s	user 0.019s	sys 0.022s
I20260709 13:01:19.735544  8586 raft_consensus.cc:359] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.736506  8586 raft_consensus.cc:385] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.712195  8592 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.736846  8586 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.737751  8586 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.744320  8586 ts_tablet_manager.cc:1434] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.004s
I20260709 13:01:19.745234  8586 tablet_bootstrap.cc:492] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:19.785890  8789 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.791366  8789 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:19.786159  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 89448.3us
I20260709 13:01:19.784385  8584 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:19.803632  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.805433  8395 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:19.800732  8584 ts_tablet_manager.cc:1403] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.032s
I20260709 13:01:19.746912  8592 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:19.800060  8433 leader_election.cc:343] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.816387  8789 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.817066  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:19.818397  8649 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.813027  8585 raft_consensus.cc:359] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.825534  8585 raft_consensus.cc:385] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.838804  8585 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.842204  8584 raft_consensus.cc:359] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.843235  8584 raft_consensus.cc:385] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:19.846146  8584 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:19.850658  8584 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.854090  8584 ts_tablet_manager.cc:1434] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.006s
I20260709 13:01:19.876626  8585 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.881062  8585 ts_tablet_manager.cc:1434] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.150s	user 0.005s	sys 0.007s
I20260709 13:01:19.897301  8858 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:19.884153  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.885200  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.887877  8649 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.898304  8391 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:19.898557  8649 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.899758  8585 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:19.901163  8649 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.891768  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.893564  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.889756  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:19.902268  8544 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:19.902515  8541 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:19.896646  8789 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:01:19.905153  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:19.906175  8871 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.910321  8697 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:19.912397  8815 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:19.913023  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:19.913664  8469 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
W20260709 13:01:19.915563  8358 leader_election.cc:343] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.916752  8466 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.931789  8584 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
W20260709 13:01:19.935370  8433 leader_election.cc:343] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:19.936451  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:19.937601  8649 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.938102  8649 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.938556  8649 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.945149  8789 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:19.948547  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:19.949177  8395 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:19.950335  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:19.951400  8789 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:19.951763  8789 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.952168  8789 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:19.954516  8585 tablet_bootstrap.cc:654] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:19.956816  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:19.964908  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55129.3us
I20260709 13:01:19.941490  8289 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.984766  8789 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.992110  8542 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:19.994338  8789 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:19.997408  8649 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:19.998811  8289 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.005039  8649 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.014607  8586 tablet_bootstrap.cc:654] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.046025  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:20.047667  8867 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.048281  8867 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.051545  8867 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.053156  8871 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:20.057900  8433 leader_election.cc:343] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.059365  8649 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.059716  8649 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.059976  8649 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.063201  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:20.080446  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:20.081110  8470 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.086383  8586 tablet_bootstrap.cc:492] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:20.092944  8586 ts_tablet_manager.cc:1403] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.348s	user 0.022s	sys 0.006s
I20260709 13:01:20.095834  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:20.096199  8586 raft_consensus.cc:359] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.096603  8391 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.096889  8586 raft_consensus.cc:385] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.097160  8584 tablet_bootstrap.cc:654] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.097259  8586 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.098330  8649 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.102304  8859 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.102689  8585 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:20.103164  8585 ts_tablet_manager.cc:1403] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.205s	user 0.023s	sys 0.006s
I20260709 13:01:20.105515  8649 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.106419  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:20.106454  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:20.112690  8592 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.113056  8585 raft_consensus.cc:359] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.113727  8585 raft_consensus.cc:385] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.114020  8585 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.115202  8586 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:20.118209  8358 leader_election.cc:343] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.119846  8586 ts_tablet_manager.cc:1434] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:01:20.121004  8586 tablet_bootstrap.cc:492] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:20.123769  8859 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.126621  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:20.124485  8585 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.127292  8542 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.126260  8470 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:20.131313  8585 ts_tablet_manager.cc:1434] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:01:20.131840  8586 tablet_bootstrap.cc:654] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.133671  8867 raft_consensus.cc:2764] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:01:20.134423  8585 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:20.147990  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:20.150326  8585 tablet_bootstrap.cc:654] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.151885  8584 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:20.153548  8584 ts_tablet_manager.cc:1403] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.232s	user 0.008s	sys 0.017s
I20260709 13:01:20.156283  8391 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:20.160601  8542 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:20.161974  8584 raft_consensus.cc:359] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.164269  8584 raft_consensus.cc:385] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.166455  8584 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
W20260709 13:01:20.167479  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55325.9us
I20260709 13:01:20.167826  8585 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:20.168303  8585 ts_tablet_manager.cc:1403] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
W20260709 13:01:20.168722  8433 leader_election.cc:343] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.170094  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:20.171175  8592 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.171715  8592 raft_consensus.cc:697] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:20.172609  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:20.172710  8592 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.174401  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:20.174711  8585 raft_consensus.cc:359] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.175343  8585 raft_consensus.cc:385] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.175611  8585 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.176474  8855 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.177033  8855 raft_consensus.cc:697] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:20.178089  8855 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:20.179117  8433 leader_election.cc:343] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.179526  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:20.180226  8867 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.183295  8867 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.185931  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:20.186579  8543 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.203015  8585 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.169190  8584 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.205950  8585 ts_tablet_manager.cc:1434] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:01:20.206301  8543 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:20.207079  8585 tablet_bootstrap.cc:492] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:20.208103  8584 ts_tablet_manager.cc:1434] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.003s
I20260709 13:01:20.211102  8592 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.211702  8592 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.213694  8592 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.210783  8584 tablet_bootstrap.cc:492] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:20.214495  8585 tablet_bootstrap.cc:654] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:20.218508  8433 leader_election.cc:343] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.218606  8854 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.226667  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:20.227403  8649 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.227865  8649 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:20.228665  8649 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.231273  8585 tablet_bootstrap.cc:492] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:20.231710  8585 ts_tablet_manager.cc:1403] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.003s
I20260709 13:01:20.234249  8585 raft_consensus.cc:359] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.234855  8585 raft_consensus.cc:385] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.235127  8585 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.235682  8855 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.235987  8585 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.237586  8585 ts_tablet_manager.cc:1434] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:01:20.239590  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:20.242386  8871 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.243005  8871 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.245965  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:20.246654  8392 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:20.246495  8871 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.247675  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:20.248070  8507 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:20.242463  8433 leader_election.cc:343] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.249094  8815 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.249297  8469 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:20.249507  8815 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.238674  8585 tablet_bootstrap.cc:492] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:20.250420  8815 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.258208  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:20.279976  8815 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:20.286828  8433 leader_election.cc:343] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.287279  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:20.287976  8592 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:20.286448  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 69871.9us
I20260709 13:01:20.298820  8815 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.305442  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:20.306066  8469 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.308208  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:20.307717  8290 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.308805  8391 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.311159  8586 tablet_bootstrap.cc:492] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:20.311626  8586 ts_tablet_manager.cc:1403] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.191s	user 0.015s	sys 0.019s
I20260709 13:01:20.316011  8585 tablet_bootstrap.cc:654] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.318128  8469 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:20.320040  8508 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:20.323726  8584 tablet_bootstrap.cc:654] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.324098  8695 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.324613  8695 raft_consensus.cc:697] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:20.326045  8695 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.328063  8391 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:20.333330  8586 raft_consensus.cc:359] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.334832  8586 raft_consensus.cc:385] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.335039  8586 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.335561  8586 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.341543  8586 ts_tablet_manager.cc:1434] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 13:01:20.342658  8586 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:20.346995  8289 catalog_manager.cc:5697] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.363422  8288 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.365728  8585 tablet_bootstrap.cc:492] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:20.366237  8585 ts_tablet_manager.cc:1403] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.000s
I20260709 13:01:20.367110  8586 tablet_bootstrap.cc:654] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.367515  8584 tablet_bootstrap.cc:492] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:20.367940  8584 ts_tablet_manager.cc:1403] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.157s	user 0.016s	sys 0.001s
I20260709 13:01:20.368763  8585 raft_consensus.cc:359] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.369400  8585 raft_consensus.cc:385] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.369658  8585 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.370563  8585 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.373009  8585 ts_tablet_manager.cc:1434] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:01:20.373987  8585 tablet_bootstrap.cc:492] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:20.384020  8584 raft_consensus.cc:359] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.384758  8584 raft_consensus.cc:385] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.385021  8584 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.385628  8584 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.387749  8584 ts_tablet_manager.cc:1434] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:01:20.388554  8592 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.388989  8592 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.390777  8592 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.391428  8290 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.394146  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:20.395114  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:20.395491  8433 leader_election.cc:343] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:20.397516  8433 leader_election.cc:343] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.399353  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:20.399847  8584 tablet_bootstrap.cc:492] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:20.400957  8867 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.404932  8585 tablet_bootstrap.cc:654] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.406437  8584 tablet_bootstrap.cc:654] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.420825  8584 tablet_bootstrap.cc:492] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:20.421267  8584 ts_tablet_manager.cc:1403] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 13:01:20.423825  8584 raft_consensus.cc:359] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.424700  8584 raft_consensus.cc:385] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.425024  8584 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.433665  8584 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.437954  8584 ts_tablet_manager.cc:1434] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:01:20.438910  8584 tablet_bootstrap.cc:492] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:20.443523  8586 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:20.443969  8586 ts_tablet_manager.cc:1403] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.027s
I20260709 13:01:20.446691  8586 raft_consensus.cc:359] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.447341  8586 raft_consensus.cc:385] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.447602  8586 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.455673  8586 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:20.457636  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:20.457930  8586 ts_tablet_manager.cc:1434] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:01:20.458891  8584 tablet_bootstrap.cc:654] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.458928  8586 tablet_bootstrap.cc:492] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:20.462208  8585 tablet_bootstrap.cc:492] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:20.464371  8585 ts_tablet_manager.cc:1403] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.017s
I20260709 13:01:20.466951  8586 tablet_bootstrap.cc:654] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.470227  8695 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.470413  8584 tablet_bootstrap.cc:492] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:20.470839  8584 ts_tablet_manager.cc:1403] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.007s
I20260709 13:01:20.470707  8695 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.473827  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:20.473532  8584 raft_consensus.cc:359] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.474330  8584 raft_consensus.cc:385] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.474399  8466 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:20.474663  8584 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.475363  8584 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.475862  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:20.476646  8871 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.476979  8871 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.477298  8871 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.477460  8695 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.477638  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:20.468063  8585 raft_consensus.cc:359] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.478252  8585 raft_consensus.cc:385] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.478542  8585 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.484234  8871 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.486820  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:20.488519  8871 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.489138  8391 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:20.489737  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:20.490252  8466 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.492779  8815 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.493234  8815 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.495180  8815 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.496380  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:20.496568  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:20.497025  8391 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:20.497149  8469 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:20.497047  8466 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:20.498311  8507 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:20.479310  8585 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.499044  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:20.499171  8815 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.500063  8815 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.500172  8585 ts_tablet_manager.cc:1434] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.004s
I20260709 13:01:20.500417  8815 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.500604  8584 ts_tablet_manager.cc:1434] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:01:20.501081  8585 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:20.501610  8584 tablet_bootstrap.cc:492] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:20.506043  8695 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.506656  8695 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:20.507336  8584 tablet_bootstrap.cc:654] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.507431  8585 tablet_bootstrap.cc:654] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.507532  8695 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.515152  8586 tablet_bootstrap.cc:492] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:20.515619  8586 ts_tablet_manager.cc:1403] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.013s
I20260709 13:01:20.515565  8815 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.519289  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:20.519841  8391 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.521603  8584 tablet_bootstrap.cc:492] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:20.522207  8584 ts_tablet_manager.cc:1403] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:01:20.524837  8872 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.525313  8872 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.539253  8872 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.540340  8584 raft_consensus.cc:359] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.541339  8584 raft_consensus.cc:385] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.541628  8586 raft_consensus.cc:359] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.542362  8586 raft_consensus.cc:385] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.542614  8586 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.550169  8391 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:20.550222  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:20.541706  8584 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.553143  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:20.553488  8507 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:20.553725  8466 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:20.555326  8695 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.555842  8695 raft_consensus.cc:697] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:20.553817  8584 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.556196  8508 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:20.557649  8695 consensus_queue.cc:237] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.558763  8910 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.559170  8910 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.559517  8910 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.560312  8815 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.558197  8392 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:20.563941  8585 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:20.547976  8586 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.564150  8789 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.564404  8585 ts_tablet_manager.cc:1403] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.027s
I20260709 13:01:20.564591  8789 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.565435  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:20.565981  8469 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.566864  8789 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.569020  8584 ts_tablet_manager.cc:1434] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:01:20.569991  8584 tablet_bootstrap.cc:492] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:20.571462  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:20.571487  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:20.572425  8541 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:20.574105  8358 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:20.575229  8789 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.579221  8585 raft_consensus.cc:359] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.579918  8585 raft_consensus.cc:385] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.580186  8585 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.581024  8585 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.581334  8290 catalog_manager.cc:5697] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.582511  8585 ts_tablet_manager.cc:1434] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:01:20.583487  8585 tablet_bootstrap.cc:492] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:20.587536  8469 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:20.589293  8584 tablet_bootstrap.cc:654] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.593142  8789 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.593995  8585 tablet_bootstrap.cc:654] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.599902  8910 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.603796  8584 tablet_bootstrap.cc:492] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:20.604327  8584 ts_tablet_manager.cc:1403] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:01:20.606177  8592 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.606803  8592 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.607268  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:20.607152  8584 raft_consensus.cc:359] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.607836  8584 raft_consensus.cc:385] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.607859  8392 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.608177  8584 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.609175  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:20.609807  8469 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.609205  8584 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.616369  8541 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.616627  8592 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.626340  8586 ts_tablet_manager.cc:1434] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.000s
I20260709 13:01:20.627502  8586 tablet_bootstrap.cc:492] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:20.628098  8892 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.629053  8910 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.617218  8584 ts_tablet_manager.cc:1434] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:01:20.622304  8469 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:20.623509  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:20.633003  8584 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:20.633041  8508 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:20.635350  8815 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.635834  8392 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:20.623683  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:20.633688  8391 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
W20260709 13:01:20.639812  8433 leader_election.cc:343] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.635854  8815 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:20.642287  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:20.642547  8815 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.643085  8592 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.644091  8592 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.644465  8592 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.646471  8584 tablet_bootstrap.cc:654] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.646070  8586 tablet_bootstrap.cc:654] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.656232  8592 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.674365  8592 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.678740  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:20.680420  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:20.681383  8393 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.686005  8877 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.703507  8585 tablet_bootstrap.cc:492] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:20.704021  8585 ts_tablet_manager.cc:1403] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.016s
I20260709 13:01:20.708518  8584 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:20.709089  8584 ts_tablet_manager.cc:1403] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.017s
I20260709 13:01:20.712174  8584 raft_consensus.cc:359] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:20.708057  8433 leader_election.cc:343] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.712934  8584 raft_consensus.cc:385] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.713371  8584 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.716470  8584 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.719399  8585 raft_consensus.cc:359] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.720075  8585 raft_consensus.cc:385] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.720307  8585 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.720356  8789 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.720949  8585 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.720674  8289 catalog_manager.cc:5697] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.724882  8586 tablet_bootstrap.cc:492] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:20.725332  8586 ts_tablet_manager.cc:1403] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.002s
I20260709 13:01:20.731235  8393 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:20.732157  8585 ts_tablet_manager.cc:1434] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 13:01:20.733091  8586 raft_consensus.cc:359] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.735591  8586 raft_consensus.cc:385] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.735942  8586 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.737182  8586 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.743287  8584 ts_tablet_manager.cc:1434] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:01:20.744984  8584 tablet_bootstrap.cc:492] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:20.748951  8585 tablet_bootstrap.cc:492] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:20.750468  8586 ts_tablet_manager.cc:1434] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:01:20.754277  8586 tablet_bootstrap.cc:492] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:20.722100  8867 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:01:20.757362  8815 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:20.769686  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:20.766782  8855 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.773568  8855 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.775722  8855 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.773301  8867 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.777335  8867 raft_consensus.cc:697] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:20.778355  8867 consensus_queue.cc:237] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.782941  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:20.783783  8466 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:20.788410  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:20.789110  8543 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:20.789175  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:20.793140  8859 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:20.794333  8584 tablet_bootstrap.cc:654] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.795267  8586 tablet_bootstrap.cc:654] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.793522  8859 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.799633  8859 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.811710  8288 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.798755  8877 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:01:20.806213  8695 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.820674  8695 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.832088  8695 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:20.834008  8859 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.837653  8871 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:01:20.845738  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:20.846661  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:20.841310  8877 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:01:20.849303  8507 leader_election.cc:343] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:20.853098  8508 leader_election.cc:343] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:20.853926  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:20.858266  8584 tablet_bootstrap.cc:492] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:20.858884  8584 ts_tablet_manager.cc:1403] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.007s
I20260709 13:01:20.859300  8815 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:20.873620  8859 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:20.874408  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:20.875924  8466 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.888573  8466 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:20.883273  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:20.911216  8288 catalog_manager.cc:5697] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.913570  8586 tablet_bootstrap.cc:492] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:20.914108  8586 ts_tablet_manager.cc:1403] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.163s	user 0.012s	sys 0.012s
I20260709 13:01:20.915729  8540 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.916627  8585 tablet_bootstrap.cc:654] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:20.914021  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:20.933236  8858 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:20.934652  8858 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:20.941464  8871 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:20.932598  8584 raft_consensus.cc:359] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.950017  8858 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.950856  8584 raft_consensus.cc:385] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.951670  8584 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.954855  8586 raft_consensus.cc:359] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.955757  8586 raft_consensus.cc:385] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:20.956097  8586 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:20.952589  8584 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.966619  8586 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:20.970542  8540 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:20.982277  8584 ts_tablet_manager.cc:1434] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.123s	user 0.006s	sys 0.004s
I20260709 13:01:20.986995  8586 ts_tablet_manager.cc:1434] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.002s
I20260709 13:01:20.994395  8394 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:20.999238  8586 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.019378  8585 tablet_bootstrap.cc:492] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.021078  8585 ts_tablet_manager.cc:1403] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.275s	user 0.017s	sys 0.005s
I20260709 13:01:21.026275  8584 tablet_bootstrap.cc:492] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:21.005861  8695 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:01:21.035908  8585 raft_consensus.cc:359] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.036620  8585 raft_consensus.cc:385] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.036888  8585 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.038992  8871 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.047755  8584 tablet_bootstrap.cc:654] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.050498  8586 tablet_bootstrap.cc:654] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.053613  8585 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.056102  8585 ts_tablet_manager.cc:1434] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.003s
I20260709 13:01:21.057067  8585 tablet_bootstrap.cc:492] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:21.060420  8871 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.060909  8871 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.063596  8871 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:21.065828  8585 tablet_bootstrap.cc:654] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.074010  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:21.074883  8470 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:21.076115  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.077215  8695 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.077574  8695 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.077945  8695 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.083613  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:21.091441  8507 leader_election.cc:343] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.095364  8585 tablet_bootstrap.cc:492] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.095834  8585 ts_tablet_manager.cc:1403] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 13:01:21.098814  8584 tablet_bootstrap.cc:492] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:21.099261  8584 ts_tablet_manager.cc:1403] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.006s
I20260709 13:01:21.101951  8584 raft_consensus.cc:359] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.102617  8584 raft_consensus.cc:385] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.102866  8584 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.104913  8584 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.107846  8584 ts_tablet_manager.cc:1434] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:01:21.110294  8585 raft_consensus.cc:359] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.111076  8585 raft_consensus.cc:385] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.111311  8585 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.111938  8585 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.108803  8584 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:21.122610  8859 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.123093  8859 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.125077  8859 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.126295  8586 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:21.126775  8586 ts_tablet_manager.cc:1403] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.007s
I20260709 13:01:21.126515  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:21.126597  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:21.127213  8585 ts_tablet_manager.cc:1434] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:01:21.127275  8470 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:21.127357  8540 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:21.128428  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.129310  8859 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.129657  8859 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.129998  8859 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.130400  8288 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.131930  8695 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.134351  8695 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:21.138185  8585 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:21.137733  8586 raft_consensus.cc:359] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.138517  8586 raft_consensus.cc:385] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.138798  8586 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.139123  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:21.139678  8393 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.139534  8586 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.141297  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:21.142390  8470 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.141597  8586 ts_tablet_manager.cc:1434] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:01:21.146824  8586 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.157819  8859 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.172274  8584 tablet_bootstrap.cc:654] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.172775  8470 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:21.174656  8859 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.171247  8586 tablet_bootstrap.cc:654] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.176419  8585 tablet_bootstrap.cc:654] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.177675  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:21.178432  8466 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.178891  8871 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.182343  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:21.186869  8466 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:21.187871  8585 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.196070  8584 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:21.177994  8393 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:21.196424  8585 ts_tablet_manager.cc:1403] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.068s	user 0.006s	sys 0.005s
I20260709 13:01:21.188647  8540 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.199201  8585 raft_consensus.cc:359] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.199841  8585 raft_consensus.cc:385] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.200239  8585 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.192708  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.200917  8585 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.203073  8695 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.210068  8695 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:21.210305  8584 ts_tablet_manager.cc:1403] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.001s
I20260709 13:01:21.211148  8695 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.213193  8584 raft_consensus.cc:359] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.213894  8584 raft_consensus.cc:385] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.189266  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.214170  8584 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.214933  8859 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.215116  8584 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.215611  8859 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:21.216617  8859 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.218395  8586 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:21.218850  8586 ts_tablet_manager.cc:1403] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.008s
I20260709 13:01:21.221372  8586 raft_consensus.cc:359] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.222038  8586 raft_consensus.cc:385] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.222286  8586 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.222908  8586 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.205432  8585 ts_tablet_manager.cc:1434] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:01:21.228864  8584 ts_tablet_manager.cc:1434] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:01:21.229907  8584 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:21.232882  8540 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:21.234225  8585 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:21.235605  8584 tablet_bootstrap.cc:654] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.239249  8586 ts_tablet_manager.cc:1434] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:01:21.240255  8586 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.248503  8871 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:21.261727  8586 tablet_bootstrap.cc:654] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.263193  8910 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.268358  8290 catalog_manager.cc:5697] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.284016  8910 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.285295  8910 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.288254  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:21.289157  8395 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:21.289199  8910 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:21.289390  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:21.290818  8508 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:21.291879  8910 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.292079  8289 catalog_manager.cc:5697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.299158  8925 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.299643  8925 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.301644  8925 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.303238  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:21.305263  8433 leader_election.cc:343] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.280323  8585 tablet_bootstrap.cc:654] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.307761  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:21.311398  8910 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:21.311635  8433 leader_election.cc:343] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.312036  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:21.312722  8925 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:21.315222  8584 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:21.316198  8584 ts_tablet_manager.cc:1403] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.006s
I20260709 13:01:21.321285  8586 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:21.321983  8586 ts_tablet_manager.cc:1403] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.022s
I20260709 13:01:21.328526  8586 raft_consensus.cc:359] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.328881  8584 raft_consensus.cc:359] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.329212  8586 raft_consensus.cc:385] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.329815  8585 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.329815  8584 raft_consensus.cc:385] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.330031  8586 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.330327  8584 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.330454  8585 ts_tablet_manager.cc:1403] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.000s
I20260709 13:01:21.330847  8586 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.332878  8586 ts_tablet_manager.cc:1434] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:01:21.332875  8585 raft_consensus.cc:359] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.333644  8585 raft_consensus.cc:385] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.333936  8585 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.334353  8586 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.334609  8585 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.336688  8585 ts_tablet_manager.cc:1434] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:21.338616  8585 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:21.342170  8586 tablet_bootstrap.cc:654] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.344453  8585 tablet_bootstrap.cc:654] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.348979  8867 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.331265  8584 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.394006  8584 ts_tablet_manager.cc:1434] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.004s
I20260709 13:01:21.393455  8867 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:21.402582  8584 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:21.411872  8584 tablet_bootstrap.cc:654] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.416383  8586 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:21.417657  8586 ts_tablet_manager.cc:1403] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.003s
I20260709 13:01:21.421247  8586 raft_consensus.cc:359] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.422211  8586 raft_consensus.cc:385] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.422631  8586 raft_consensus.cc:740] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.423496  8586 consensus_queue.cc:260] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.427532  8585 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.427999  8585 ts_tablet_manager.cc:1403] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.032s
I20260709 13:01:21.428586  8586 ts_tablet_manager.cc:1434] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:21.429746  8586 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.430526  8585 raft_consensus.cc:359] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.431190  8585 raft_consensus.cc:385] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.431437  8585 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.432075  8585 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.434648  8585 ts_tablet_manager.cc:1434] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:21.435590  8585 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:21.441030  8585 tablet_bootstrap.cc:654] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.443252  8586 tablet_bootstrap.cc:654] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.450516  8584 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:21.450968  8584 ts_tablet_manager.cc:1403] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.009s
I20260709 13:01:21.454367  8586 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:21.453675  8584 raft_consensus.cc:359] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.455421  8584 raft_consensus.cc:385] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.455341  8586 ts_tablet_manager.cc:1403] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.001s
I20260709 13:01:21.455745  8584 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.457558  8584 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.458951  8586 raft_consensus.cc:359] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.459546  8584 ts_tablet_manager.cc:1434] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:21.459690  8586 raft_consensus.cc:385] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.460011  8586 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.461270  8585 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.461091  8586 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.461719  8585 ts_tablet_manager.cc:1403] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.005s
I20260709 13:01:21.463284  8586 ts_tablet_manager.cc:1434] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:21.465365  8586 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.465890  8584 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:21.472597  8586 tablet_bootstrap.cc:654] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.482661  8584 tablet_bootstrap.cc:654] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.464771  8585 raft_consensus.cc:359] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.484133  8585 raft_consensus.cc:385] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.484442  8585 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.485693  8585 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.487830  8585 ts_tablet_manager.cc:1434] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:01:21.490588  8585 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:21.491879  8859 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.501194  8585 tablet_bootstrap.cc:654] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.555775  8871 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.556674  8584 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:21.557139  8584 ts_tablet_manager.cc:1403] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.020s
I20260709 13:01:21.559854  8584 raft_consensus.cc:359] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.560494  8584 raft_consensus.cc:385] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.560757  8584 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.556311  8871 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.563225  8586 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:21.563712  8586 ts_tablet_manager.cc:1403] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.099s	user 0.045s	sys 0.048s
I20260709 13:01:21.561448  8584 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.564036  8871 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:21.566536  8584 ts_tablet_manager.cc:1434] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:01:21.567091  8858 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.568040  8586 raft_consensus.cc:359] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.568697  8585 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.568774  8586 raft_consensus.cc:385] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.564447  8859 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.569625  8585 ts_tablet_manager.cc:1403] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.017s
I20260709 13:01:21.569178  8586 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.571573  8592 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.571357  8586 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.571996  8592 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.573644  8586 ts_tablet_manager.cc:1434] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.003s
I20260709 13:01:21.567559  8858 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.574134  8592 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.575863  8858 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.575598  8585 raft_consensus.cc:359] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.576292  8585 raft_consensus.cc:385] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.576545  8585 raft_consensus.cc:740] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.577210  8585 consensus_queue.cc:260] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.579139  8585 ts_tablet_manager.cc:1434] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:01:21.580116  8585 tablet_bootstrap.cc:492] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:21.581194  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:21.581908  8542 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:21.586148  8358 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:21.589876  8858 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.590404  8858 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.590831  8858 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:21.592453  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:21.596926  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:21.597558  8467 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:21.597594  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:21.598341  8470 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:21.599638  8508 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.600013  8586 tablet_bootstrap.cc:492] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.600384  8871 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.600788  8871 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.601154  8871 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.607844  8586 tablet_bootstrap.cc:654] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.611042  8592 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.611526  8592 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.613229  8592 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.617034  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:21.617767  8393 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:21.618840  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:21.619503  8391 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:21.620291  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:21.620915  8393 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:21.617128  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:21.623672  8540 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:21.624259  8584 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:21.634094  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:21.635221  8540 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:21.634352  8871 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.643684  8585 tablet_bootstrap.cc:654] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.649152  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:21.649775  8469 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.645296  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.653831  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.655719  8592 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.654620  8867 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.656075  8592 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.656180  8867 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.656724  8867 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.656493  8592 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.661496  8858 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.666195  8858 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.667104  8584 tablet_bootstrap.cc:654] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.656427  8469 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:21.671373  8508 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.671816  8586 tablet_bootstrap.cc:492] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:21.672104  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:21.672297  8586 ts_tablet_manager.cc:1403] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.011s
I20260709 13:01:21.672278  8910 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.672741  8470 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.672979  8910 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:21.673929  8910 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.679123  8586 raft_consensus.cc:359] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.680632  8586 raft_consensus.cc:385] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.681128  8586 raft_consensus.cc:740] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.681409  8871 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:21.683287  8867 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.663573  8592 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.684568  8586 consensus_queue.cc:260] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.686100  8586 ts_tablet_manager.cc:1434] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:01:21.686305  8592 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.687074  8586 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.688146  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:21.688318  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:21.688756  8391 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.688944  8542 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.690023  8867 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.692899  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:21.693475  8393 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.694293  8925 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.694585  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:21.694766  8925 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.695212  8541 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.696759  8925 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.698889  8584 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:21.701560  8584 ts_tablet_manager.cc:1403] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.003s
I20260709 13:01:21.700147  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:21.668274  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:21.701555  8695 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:21.700868  8393 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:21.702677  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:21.704649  8391 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:21.707825  8540 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.711560  8541 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:21.713244  8586 tablet_bootstrap.cc:654] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.715741  8584 raft_consensus.cc:359] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.716657  8584 raft_consensus.cc:385] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.717012  8584 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
W20260709 13:01:21.718884  8433 leader_election.cc:343] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.719509  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.684123  8470 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:21.721671  8592 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.722333  8592 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:21.723305  8592 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.732283  8542 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:21.737601  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:21.748277  8391 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.741058  8871 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.752626  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.753383  8867 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.753590  8359 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.753989  8867 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:21.754441  8854 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.754915  8854 raft_consensus.cc:697] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:21.754976  8867 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.755729  8854 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.755739  8289 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.756480  8391 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:21.747188  8858 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.758279  8910 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.758841  8910 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.762971  8585 tablet_bootstrap.cc:492] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.764744  8910 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:21.767105  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:21.768044  8470 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:21.769639  8585 ts_tablet_manager.cc:1403] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.190s	user 0.008s	sys 0.004s
I20260709 13:01:21.769604  8508 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:21.771555  8433 leader_election.cc:343] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.772367  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:21.774910  8910 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.775339  8910 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.775713  8910 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.775835  8585 raft_consensus.cc:359] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.776674  8585 raft_consensus.cc:385] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.777071  8585 raft_consensus.cc:740] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.778498  8585 consensus_queue.cc:260] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.780061  8584 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.783138  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:21.789947  8585 ts_tablet_manager.cc:1434] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:01:21.794054  8584 ts_tablet_manager.cc:1434] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:01:21.795079  8584 tablet_bootstrap.cc:492] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
W20260709 13:01:21.796689  8507 leader_election.cc:343] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.781158  8925 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:21.801928  8540 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:21.805043  8293 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.813143  8585 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:21.815752  8910 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.860320  8854 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.860868  8854 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.862553  8910 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:21.864226  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:21.864880  8470 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:21.885393  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 69339.6us
W20260709 13:01:21.886435  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 76958.5us
I20260709 13:01:21.894249  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:21.894124  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:21.894937  8469 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
W20260709 13:01:21.898250  8507 leader_election.cc:343] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:21.898698  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:21.915004  8973 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:21.911180  8293 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.915477  8973 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.921006  8973 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:21.921128  8293 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.923296  8586 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:21.923834  8586 ts_tablet_manager.cc:1403] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.237s	user 0.041s	sys 0.044s
I20260709 13:01:21.928475  8854 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:21.929459  8969 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:01:21.936393  8585 tablet_bootstrap.cc:654] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.936681  8584 tablet_bootstrap.cc:654] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:21.948004  8586 raft_consensus.cc:359] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.948794  8586 raft_consensus.cc:385] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.949098  8586 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.950223  8586 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.953056  8855 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:21.957998  8470 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:21.968103  8586 ts_tablet_manager.cc:1434] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 13:01:21.969343  8508 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:21.969550  8586 tablet_bootstrap.cc:492] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Bootstrap starting.
I20260709 13:01:21.974606  8585 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:21.975208  8585 ts_tablet_manager.cc:1403] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.164s	user 0.013s	sys 0.000s
I20260709 13:01:21.976717  8979 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:21.978300  8979 raft_consensus.cc:697] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:21.979434  8979 consensus_queue.cc:237] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.984067  8585 raft_consensus.cc:359] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.984959  8585 raft_consensus.cc:385] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:21.985283  8585 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:21.987325  8973 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:21.996061  8584 tablet_bootstrap.cc:492] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:21.996269  8973 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:21.996564  8584 ts_tablet_manager.cc:1403] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.202s	user 0.012s	sys 0.010s
I20260709 13:01:22.000557  8586 tablet_bootstrap.cc:654] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.000485  8584 raft_consensus.cc:359] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.001304  8584 raft_consensus.cc:385] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.001691  8584 raft_consensus.cc:740] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.002091  8585 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.002439  8584 consensus_queue.cc:260] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.004393  8585 ts_tablet_manager.cc:1434] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:01:22.004746  8584 ts_tablet_manager.cc:1434] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:22.005405  8585 tablet_bootstrap.cc:492] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:22.005820  8584 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:22.019412  8584 tablet_bootstrap.cc:654] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.030674  8585 tablet_bootstrap.cc:654] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.038021  8586 tablet_bootstrap.cc:492] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: No bootstrap required, opened a new log
I20260709 13:01:22.038506  8586 ts_tablet_manager.cc:1403] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 13:01:22.040338  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:22.041079  8466 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.045168  8586 raft_consensus.cc:359] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.048185  8586 raft_consensus.cc:385] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.048537  8586 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.049320  8586 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:22.053923  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 134913us
I20260709 13:01:22.092016  8695 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.092717  8695 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.120808  8293 catalog_manager.cc:5697] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.122879  8466 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:22.133881  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:22.135646  8586 ts_tablet_manager.cc:1434] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent starting tablet: real 0.097s	user 0.015s	sys 0.004s
I20260709 13:01:22.140175  8858 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:22.140724  8858 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:22.141544  8858 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.177987  8695 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:22.161461  8910 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.181027  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:22.182785  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:22.190215  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:22.190832  8393 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:22.192188  8467 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 0.
I20260709 13:01:22.192138  8980 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:22.192561  8584 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:22.201066  8584 ts_tablet_manager.cc:1403] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.196s	user 0.022s	sys 0.010s
I20260709 13:01:22.202131  8508 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:22.202852  8695 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:22.203222  8695 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.203539  8695 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.204173  8584 raft_consensus.cc:359] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.205013  8584 raft_consensus.cc:385] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.205302  8584 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.209164  8585 tablet_bootstrap.cc:492] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:22.209628  8585 ts_tablet_manager.cc:1403] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.204s	user 0.026s	sys 0.025s
I20260709 13:01:22.210729  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:22.212769  8584 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.218364  8977 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.220618  8977 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.184785  8910 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.233340  8584 ts_tablet_manager.cc:1434] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:01:22.234323  8584 tablet_bootstrap.cc:492] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:22.236646  8541 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:22.237185  8977 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:22.241317  8585 raft_consensus.cc:359] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.243358  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:22.247718  8910 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:22.249217  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:22.250083  8470 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 1: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:22.241987  8585 raft_consensus.cc:385] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.254247  8585 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
W20260709 13:01:22.254451  8433 leader_election.cc:343] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.257848  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:22.255556  8585 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.261114  8507 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:22.262307  8289 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.263913  8695 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.266150  8979 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.267226  8695 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:22.268760  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:22.269402  8395 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.272416  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:22.273146  8470 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.290983  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:22.291707  8543 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:22.298143  8974 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:22.308331  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:22.310487  8395 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:22.314189  8988 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:01:22.317736  8977 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:22.318156  8977 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.319270  8585 ts_tablet_manager.cc:1434] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.000s
I20260709 13:01:22.317394  8507 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:22.318533  8977 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.286659  8979 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.321991  8983 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.329541  8983 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.329156  8470 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:22.325452  8872 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:22.340098  8585 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: Bootstrap starting.
I20260709 13:01:22.344609  8872 raft_consensus.cc:697] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:22.345494  8872 consensus_queue.cc:237] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.346010  8592 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:22.323505  8973 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:01:22.353909  8983 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:22.366639  8592 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:22.364977  8978 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:22.370913  8977 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.372556  8584 tablet_bootstrap.cc:654] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.377200  8592 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.379792  8988 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:22.380044  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:22.382763  8977 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:22.382846  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:22.378350  8592 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.391937  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:22.393119  8433 leader_election.cc:343] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:22.399278  8358 leader_election.cc:343] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.422329  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:22.422665  8992 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:22.423123  8543 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.395408  8467 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 0.
I20260709 13:01:22.446130  8592 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:22.450609  8507 consensus_peers.cc:597] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.467849  8543 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:22.477614  8585 tablet_bootstrap.cc:654] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:22.489367  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:22.490626  8393 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 0.
I20260709 13:01:22.491204  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:22.508893  8925 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:22.511750  8925 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:22.512619  8925 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.514317  8991 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:22.522140  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:22.525187  8584 tablet_bootstrap.cc:492] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:22.525507  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:22.527408  8584 ts_tablet_manager.cc:1403] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.293s	user 0.015s	sys 0.000s
I20260709 13:01:22.527900  8592 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:22.530265  8592 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.530658  8592 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.536895  8288 catalog_manager.cc:5697] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 0 to 1, leader changed from <none> to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.554206  8592 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.556190  8592 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:22.537497  8433 leader_election.cc:343] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:22.591239  8993 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.142s	user 0.005s	sys 0.000s
W20260709 13:01:22.593036  8999 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:22.595399  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:22.596524  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:22.599470  8392 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.597645  8585 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: No bootstrap required, opened a new log
I20260709 13:01:22.603564  8585 ts_tablet_manager.cc:1403] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: Time spent bootstrapping tablet: real 0.264s	user 0.036s	sys 0.032s
I20260709 13:01:22.603494  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:22.608464  8392 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:22.609875  8858 raft_consensus.cc:2764] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:01:22.616331  8584 raft_consensus.cc:359] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.617137  8584 raft_consensus.cc:385] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.617412  8584 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.625955  8584 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.631510  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:22.632429  8592 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:22.632880  8592 raft_consensus.cc:697] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:22.633642  8592 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:22.639554  8433 leader_election.cc:343] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:22.654861  8584 ts_tablet_manager.cc:1434] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.000s
I20260709 13:01:22.653842  8585 raft_consensus.cc:359] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.655675  8585 raft_consensus.cc:385] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.655965  8585 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.657465  8585 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.662907  8585 ts_tablet_manager.cc:1434] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:01:22.657845  8859 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:01:22.664259  8855 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.664746  8855 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:22.691562  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 53420.7us
I20260709 13:01:22.723119  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:22.727411  8855 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:22.729650  8584 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: Bootstrap starting.
I20260709 13:01:22.760195  8584 tablet_bootstrap.cc:654] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:22.767611  8570 tablet.cc:2406] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:22.775183  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:22.811348  8544 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:22.769076  8815 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:01:22.815114  8358 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:22.816438  8973 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:22.798974  8341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:22.793247  8974 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:01:22.827247  8973 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.827924  8871 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.828411  8871 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.831147  8871 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:22.826766  8289 catalog_manager.cc:5697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.833483  8289 catalog_manager.cc:5697] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.839169  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:22.842470  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:22.843159  8390 raft_consensus.cc:2393] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 1: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:22.858467  8507 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:22.844187  8871 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:22.862221  8991 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:22.881770  8991 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:22.928195  8584 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: No bootstrap required, opened a new log
I20260709 13:01:22.932742  8584 ts_tablet_manager.cc:1403] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent bootstrapping tablet: real 0.203s	user 0.023s	sys 0.007s
I20260709 13:01:22.938421  8584 raft_consensus.cc:359] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.949296  8584 raft_consensus.cc:385] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:22.955039  8584 raft_consensus.cc:740] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Initialized, Role: FOLLOWER
I20260709 13:01:22.955932  8584 consensus_queue.cc:260] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:22.958187  8584 ts_tablet_manager.cc:1434] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:01:23.005352  8877 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:23.015367  8973 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.015874  8973 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:23.018496  8973 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:23.023800  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:23.024763  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:23.036670  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:23.037940  8973 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:23.042722  9008 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:23.214236  8877 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:23.224828  8877 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:23.357530  8392 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:23.794129  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:23.836045  9023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:23.836905  9024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:23.838845  9026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:23.839740  7283 server_base.cc:1061] running on GCE node
I20260709 13:01:23.841292  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:23.841572  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:23.841876  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602083841853 us; error 0 us; skew 500 ppm
I20260709 13:01:23.842664  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:23.846158  7283 webserver.cc:533] Webserver started at http://127.7.28.196:38197/ using document root <none> and password file <none>
I20260709 13:01:23.846717  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:23.846963  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:23.847311  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:23.848580  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-3-root/instance:
uuid: "92314b14f5554885a80c3dc87f4beed4"
format_stamp: "Formatted at 2026-07-09 13:01:23 on dist-test-slave-ll1f"
I20260709 13:01:23.854740  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.006s
I20260709 13:01:23.859028  9031 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:23.860294  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:01:23.860775  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-3-root
uuid: "92314b14f5554885a80c3dc87f4beed4"
format_stamp: "Formatted at 2026-07-09 13:01:23 on dist-test-slave-ll1f"
I20260709 13:01:23.861177  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:23.916026  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:23.917712  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:23.919719  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:23.922649  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:23.922891  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:23.923162  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:23.923362  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:24.021850  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.196:42855
I20260709 13:01:24.021970  9093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.196:42855 every 8 connection(s)
I20260709 13:01:24.034880  7283 auto_leader_rebalancer-test.cc:384] add a tserver: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:24.047340  9094 heartbeater.cc:344] Connected to a master server at 127.7.28.254:35733
I20260709 13:01:24.047784  9094 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:24.048619  9094 heartbeater.cc:507] Master 127.7.28.254:35733 requested a full tablet report, sending...
I20260709 13:01:24.050755  8289 ts_manager.cc:194] Registered new tserver with Master: 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:24.052611  8289 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50098
I20260709 13:01:24.960212  8537 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:24.968612  8392 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:24.972816  9010 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:24.973881  8465 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:24.983093  8979 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.008742  9106 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.019995  8395 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:01:25.036525  8509 consensus_peers.cc:597] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3476b7ee17e048f38396353721fa682f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:25.041026  8289 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.047688  8465 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.055127  9094 heartbeater.cc:499] Master 127.7.28.254:35733 was elected leader, sending a full tablet report...
I20260709 13:01:25.071856  8395 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.081765  8544 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:25.083879  9098 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.089496  8465 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:25.091478  9098 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.111615  8858 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.113629  8466 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:01:25.115710  8360 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04d76276a90a4f889ff8e98f46e90227. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:25.120182  8537 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.133348  8395 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.133329  8293 catalog_manager.cc:5697] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.158555  8541 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:25.158671  8360 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55bf07df55b74bb7a74bd894b869faef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:25.160054  8466 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:25.160550  8858 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.162129  9119 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.175838  9119 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.177785  8465 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.178395  8541 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.198272  8289 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.210646  8465 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.220572  8541 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:25.223084  9009 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.227578  8395 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:25.229961  9008 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:25.241568  8435 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b6226d3e14545daa1ff24f4a0384182. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:25.253468  9099 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.256242  8537 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.258047  8390 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.276140  8289 catalog_manager.cc:5697] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:25.475409  9128 ts_tablet_manager.cc:933] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:01:25.483572  9128 tablet_copy_client.cc:323] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
I20260709 13:01:25.643633  9131 ts_tablet_manager.cc:933] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:25.657007  9131 tablet_copy_client.cc:323] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:01:25.669926  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet 04d76276a90a4f889ff8e98f46e90227 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
I20260709 13:01:25.670727  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet 04d76276a90a4f889ff8e98f46e90227 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-04d76276a90a4f889ff8e98f46e90227
I20260709 13:01:25.682871  8405 tablet_copy_source_session.cc:215] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:25.688071  9128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d76276a90a4f889ff8e98f46e90227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.712113  9137 ts_tablet_manager.cc:933] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:25.719215  9136 ts_tablet_manager.cc:933] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:01:25.720806  8554 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet 3476b7ee17e048f38396353721fa682f from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:01:25.721432  8554 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet 3476b7ee17e048f38396353721fa682f from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-3476b7ee17e048f38396353721fa682f
I20260709 13:01:25.729905  9137 tablet_copy_client.cc:323] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.194:32851
I20260709 13:01:25.732685  8554 tablet_copy_source_session.cc:215] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:01:25.750485  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 75665.6us
I20260709 13:01:25.758641  9131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3476b7ee17e048f38396353721fa682f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.758795  9136 tablet_copy_client.cc:323] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
I20260709 13:01:25.760641  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet 55bf07df55b74bb7a74bd894b869faef from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
I20260709 13:01:25.761016  8480 tablet_copy_service.cc:140] P d2a645dcec4c479ba4c94d075b1bc98c: Received BeginTabletCopySession request for tablet 8b6226d3e14545daa1ff24f4a0384182 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:48784)
I20260709 13:01:25.761227  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet 55bf07df55b74bb7a74bd894b869faef from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-55bf07df55b74bb7a74bd894b869faef
I20260709 13:01:25.761615  8480 tablet_copy_service.cc:161] P d2a645dcec4c479ba4c94d075b1bc98c: Beginning new tablet copy session on tablet 8b6226d3e14545daa1ff24f4a0384182 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:48784: session id = 92314b14f5554885a80c3dc87f4beed4-8b6226d3e14545daa1ff24f4a0384182
I20260709 13:01:25.769107  8480 tablet_copy_source_session.cc:215] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:25.769893  9128 tablet_copy_client.cc:806] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:25.770632  9128 tablet_copy_client.cc:670] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:25.772670  9137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6226d3e14545daa1ff24f4a0384182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.775655  9128 tablet_copy_client.cc:538] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:25.785113  8405 tablet_copy_source_session.cc:215] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:25.797983  9137 tablet_copy_client.cc:806] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:25.799083  9128 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:01:25.802253  9137 tablet_copy_client.cc:670] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:25.802809  9131 tablet_copy_client.cc:806] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:25.803457  9131 tablet_copy_client.cc:670] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:25.803747  9136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bf07df55b74bb7a74bd894b869faef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:25.806715  9137 tablet_copy_client.cc:538] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:25.813532  9131 tablet_copy_client.cc:538] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:25.830370  9131 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:01:25.836927  9137 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:01:25.843129  9136 tablet_copy_client.cc:806] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:25.845438  9136 tablet_copy_client.cc:670] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:25.849654  9136 tablet_copy_client.cc:538] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:25.858825  9136 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:01:25.874550  9128 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:25.875547  9128 tablet_bootstrap.cc:492] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:01:25.876299  9128 ts_tablet_manager.cc:1403] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.015s
I20260709 13:01:25.884025  9128 raft_consensus.cc:359] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.884752  9137 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:25.884994  9128 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:01:25.885699  9137 tablet_bootstrap.cc:492] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:01:25.886269  9131 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:25.885735  9128 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.886489  9137 ts_tablet_manager.cc:1403] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.008s
I20260709 13:01:25.887208  9131 tablet_bootstrap.cc:492] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:01:25.887895  9131 ts_tablet_manager.cc:1403] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.006s
I20260709 13:01:25.889624  9137 raft_consensus.cc:359] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.890894  9131 raft_consensus.cc:359] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.891548  9137 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:01:25.892551  9137 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.893630  9128 ts_tablet_manager.cc:1434] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.005s
I20260709 13:01:25.891824  9131 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:01:25.894712  9131 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.899066  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-04d76276a90a4f889ff8e98f46e90227 received from {username='slave'} at 127.0.0.1:60598
I20260709 13:01:25.899600  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-04d76276a90a4f889ff8e98f46e90227 on tablet 04d76276a90a4f889ff8e98f46e90227 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:25.906626  9136 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:25.907621  9136 tablet_bootstrap.cc:492] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:01:25.908325  9136 ts_tablet_manager.cc:1403] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.009s
I20260709 13:01:25.915944  9136 raft_consensus.cc:359] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.917016  9136 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:01:25.917670  9136 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:25.919325  9131 ts_tablet_manager.cc:1434] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.009s
I20260709 13:01:25.920323  9136 ts_tablet_manager.cc:1434] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:01:25.921137  8554 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-3476b7ee17e048f38396353721fa682f received from {username='slave'} at 127.0.0.1:56998
I20260709 13:01:25.921630  8554 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-3476b7ee17e048f38396353721fa682f on tablet 3476b7ee17e048f38396353721fa682f with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:25.924934  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-55bf07df55b74bb7a74bd894b869faef received from {username='slave'} at 127.0.0.1:60598
I20260709 13:01:25.925329  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-55bf07df55b74bb7a74bd894b869faef on tablet 55bf07df55b74bb7a74bd894b869faef with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:25.931800  9137 ts_tablet_manager.cc:1434] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.045s	user 0.018s	sys 0.007s
I20260709 13:01:25.934006  8480 tablet_copy_service.cc:342] P d2a645dcec4c479ba4c94d075b1bc98c: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-8b6226d3e14545daa1ff24f4a0384182 received from {username='slave'} at 127.0.0.1:48784
I20260709 13:01:25.934487  8480 tablet_copy_service.cc:434] P d2a645dcec4c479ba4c94d075b1bc98c: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-8b6226d3e14545daa1ff24f4a0384182 on tablet 8b6226d3e14545daa1ff24f4a0384182 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:26.059381  9069 raft_consensus.cc:1217] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:26.069657  9069 raft_consensus.cc:1217] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:26.202332  9069 raft_consensus.cc:1217] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:26.309222  9069 raft_consensus.cc:1217] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:26.579124  9148 raft_consensus.cc:1064] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:26.581774  9148 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:26.587949  8537 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.588274  9069 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.589958  9119 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:26.592886  8465 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.592195  9148 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:26.595003  9119 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:26.607220  9010 raft_consensus.cc:1064] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:26.609570  9010 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:26.610062  9119 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.615483  8537 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.615617  8466 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.628203  9069 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.639026  9106 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:26.680641  8293 catalog_manager.cc:5697] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.737452  9099 raft_consensus.cc:1064] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:26.741071  9099 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:26.747542  9069 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.754912  8467 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.757283  9168 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:26.781399  9069 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.781826  8537 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.783779  9135 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:26.846678  8395 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.852890  9170 raft_consensus.cc:1064] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:26.857368  9159 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.860236  9099 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:26.864553  9170 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:26.872407  9068 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.876622  8465 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.893425  9159 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:26.886243  8288 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.896546  8390 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:26.902884  9067 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:26.905463  8395 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.911896  9164 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:26.923554  9166 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.925307  9067 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.945182  8467 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:26.963641  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04d76276a90a4f889ff8e98f46e90227 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:26.965548  8293 catalog_manager.cc:5697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 3 to 4, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.966869  8537 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:26.978914  8531 tablet_service.cc:1558] Processing DeleteTablet for tablet 04d76276a90a4f889ff8e98f46e90227 with delete_type TABLET_DATA_TOMBSTONED (TS c45599d1dc3b4823b857cf77f276dc7b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49310
I20260709 13:01:26.985170  8467 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:26.985766  9174 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:26.988638  9069 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.990433  9164 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:26.990779  9180 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:26.986972  9068 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:26.993852  9010 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.004107  9010 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:27.002100  8395 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.008071  9164 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:01:27.028805  8537 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.033231  9184 tablet_replica.cc:333] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:01:27.034358  9184 raft_consensus.cc:2243] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.048041  9184 raft_consensus.cc:2272] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.052495  8544 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.055691  9160 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.056267  8467 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.053195  9068 raft_consensus.cc:2955] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.065201  9184 ts_tablet_manager.cc:1916] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:27.067603  9067 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.068532  9169 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:27.070966  8390 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.079862  8469 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.083802  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3476b7ee17e048f38396353721fa682f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:27.083262  8469 raft_consensus.cc:2955] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.089996  8288 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 3 to 4, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.103611  8376 tablet_service.cc:1558] Processing DeleteTablet for tablet 3476b7ee17e048f38396353721fa682f with delete_type TABLET_DATA_TOMBSTONED (TS 2122d8c723e84e3da22f81f7eeb4b1a9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44064
I20260709 13:01:27.115911  8293 catalog_manager.cc:5697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.110710  9169 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:01:27.130766  9162 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.138847  9188 tablet_replica.cc:333] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:01:27.140311  9188 raft_consensus.cc:2243] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.141115  9188 raft_consensus.cc:2272] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.145874  9188 ts_tablet_manager.cc:1916] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:27.134025  9069 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.123816  9184 ts_tablet_manager.cc:1929] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:27.160548  9184 log.cc:1199] T 04d76276a90a4f889ff8e98f46e90227 P c45599d1dc3b4823b857cf77f276dc7b: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/wals/04d76276a90a4f889ff8e98f46e90227
I20260709 13:01:27.170563  8289 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.173928  8277 catalog_manager.cc:5028] TS c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): tablet 04d76276a90a4f889ff8e98f46e90227 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:01:27.189970  9188 ts_tablet_manager.cc:1929] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:27.190531  9188 log.cc:1199] T 3476b7ee17e048f38396353721fa682f P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/wals/3476b7ee17e048f38396353721fa682f
I20260709 13:01:27.195153  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet 3476b7ee17e048f38396353721fa682f (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:01:27.195226  8544 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.205832  8395 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:27.213826  9069 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.215194  8544 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.215838  9166 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.216919  9118 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:27.226976  8469 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.233170  9118 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.238011  8544 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.238960  9069 raft_consensus.cc:2955] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.256229  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55bf07df55b74bb7a74bd894b869faef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:27.263471  8289 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 3 to 4, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.286515  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet 55bf07df55b74bb7a74bd894b869faef with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47224
I20260709 13:01:27.288654  9190 tablet_replica.cc:333] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:01:27.289875  9190 raft_consensus.cc:2243] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.290763  9190 raft_consensus.cc:2272] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.296231  9190 ts_tablet_manager.cc:1916] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:27.317054  9190 ts_tablet_manager.cc:1929] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:27.317481  9190 log.cc:1199] T 55bf07df55b74bb7a74bd894b869faef P d2a645dcec4c479ba4c94d075b1bc98c: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/wals/55bf07df55b74bb7a74bd894b869faef
I20260709 13:01:27.319164  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet 55bf07df55b74bb7a74bd894b869faef (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:01:27.483314  8469 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:27.488125  9069 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.489801  9179 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:27.490039  8392 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:27.491739  9180 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.498116  9179 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.502890  8395 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.502794  9069 raft_consensus.cc:2955] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.524281  8278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b6226d3e14545daa1ff24f4a0384182 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:27.523290  8290 catalog_manager.cc:5697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 3 to 4, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:27.540371  8531 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6226d3e14545daa1ff24f4a0384182 with delete_type TABLET_DATA_TOMBSTONED (TS c45599d1dc3b4823b857cf77f276dc7b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49310
I20260709 13:01:27.541352  9184 tablet_replica.cc:333] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:01:27.542155  9184 raft_consensus.cc:2243] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.542835  9184 raft_consensus.cc:2272] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.545650  9184 ts_tablet_manager.cc:1916] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:27.559713  9184 ts_tablet_manager.cc:1929] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:27.560032  9184 log.cc:1199] T 8b6226d3e14545daa1ff24f4a0384182 P c45599d1dc3b4823b857cf77f276dc7b: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/wals/8b6226d3e14545daa1ff24f4a0384182
I20260709 13:01:27.561393  8277 catalog_manager.cc:5028] TS c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): tablet 8b6226d3e14545daa1ff24f4a0384182 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:01:28.612766  8395 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:28.618507  8467 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:28.618546  8537 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:28.618690  8360 consensus_peers.cc:597] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef4deccb7c274fec97786db5d6131514. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:28.619896  9192 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.620738  9148 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.628819  9148 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.630537  8537 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.643287  8469 consensus_queue.cc:237] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:28.647701  8288 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.649415  8467 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.668413  8537 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:28.668953  8435 consensus_peers.cc:597] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13811dee93af4290bdcf7d73b527d0f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:28.670837  8395 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:28.671168  9172 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.674409  9172 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:28.685719  9172 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.693059  8392 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.707437  8537 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.713804  8542 consensus_queue.cc:237] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:28.725119  8290 catalog_manager.cc:5697] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 1 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.748183  8395 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:28.748415  8469 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:28.749624  9159 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.750478  9191 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:28.752808  8509 consensus_peers.cc:597] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6becd976429a45a3874a10895b19b63e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:28.759581  9159 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.762149  8395 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.766149  8469 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.777293  8395 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:28.784376  8290 catalog_manager.cc:5697] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 1 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:01:28.789203  8360 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7219cc411cf6498f8f250f689007874f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:28.790486  8465 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:28.792035  8542 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:28.792625  9196 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.795473  9196 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.806391  9196 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.824092  8469 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:28.834774  8288 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 1 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.846072  8542 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:29.433983  9222 ts_tablet_manager.cc:933] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:01:29.440366  9222 tablet_copy_client.cc:323] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
I20260709 13:01:29.442513  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet ef4deccb7c274fec97786db5d6131514 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
I20260709 13:01:29.443064  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet ef4deccb7c274fec97786db5d6131514 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-ef4deccb7c274fec97786db5d6131514
I20260709 13:01:29.460469  8405 tablet_copy_source_session.cc:215] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:29.476346  9221 ts_tablet_manager.cc:933] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:01:29.846709  9224 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:29.847781  9224 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:29.851154  9224 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:29.996163  9221 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.012s	sys 0.060s
W20260709 13:01:29.996721  9221 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.012s	sys 0.060s
I20260709 13:01:29.997824  9221 tablet_copy_client.cc:323] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
W20260709 13:01:30.091816  8324 debug-util.cc:398] Leaking SignalData structure 0x7b080003da80 after lost signal to thread 7286
W20260709 13:01:30.093297  8324 debug-util.cc:398] Leaking SignalData structure 0x7b080003e160 after lost signal to thread 8327
W20260709 13:01:30.094895  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0820 after lost signal to thread 8419
W20260709 13:01:31.625883  8510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.642s	user 0.002s	sys 0.014s
W20260709 13:01:31.628886  8510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.646s	user 0.004s	sys 0.014s
I20260709 13:01:31.638209  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58882 (request call id 28) took 2269 ms. Trace:
I20260709 13:01:31.639081  9069 rpcz_store.cc:276] 0709 13:01:29.369151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.635941 (+2266790us) service_pool.cc:224] Handling call
0709 13:01:31.636864 (+   923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.637339 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.637419 (+    80us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.637509 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:31.637579 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.637700 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.637929 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.644927  9228 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.646341  9228 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.649802  9228 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.650580  9228 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.651643  9228 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.654155  9228 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.657151  9229 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.658346  9230 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.658116  9229 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.659207  9230 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.661509  9230 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.662361  9230 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.663064  9229 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.663127  9230 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.666023  9230 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.669632  9231 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.670329  9229 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.672170  9230 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.670109  9228 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.675279  9228 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.670706  9231 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.675882  9230 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.675613  9232 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.678314  9230 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.678290  9231 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.681334  9196 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.681386  9232 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:31.682209  9196 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.678269  9228 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.672453  9229 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:31.683708  9230 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.710340  9203 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.711263  9203 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.713204  9229 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:31.711259  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7e80 after lost signal to thread 8494
I20260709 13:01:31.720511  9196 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.727140  9196 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.727959  9196 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.730605  9196 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.731277  9196 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:31.732271  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6a00 after lost signal to thread 8568
I20260709 13:01:31.733098  9148 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.705585  9231 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.733934  9148 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.743459  9231 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.741259  9203 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.745723  9232 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.746264  9231 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.746487  9230 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.747030  9196 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.749085  9230 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.742472  9233 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.745328  9148 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.750614  9233 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.755110  9233 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.760352  9231 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.760701  9212 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.759783  9196 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.761616  9231 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.761721  9212 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.764503  9234 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.765411  9148 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.765753  9234 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.767794  9212 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.768384  9231 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.768673  9237 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.769693  9235 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.769769  9233 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.766278  9148 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.769878  9237 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.766551  9230 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.776054  9230 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.777674  9236 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.777001  9237 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.775368  9148 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.779608  9196 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.782107  9196 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.770705  9233 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.770681  9235 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.784902  9237 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.786257  9237 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.787163  9230 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.789479  9233 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.778712  9236 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:31.791633  9196 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.792282  9196 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.784981  9148 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.795205  9237 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.877655  9237 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.878588  9237 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.879228  9242 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.879994  9242 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.796592  9236 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.881973  9245 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.882330  9236 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.794116  9234 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.883594  9243 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.884032  9234 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.884897  9234 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.885308  9244 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.807906  9235 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.827873  9231 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.886821  9231 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.889240  9246 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.839166  9241 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.897727  9241 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.900918  9241 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.849874  9232 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.902011  9232 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.905193  9232 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.852849  9229 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.908318  9229 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:31.911222  9229 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.885500  9251 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.912014  9203 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.912364  9251 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:31.913003  9203 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.915125  9251 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:31.915518  8435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.539s	user 0.055s	sys 0.135s
I20260709 13:01:31.915772  9251 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:01:31.916049  8435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.540s	user 0.055s	sys 0.135s
I20260709 13:01:31.916570  9251 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.885317  9250 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.915140  9203 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.918180  9250 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:31.919047  9203 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.919734  9203 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.853447  9238 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.921000  9238 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.827184  9230 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.922451  9230 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.924023  9241 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.924618  9248 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.924988  9230 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.924799  9241 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.834841  9240 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.925410  9248 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.926074  9240 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.928802  9240 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.828117  9233 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.929808  9233 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.930270  9241 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.931335  9241 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.932618  9233 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.890229  9231 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.886711  9235 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.934278  9235 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.937093  9235 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.883170  9236 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.891856  9242 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.892297  9212 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.938181  9212 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.932264  9241 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.939327  9236 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.940704  9212 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.882753  9245 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.942667  9241 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.943585  9245 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.943722  9236 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.944425  9245 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.944550  9236 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.892812  9234 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.893589  9148 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.947284  9236 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.948477  9236 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.949066  9148 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.881461  9237 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.949371  9236 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.949774  9148 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.950662  9148 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:01:31.951156  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2840 after lost signal to thread 9093
I20260709 13:01:31.951416  9238 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.952090  9236 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.952898  9148 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:31.884411  9243 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.954617  9203 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.955245  9243 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.886324  9244 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.955513  9203 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.956409  9203 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.957289  9241 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.957742  9244 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.956784  9236 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:31.958351  9148 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.958632  9203 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.911098  9253 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.959074  9241 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.959540  9253 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.958885  9236 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.964076  9241 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.964637  9241 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.965202  9241 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.961544  9234 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.966702  9234 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.968037  9236 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.937551  9250 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.887253  9239 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.970398  9250 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:31.970624  9239 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.970991  9250 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:31.972993  9239 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:31.975334  8507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.193:35967 timed out after 2.072s (SENT) [suppressed 1 similar messages]
I20260709 13:01:31.945319  9245 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.980319  9245 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.897614  9246 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.983064  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:31.985656  9251 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.987061  9196 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:31.987896  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:31.975270  9241 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.988513  8395 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:31.969419  9234 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:31.989400  9250 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:31.990046  9250 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:31.990656  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:31.990617  9250 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:31.991353  8395 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:31.992385  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:31.993039  8394 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:31.959026  9148 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:31.999963  9253 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.007004  9234 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.009765  9234 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.007768  9251 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.024009  9259 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.011934  9251 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.024734  9259 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:32.037556  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:31.985657  9246 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.043015  9243 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.043797  9243 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.048130  9241 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:32.049118  9241 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:32.037659  9259 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:32.052676  9259 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.054008  9259 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:01:32.025511  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 50365.9us
I20260709 13:01:32.056226  9239 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.070212  9239 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.070824  9212 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.071481  9212 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.035192  9244 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.072474  9244 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.142097  9257 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.082979  9212 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:32.114099  9222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef4deccb7c274fec97786db5d6131514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:32.156009  9228 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:32.157389  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.158152  9228 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.157325  9196 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.161456  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:32.162335  8465 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 1.
I20260709 13:01:32.077099  9256 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.081918  9244 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.076670  9251 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.082330  9245 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:32.199062  9233 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:32.218437  9228 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:32.218138  9233 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.219851  9263 ts_tablet_manager.cc:933] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:32.073360  9246 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:32.150614  9232 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.188702  9212 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.113170  9255 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.157348  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:32.144698  9257 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.126675  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:32.271271  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.189270  9231 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.162971  9148 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.210280  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.151067  9253 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.215507  9262 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.261852  9250 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.262116  9239 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.238943  9248 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.150414  9229 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:32.231029  9245 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.296361  9232 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.188580  9033 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:32.271744  9233 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:32.564443  9244 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.435364  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:32.296957  9246 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.577461  9244 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.487253  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.579736  9244 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.580272  9245 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.380247  9264 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.581198  9239 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.580889  9229 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.581420  9262 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.581732  9239 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.338409  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.583653  9262 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.583828  8392 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:32.584254  9262 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.434823  9257 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.354417  8469 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 1.
I20260709 13:01:32.584918  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.381204  9243 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.298504  9241 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.434506  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.274730  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet 7219cc411cf6498f8f250f689007874f from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
I20260709 13:01:32.497979  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.243100  9234 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.339313  9254 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.360898  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.300205  9256 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.380447  9263 tablet_copy_client.cc:323] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.194:32851
I20260709 13:01:32.354588  9230 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.469549  9231 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.338423  9255 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.300093  9228 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.580132  9253 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.365896  9203 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.426556  9266 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.579501  9246 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.585778  8392 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:32.633190  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.597041  9272 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.360399  9258 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:32.435750  9265 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.436944  9259 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.503759  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.604961  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:32.605544  9271 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.331250  9251 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:32.606999  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 443449us
I20260709 13:01:32.607194  9250 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.583830  9239 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.609336  9268 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.586416  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.610149  9257 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.587586  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.586212  9270 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:32.587754  9254 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.587808  8394 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:32.588732  9230 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.584892  9262 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.588948  9244 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.594468  9255 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.586903  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet 7219cc411cf6498f8f250f689007874f from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-7219cc411cf6498f8f250f689007874f
I20260709 13:01:32.581226  9264 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.588025  8393 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:32.590430  9228 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:32.592666  9253 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.587352  9234 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:32.588231  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.617835  9229 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:32.618237  9232 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:32.589675  9256 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:32.580060  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.380893  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:32.270817  9212 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.626782  9203 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:32.627066  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:32.449306  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:32.673516  8361 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44080 dropped due to backpressure: service queue is full with 50 items
I20260709 13:01:32.674467  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:32.632961  9231 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:32.690074  8392 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.035607  8395 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 1.
I20260709 13:01:33.035955  8390 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
W20260709 13:01:32.698378  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 105974us
I20260709 13:01:33.034986  8543 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.035426  8537 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.042542  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.043773  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:32.707598  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.044351  8537 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
W20260709 13:01:32.832732  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800297980 after lost signal to thread 7286
I20260709 13:01:33.044308  8536 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.053650  9234 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.053601  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.054364  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.055263  9228 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:33.044173  8386 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.056033  9270 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:33.067312  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.037923  9250 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:33.051585  9257 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.056041  9033 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:32.710060  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.058436  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.063607  8544 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:32.816530  9222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58882 (request call id 29) took 3435 ms. Trace:
I20260709 13:01:32.843922  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.071064  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.074314  8538 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.074847  9234 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.075296  8480 tablet_copy_service.cc:140] P d2a645dcec4c479ba4c94d075b1bc98c: Received BeginTabletCopySession request for tablet 13811dee93af4290bdcf7d73b527d0f4 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:48784)
I20260709 13:01:33.075553  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.075973  8480 tablet_copy_service.cc:161] P d2a645dcec4c479ba4c94d075b1bc98c: Beginning new tablet copy session on tablet 13811dee93af4290bdcf7d73b527d0f4 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:48784: session id = 92314b14f5554885a80c3dc87f4beed4-13811dee93af4290bdcf7d73b527d0f4
I20260709 13:01:33.076459  9270 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.077008  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.070125  9250 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.078402  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.078959  8544 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.079314  9257 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.079772  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.080754  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.073694  8543 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.059020  9271 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.047042  8391 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.045807  8389 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.094113  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.062085  8387 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:32.706382  9272 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.099272  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.069407  9244 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.058494  9268 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.103221  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.081492  9222 rpcz_store.cc:276] 0709 13:01:29.369555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.397082 (+ 27527us) service_pool.cc:224] Handling call
0709 13:01:29.434386 (+ 37304us) ts_tablet_manager.cc:934] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
0709 13:01:32.090597 (+2656211us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:32.511318 (+420721us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:32.511471 (+   153us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:32.675157 (+163686us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:32.675541 (+   384us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:32.691900 (+ 16359us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:32.804968 (+113068us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":270,"tablet-copy.queue_time_us":35658,"thread_start_us":84483,"threads_started":2}
I20260709 13:01:33.085147  8539 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.092028  8535 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.104843  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.071190  9251 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.100080  9274 ts_tablet_manager.cc:933] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:33.100423  9090 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfbe0 after lost signal to thread 8327
I20260709 13:01:32.728170  9266 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.098279  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:33.121146  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.069448  9265 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
W20260709 13:01:33.107090  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51189us
I20260709 13:01:33.122612  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.071655  9258 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.036330  8361 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44080 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60598 (request call id 9)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 500)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 509)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 576)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 577)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 578)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 580)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 490)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 491)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 505)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 518)
I20260709 13:01:33.128916  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.129693  8535 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.130196  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.116941  9222 tablet_copy_client.cc:806] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:33.132884  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.116683  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.136854  9268 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.137244  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.133770  8543 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.134835  9032 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:33.120448  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.139449  8539 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.139158  9250 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:33.140496  9222 tablet_copy_client.cc:670] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:33.141242  9069 raft_consensus.cc:1240] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.136655  8536 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.145066  9262 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.145474  9271 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.146040  8542 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.124579  8507 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.154400  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.150528  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.156829  8542 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.158543  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.159204  9230 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.154170  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.159904  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.151117  9258 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.165390  8470 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.166215  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:33.164965  9212 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.169180  8405 tablet_copy_source_session.cc:215] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:33.152030  9254 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.167802  9230 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.164570  9251 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.150242  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.160065  8538 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.174278  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.175393  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:33.201803  9090 debug-util.cc:398] Leaking SignalData structure 0x7b08002bbee0 after lost signal to thread 8419
I20260709 13:01:33.201928  9230 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.202504  9272 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.202684  9230 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:33.203176  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800099a40 after lost signal to thread 8494
I20260709 13:01:33.208645  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.209260  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.211360  8405 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:60598 (request call id 7) took 1073 ms. Trace:
I20260709 13:01:33.172448  9264 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:33.203534  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800305a80 after lost signal to thread 8495
I20260709 13:01:33.212641  8507 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.221457  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.222886  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.177397  9244 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.223794  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.177995  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.230074  8537 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.225853  9276 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.208633  9266 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.228302  9212 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.236379  9212 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.236864  9212 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.238734  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:33.239583  9230 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.237377  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.242023  9258 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.242516  9258 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.242921  9258 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.243079  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.244315  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.176283  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.149600  9275 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.178171  9203 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.229275  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.244904  8394 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.226246  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.211817  8405 rpcz_store.cc:276] 0709 13:01:32.211264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.274367 (+ 63103us) service_pool.cc:224] Handling call
0709 13:01:33.211257 (+936890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.256187  9274 tablet_copy_client.cc:323] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:01:33.249267  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.177131  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:33.253166  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800316960 after lost signal to thread 8568
I20260709 13:01:33.259114  8388 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
W20260709 13:01:33.260038  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800309740 after lost signal to thread 9093
I20260709 13:01:33.260154  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.261111  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.261569  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.253093  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.262257  8391 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:33.228451  9250 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.254012  8535 raft_consensus.cc:1240] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.263159  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.264017  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.264348  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.264595  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.265316  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.266424  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.266858  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.267112  8389 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.267288  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.267515  8395 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.254587  8390 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:33.254848  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.246016  9276 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:32.710278  8358 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44080 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60598 (request call id 9)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 500)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 509)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 576)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 577)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 578)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 580)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 581)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 585)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 490)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 491)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 505)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 518)
I20260709 13:01:33.269129  8393 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:33.270638  8507 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.258526  9229 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.267976  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.269953  9276 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.274636  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.250466  9230 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.278474  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.279390  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.280153  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.278040  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.281596  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.272719  9229 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.250914  9275 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:33.283037  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.283352  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.282469  9229 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.287707  8507 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.288127  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.290421  8507 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.291862  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.291987  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:33.255626  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 120874us
I20260709 13:01:33.288837  9273 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.294414  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.298432  9230 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.299039  9230 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.299582  9230 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.309927  9230 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.312860  9230 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.286655  9266 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:33.345762  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 51392.4us
I20260709 13:01:33.285435  9275 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.348834  8480 tablet_copy_source_session.cc:215] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:33.349220  8507 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.349588  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.355322  9265 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.359110  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.295686  9273 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.342617  9232 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.362041  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.362648  9273 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.365367  9263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13811dee93af4290bdcf7d73b527d0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:33.366333  9228 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.366707  8507 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.376801  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.346984  9266 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.366330  9230 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.385001  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.383100  8507 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.376175  9228 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.368302  9232 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.382189  9231 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.392074  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.384383  9266 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.393397  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.395906  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.397004  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.397162  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.388904  9228 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.399950  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.398092  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.387805  9233 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.399684  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.407171  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.384120  9230 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.405869  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.381768  9212 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.381779  9273 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.503309  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.499611  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.390973  9232 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:33.522199  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 139172us
I20260709 13:01:33.524859  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.506557  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.457391  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.525887  8390 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:33.411794  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.458829  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.527269  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.398010  9231 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.400960  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.515770  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.538347  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.544718  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.492800  9275 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:33.538960  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.544353  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.530673  8507 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.546196  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.547005  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.411752  9233 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.550237  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.549636  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.456723  9258 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.526127  9230 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.552505  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.444363  9276 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:33.553799  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.553855  8467 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.513229  8554 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet 6becd976429a45a3874a10895b19b63e from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:01:33.528422  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.545861  9231 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.456641  9229 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.557518  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 582) took 1014 ms. Trace:
I20260709 13:01:33.444756  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.563284  9221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7219cc411cf6498f8f250f689007874f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:33.560691  8390 rpcz_store.cc:276] 0709 13:01:32.542953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.530808 (+987855us) service_pool.cc:224] Handling call
0709 13:01:33.546942 (+ 16134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.557193 (+ 10251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.557220 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.557271 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.557300 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.557357 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.557459 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.564772  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 581) took 1017 ms. Trace:
I20260709 13:01:33.566558  8393 rpcz_store.cc:276] 0709 13:01:32.542558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.529205 (+986647us) service_pool.cc:224] Handling call
0709 13:01:33.549298 (+ 20093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.553663 (+  4365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.553690 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.557276 (+  3586us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.557306 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.557357 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.559358 (+  2001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.570212  9266 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.571843  8537 raft_consensus.cc:1240] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.573565  9282 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.571388  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 585) took 1027 ms. Trace:
I20260709 13:01:33.575358  8393 rpcz_store.cc:276] 0709 13:01:32.543952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.570479 (+1026527us) service_pool.cc:224] Handling call
0709 13:01:33.570825 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.571037 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.571065 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.571110 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.571142 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.571210 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.571330 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.552752  9233 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.578301  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:33.556973  9281 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.580776  9276 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.582964  9258 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.573468  9266 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.563511  9229 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.609225  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 583) took 1066 ms. Trace:
I20260709 13:01:33.553346  8461 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:33.559149  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.609815  8390 rpcz_store.cc:276] 0709 13:01:32.543300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.567941 (+1024641us) service_pool.cc:224] Handling call
0709 13:01:33.598557 (+ 30616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.608713 (+ 10156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.608762 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.608833 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.608884 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.608976 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.609148 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.603480  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:33.574119  9282 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.613869  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 586) took 1069 ms. Trace:
I20260709 13:01:33.615852  8393 rpcz_store.cc:276] 0709 13:01:32.544281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.576773 (+1032492us) service_pool.cc:224] Handling call
0709 13:01:33.606064 (+ 29291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.610450 (+  4386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.610492 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.613524 (+  3032us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.613573 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.613652 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.613805 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.577152  8554 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet 6becd976429a45a3874a10895b19b63e from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-6becd976429a45a3874a10895b19b63e
I20260709 13:01:33.603921  9275 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.605458  8539 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.588393  9281 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:01:33.628750  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 98124.6us
I20260709 13:01:33.629606  8507 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.630687  8507 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:33.623124  9282 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.633384  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 490) took 1028 ms. Trace:
I20260709 13:01:33.633962  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 491) took 1026 ms. Trace:
I20260709 13:01:33.633864  8390 rpcz_store.cc:276] 0709 13:01:32.603211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.622144 (+1018933us) service_pool.cc:224] Handling call
0709 13:01:33.629191 (+  7047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.631327 (+  2136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.631365 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.631417 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.631453 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.631519 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.631636 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.634398  8393 rpcz_store.cc:276] 0709 13:01:32.605309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.616762 (+1011453us) service_pool.cc:224] Handling call
0709 13:01:33.628517 (+ 11755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.628681 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.628708 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.631718 (+  3010us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.631756 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.631808 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.631903 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.628327  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.628756  9281 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.632349  9258 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.645391  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 580) took 1128 ms. Trace:
I20260709 13:01:33.650972  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 493) took 1042 ms. Trace:
I20260709 13:01:33.651522  8393 rpcz_store.cc:276] 0709 13:01:32.608141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.636004 (+1027863us) service_pool.cc:224] Handling call
0709 13:01:33.642598 (+  6594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.650506 (+  7908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.650549 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.650612 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.650656 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.650739 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.650896 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.654289  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 492) took 1047 ms. Trace:
I20260709 13:01:33.654834  8390 rpcz_store.cc:276] 0709 13:01:32.606948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.635218 (+1028270us) service_pool.cc:224] Handling call
0709 13:01:33.640018 (+  4800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.643258 (+  3240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.643287 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.648036 (+  4749us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:33.654036 (+  6000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.654106 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.654231 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.646811  9258 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.656949  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 496) took 1046 ms. Trace:
I20260709 13:01:33.641695  9284 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.657407  8390 rpcz_store.cc:276] 0709 13:01:32.610350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.656008 (+1045658us) service_pool.cc:224] Handling call
0709 13:01:33.656454 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.656632 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.656659 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.656703 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.656734 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.656790 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.656896 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.646443  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.657922  9258 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.293466  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:33.663470  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.663889  9212 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.670200  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 497) took 1052 ms. Trace:
I20260709 13:01:33.671404  8390 rpcz_store.cc:276] 0709 13:01:32.614468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.658906 (+1044438us) service_pool.cc:224] Handling call
0709 13:01:33.659213 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.665904 (+  6691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.665946 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.666467 (+   521us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.666516 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.666579 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.666725 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.680480  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.678683  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 499) took 1060 ms. Trace:
I20260709 13:01:33.682838  8390 rpcz_store.cc:276] 0709 13:01:32.618350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.676509 (+1058159us) service_pool.cc:224] Handling call
0709 13:01:33.676854 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.678292 (+  1438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.678324 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.678373 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.678426 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.678492 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.678621 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:33.686035  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 168656us
I20260709 13:01:33.691468  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:33.694105  9230 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.695024  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 505) took 1070 ms. Trace:
I20260709 13:01:33.695277  8538 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.647843  8387 rpcz_store.cc:276] 0709 13:01:32.517457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.293859 (+776402us) service_pool.cc:224] Handling call
0709 13:01:33.644773 (+350914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.644979 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.645012 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.645077 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.645118 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.645180 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.645310 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.697938  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 494) took 1089 ms. Trace:
I20260709 13:01:33.698225  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 501) took 1078 ms. Trace:
I20260709 13:01:33.698376  8393 rpcz_store.cc:276] 0709 13:01:32.608894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.652767 (+1043873us) service_pool.cc:224] Handling call
0709 13:01:33.679513 (+ 26746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.684815 (+  5302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.684847 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.697015 (+ 12168us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.697056 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.697748 (+   692us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.697880 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.658602  9284 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:33.698810  8390 rpcz_store.cc:276] 0709 13:01:32.620262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.683842 (+1063580us) service_pool.cc:224] Handling call
0709 13:01:33.684583 (+   741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.696551 (+ 11968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.696587 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.697987 (+  1400us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.698026 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.698086 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.698179 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.705443  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:33.695506  8389 rpcz_store.cc:276] 0709 13:01:32.624443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.693974 (+1069531us) service_pool.cc:224] Handling call
0709 13:01:33.694426 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.694659 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.694696 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.694744 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.694784 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.694848 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.694962 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.710064  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 518) took 1077 ms. Trace:
I20260709 13:01:33.704782  9284 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.717362  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 506) took 1092 ms. Trace:
I20260709 13:01:33.713581  8390 rpcz_store.cc:276] 0709 13:01:32.630943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.704318 (+1073375us) service_pool.cc:224] Handling call
0709 13:01:33.704640 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.707770 (+  3130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.707787 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.707818 (+    31us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.707836 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.707885 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.708009 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.717810  9066 raft_consensus.cc:1240] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.729437  8554 tablet_copy_source_session.cc:215] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:33.732983  9281 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.735239  9230 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.737412  9280 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:33.738045  9280 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:33.974483  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 237435us
I20260709 13:01:33.983182  9233 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.984966  9282 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:33.988831  9282 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:33.970754  9278 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:34.003551  8358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.022s	sys 0.037s
I20260709 13:01:33.977092  9279 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:34.005409  9280 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:34.008507  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.008888  9281 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:34.009326  8390 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.011102  9278 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:34.013311  9278 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:34.015771  9284 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:34.017956  9284 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:34.004172  8358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.022s	sys 0.037s
W20260709 13:01:34.025352  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 747320us
I20260709 13:01:34.030565  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.033392  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:34.283231  8507 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.28.254:35733, user_credentials={real_user=slave}} blocked reactor thread for 253855us
W20260709 13:01:34.563005  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 80777us
I20260709 13:01:34.734920  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.735656  8464 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.736796  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.737488  8389 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:33.717847  8387 rpcz_store.cc:276] 0709 13:01:32.625070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.696311 (+1071241us) service_pool.cc:224] Handling call
0709 13:01:33.706482 (+ 10171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.710926 (+  4444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.711447 (+   521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.713811 (+  2364us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.717089 (+  3278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.717171 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.717305 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.743134  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.743907  8389 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.745031  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.747715  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.748310  8466 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.749174  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.747097  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.750890  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.751562  8464 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.749696  8466 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.752780  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.550000  9279 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:34.754549  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.755461  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.755791  9279 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:33.974689  9286 consensus_queue.cc:1059] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:01:34.764128  9286 raft_consensus.cc:3055] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:34.764650  9286 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:34.765733  9286 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:34.768033  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:34.769140  8360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.030s	sys 0.028s
W20260709 13:01:34.775151  8360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.030s	sys 0.028s
W20260709 13:01:34.771827  8359 connection.cc:256] RPC call timeout handler was delayed by -1.4325968359999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 13:01:34.775512  8359 connection.cc:256] RPC call timeout handler was delayed by -1.42642472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:01:34.775512  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 800188us
I20260709 13:01:34.777842  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.778626  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:34.779050  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.779714  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:34.780031  8359 connection.cc:256] RPC call timeout handler was delayed by -1.4249859270000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:01:34.780411  8359 connection.cc:256] RPC call timeout handler was delayed by -1.4153364370000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:01:34.780694  8359 connection.cc:256] RPC call timeout handler was delayed by -1.3817929400000253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:01:34.780984  8359 connection.cc:256] RPC call timeout handler was delayed by -1.3781929400000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:01:34.781280  8359 connection.cc:256] RPC call timeout handler was delayed by -1.3723100679999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 13:01:34.781299  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.785907  9286 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.788056  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.791064  8466 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.791963  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.790198  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.792554  8466 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.793429  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.794127  8466 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.793478  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.795073  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.795195  8464 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.795644  8466 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:34.796152  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.796442  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.797307  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:34.804791  9258 consensus_meta.cc:287] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 1.134s	user 0.009s	sys 0.001s
I20260709 13:01:34.809122  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.810156  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.812285  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.814905  9258 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:34.815832  8390 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.816694  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.820094  9258 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:34.860945  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.863437  8358 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:34.873478  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.874260  8389 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.875277  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.881162  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.881946  8358 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:34.881421  9221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58882 (request call id 31) took 5463 ms. Trace:
I20260709 13:01:34.882877  8358 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:34.882529  9221 rpcz_store.cc:276] 0709 13:01:29.418391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.418561 (+   170us) service_pool.cc:224] Handling call
0709 13:01:29.481770 (+ 63209us) ts_tablet_manager.cc:934] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
0709 13:01:33.561729 (+4079959us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:34.811839 (+1250110us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:34.811954 (+   115us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:34.877351 (+ 65397us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:34.877628 (+   277us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:34.881202 (+  3574us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:34.881322 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":672,"tablet-copy.queue_time_us":57111,"thread_start_us":529442,"threads_started":2}
I20260709 13:01:34.884238  9221 tablet_copy_client.cc:806] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
W20260709 13:01:34.881973  9263 consensus_meta.cc:287] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 1.238s	user 0.012s	sys 0.000s
I20260709 13:01:34.885097  9221 tablet_copy_client.cc:670] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:34.882181  8394 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.881106  9290 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:34.886525  8394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 509) took 2258 ms (client timeout 2249 ms). Trace:
W20260709 13:01:34.887521  8394 rpcz_store.cc:269] 0709 13:01:32.628091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.281958 (+653867us) service_pool.cc:224] Handling call
0709 13:01:34.877759 (+1595801us) spinlock_profiling.cc:243] Waited 940 us on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:34.886427 (+  8668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162048}
I20260709 13:01:34.886548  9290 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:34.888654  9290 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.885903  9263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58892 (request call id 15) took 2849 ms. Trace:
I20260709 13:01:34.894131  9263 rpcz_store.cc:276] 0709 13:01:32.037118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.037382 (+   264us) service_pool.cc:224] Handling call
0709 13:01:32.220255 (+182873us) ts_tablet_manager.cc:934] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
0709 13:01:33.363730 (+1143475us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:33.607737 (+244007us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:33.621686 (+ 13949us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:34.885010 (+1263324us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:34.885326 (+   316us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:34.885721 (+   395us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:34.885826 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10789,"tablet-copy.queue_time_us":181555,"thread_start_us":248475,"threads_started":2}
I20260709 13:01:34.896092  9263 tablet_copy_client.cc:806] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:34.886667  9292 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:34.896665  9292 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:34.897143  9292 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.896185  9288 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:34.897616  9288 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:34.898036  9288 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.898219  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.899619  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.900756  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.902328  9263 tablet_copy_client.cc:670] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:34.903467  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:34.908943  9231 consensus_meta.cc:287] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 1.345s	user 0.020s	sys 0.003s
I20260709 13:01:34.909384  9231 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:34.910774  8387 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 2.
W20260709 13:01:34.911396  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 129599us
W20260709 13:01:34.912309  8359 connection.cc:256] RPC call timeout handler was delayed by -1.3403929400000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 13:01:34.912870  9231 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:34.912933  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.915377  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.916141  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.907955  9292 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:34.920039  8358 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:34.923708  9292 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:34.923928  9293 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:34.924497  9293 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:01:34.917186  8359 connection.cc:256] RPC call timeout handler was delayed by -1.3272968359999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 13:01:34.925014  9293 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.925222  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:34.925904  8359 connection.cc:256] RPC call timeout handler was delayed by -1.2170859270000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:01:34.925998  8463 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
W20260709 13:01:34.926506  8359 connection.cc:256] RPC call timeout handler was delayed by -1.202643084999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:01:34.926914  8359 connection.cc:256] RPC call timeout handler was delayed by -1.2003968359999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 13:01:34.926877  8463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 585) took 1292 ms (client timeout 1568 ms). Trace:
W20260709 13:01:34.927466  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1904968359999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:01:34.927886  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.928417  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1796968359999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
I20260709 13:01:34.918991  9290 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:34.930135  8358 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:34.931154  9290 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:34.923026  8394 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
W20260709 13:01:34.927642  8463 rpcz_store.cc:269] 0709 13:01:33.634853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.636350 (+  1497us) service_pool.cc:224] Handling call
0709 13:01:34.924988 (+1288638us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:34.926766 (+  1778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4910976}
W20260709 13:01:34.928828  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1786410729999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:01:34.931340  8358 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:34.942560  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:34.942984  9292 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:34.942977  8358 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:34.943325  8461 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
W20260709 13:01:34.943063  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1606497610000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:01:34.944546  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1378544479999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:01:34.944816  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1270929400000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:01:34.945057  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0374968360000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 13:01:34.945288  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0148410729999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 13:01:34.943612  9292 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:34.946069  9292 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.940578  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:34.947086  8388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 512) took 2318 ms (client timeout 1973 ms). Trace:
I20260709 13:01:34.938784  9288 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:34.947480  8388 rpcz_store.cc:269] 0709 13:01:32.628917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.259849 (+630932us) service_pool.cc:224] Handling call
0709 13:01:34.940456 (+1680607us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2eee 0000000000375939 00007fbe184361e0 00007fbe184ff0c4 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:34.947009 (+  6553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18880256}
I20260709 13:01:34.951553  9287 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:34.952000  9287 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:34.952353  9287 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.932063  9289 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:34.961113  8393 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:34.957669  9289 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:34.962986  9289 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.966265  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 514) took 2334 ms. Trace:
I20260709 13:01:34.966883  8393 rpcz_store.cc:276] 0709 13:01:32.629484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.699737 (+1070253us) service_pool.cc:224] Handling call
0709 13:01:34.938359 (+1238622us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:34.938636 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.961642 (+ 23006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.964034 (+  2392us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b540024a254. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:34.964219 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49715328}
I20260709 13:01:34.971733  9288 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:34.972092  9233 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:34.973716  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 577) took 2457 ms. Trace:
I20260709 13:01:34.974133  8395 rpcz_store.cc:276] 0709 13:01:32.516417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.289233 (+772816us) service_pool.cc:224] Handling call
0709 13:01:34.973249 (+1684016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.973457 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.973480 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.973520 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:34.973547 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.973601 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.973674 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.985445  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:34.986249  8536 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.987427  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:34.988035  8536 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.988997  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:34.990420  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:34.991617  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:34.992481  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:34.992777  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:34.993350  8536 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.994270  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:34.995416  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:34.995961  8536 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:34.996879  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 578) took 2480 ms. Trace:
I20260709 13:01:34.998674  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:34.999547  9290 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:34.999987  9290 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:35.000394  9290 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.999707  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 503) took 1603 ms. Trace:
I20260709 13:01:34.997243  8392 rpcz_store.cc:276] 0709 13:01:32.516779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.289332 (+772553us) service_pool.cc:224] Handling call
0709 13:01:34.996388 (+1707056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.996590 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.996615 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.996656 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:34.996685 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.996737 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.996831 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.003916  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:35.004235  9294 consensus_queue.cc:1059] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:35.004724  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 61840us
I20260709 13:01:35.001904  8538 rpcz_store.cc:276] 0709 13:01:33.396349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.396499 (+   150us) service_pool.cc:224] Handling call
0709 13:01:33.396802 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.695787 (+298985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.999442 (+1303655us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54002b7354. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:34.999624 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685968640}
I20260709 13:01:35.006480  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.007110  8538 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
W20260709 13:01:35.003466  8416 debug-util.cc:398] Leaking SignalData structure 0x7b08001986e0 after lost signal to thread 7286
I20260709 13:01:35.007767  9289 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.009956  9289 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.005496  8358 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.010408  9293 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.011471  8358 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:35.012428  9293 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.013391  9289 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.015015  9289 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.015439  9289 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.015245  9032 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.023335  9032 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.002439  9287 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.013046  9293 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.021588  9069 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.031576  9273 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:35.024667  9290 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.026875  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:34.996805  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.028385  8358 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.024142  9295 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.044514  9296 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:35.045244  9230 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:35.045881  9265 raft_consensus.cc:3055] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.047751  9287 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.062131  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.062713  8470 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:35.049751  9289 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.051795  9290 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.052353  9288 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.056185  9295 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:35.057595  8416 debug-util.cc:398] Leaking SignalData structure 0x7b0800060180 after lost signal to thread 8327
I20260709 13:01:35.057971  9230 raft_consensus.cc:3055] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.058059  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.056742  9293 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.059315  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:35.070559  8462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 588) took 1373 ms (client timeout 1560 ms). Trace:
I20260709 13:01:35.058555  9296 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:35.056921  9265 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:35.074352  9296 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:35.066226  9288 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:35.068213  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 80426.1us
I20260709 13:01:35.053455  9292 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.067193  9295 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:35.070966  8462 rpcz_store.cc:269] 0709 13:01:33.701902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.706131 (+  4229us) service_pool.cc:224] Handling call
0709 13:01:35.057969 (+1351838us) spinlock_profiling.cc:243] Waited 917 us on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2f8c 00007fbe103c2ef6 0000000000375939 00007fbe184361e0 00007fbe184ff0c4 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:35.070490 (+ 12521us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112000}
I20260709 13:01:35.073127  9289 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.064013  8358 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.067133  9230 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:35.086184  9295 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.074172  9265 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:35.086611  9230 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:35.087630  9265 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.075655  9288 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.088114  9230 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.078805  8358 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:35.078881  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:35.080091  9289 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.092237  9289 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.092638  9289 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.090662  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.091961  9069 raft_consensus.cc:2393] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 2: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:01:35.097939  9287 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.100129  9066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58882 (request call id 37) took 1358 ms. Trace:
I20260709 13:01:35.095397  8358 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:35.101821  8508 connection.cc:256] RPC call timeout handler was delayed by -1.3449960160000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 13:01:35.102566  8508 connection.cc:256] RPC call timeout handler was delayed by -1.2891960160000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 13:01:35.102614  8358 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:35.103091  8508 connection.cc:256] RPC call timeout handler was delayed by -1.2675960160000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
I20260709 13:01:35.100587  9066 rpcz_store.cc:276] 0709 13:01:33.741767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.099230 (+1357463us) service_pool.cc:224] Handling call
0709 13:01:35.100058 (+   828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.109876  9286 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.113500  9287 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.110320  9286 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.094421  9293 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.113716  9299 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:35.115836  9287 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.111694  9289 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.120694  9275 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.112557  8358 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:35.110183  8508 connection.cc:256] RPC call timeout handler was delayed by -1.1873174469999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:01:35.118214  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.119657  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.125660  8358 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.126212  8543 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:35.128559  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 513) took 1579 ms. Trace:
I20260709 13:01:35.129139  9297 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.117740  9293 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.129664  9297 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.129914  9293 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.130162  9275 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:35.130651  9275 raft_consensus.cc:697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:35.131657  9275 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:35.135748  9289 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.116473  9286 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.121582  9287 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.121304  9299 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:35.139659  9299 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:35.142238  8542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 510) took 1628 ms (client timeout 1631 ms). Trace:
W20260709 13:01:35.142679  8542 rpcz_store.cc:269] 0709 13:01:33.514014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.522673 (+  8659us) service_pool.cc:224] Handling call
0709 13:01:35.119503 (+1596830us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:35.142173 (+ 22670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43363200}
I20260709 13:01:35.145747  8358 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:35.147027  9292 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.148098  9279 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.148488  9279 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.148931  9279 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.149093  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 499) took 1754 ms. Trace:
I20260709 13:01:35.150146  9290 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.151103  9290 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.151513  9290 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.130175  9297 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.149570  8537 rpcz_store.cc:276] 0709 13:01:33.395142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.397781 (+  2639us) service_pool.cc:224] Handling call
0709 13:01:33.508016 (+110235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.572260 (+ 64244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.148835 (+1576575us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b540037cb54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:35.149032 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146340096}
I20260709 13:01:35.153581  8358 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:35.155290  8358 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.128925  8543 rpcz_store.cc:276] 0709 13:01:33.549241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.549554 (+   313us) service_pool.cc:224] Handling call
0709 13:01:35.118078 (+1568524us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:35.128459 (+ 10381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9396608}
I20260709 13:01:35.155023  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.124979  9295 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.161536  8535 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:35.163870  9263 tablet_copy_client.cc:538] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.165391  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 592) took 1445 ms. Trace:
I20260709 13:01:35.165843  8465 rpcz_store.cc:276] 0709 13:01:33.719772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.719870 (+    98us) service_pool.cc:224] Handling call
0709 13:01:33.721754 (+  1884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.164394 (+1442640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.164432 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.164505 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:35.164545 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.164615 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.164729 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3613952}
I20260709 13:01:35.168241  9301 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.155323  9289 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.171653  9289 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.172123  9289 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.173645  9222 tablet_copy_client.cc:538] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.177320  9263 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:01:35.177997  9301 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.179462  9301 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:35.168812  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 73592.9us
I20260709 13:01:35.140018  9288 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.181016  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.184437  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:35.185519  8541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 512) took 1642 ms (client timeout 2070 ms). Trace:
W20260709 13:01:35.185915  8541 rpcz_store.cc:269] 0709 13:01:33.543572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.543730 (+   158us) service_pool.cc:224] Handling call
0709 13:01:35.184287 (+1640557us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:35.185465 (+  1178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4920704}
I20260709 13:01:35.193917  9221 tablet_copy_client.cc:538] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.194319  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.194953  8541 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 1.
I20260709 13:01:33.991986  9232 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.196223  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:35.197271  9232 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:35.197309  9299 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.198239  9299 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:35.198603  9299 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.211692  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.212539  8470 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.219188  9287 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.219683  9296 consensus_queue.cc:1059] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.220568  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.221119  9294 raft_consensus.cc:3055] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.221288  8539 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:35.225195  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.226222  8386 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:35.226733  8386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 524) took 1976 ms (client timeout 2225 ms). Trace:
I20260709 13:01:35.226773  9286 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.227193  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.228245  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.228639  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.229178  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.229292  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.229765  8465 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.229852  8462 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.232651  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:35.233448  8468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48784 (request call id 9) took 1601 ms (client timeout 1971 ms). Trace:
I20260709 13:01:35.221518  9287 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.221522  9294 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:35.227262  8386 rpcz_store.cc:269] 0709 13:01:33.250186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.289955 (+ 39769us) service_pool.cc:224] Handling call
0709 13:01:35.226637 (+1936682us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:35.288197  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 132971us
I20260709 13:01:35.291690  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.292358  8465 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.293818  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.295646  9286 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.297340  9293 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.299324  8358 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:35.293118  8508 leader_election.cc:336] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.072s (SENT)
W20260709 13:01:35.237043  8468 rpcz_store.cc:269] 0709 13:01:33.638031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.640839 (+  2808us) service_pool.cc:224] Handling call
0709 13:01:35.232497 (+1591658us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:35.233388 (+   891us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11785984}
I20260709 13:01:35.307222  8508 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.240867  9297 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.308025  9294 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.311506  9294 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.314306  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.316529  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.317122  8465 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.318544  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.319067  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.319885  8544 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.319767  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.319334  8541 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.320528  8542 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.321920  9288 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.322232  9232 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.322073  9289 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:35.310207  8416 debug-util.cc:398] Leaking SignalData structure 0x7b0800333540 after lost signal to thread 8419
W20260709 13:01:35.339933  8416 debug-util.cc:398] Leaking SignalData structure 0x7b0800333500 after lost signal to thread 8420
I20260709 13:01:35.340679  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.348913  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:35.379894  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 86801.5us
I20260709 13:01:35.381572  9033 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:35.382521  9276 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.308923  9286 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.383849  9286 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:35.384204  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.385345  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:35.399798  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 84632.7us
I20260709 13:01:35.387629  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.385680  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.402176  8537 raft_consensus.cc:2393] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:01:35.384791  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.405115  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.406415  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.380664  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.384253  9286 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.380797  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:35.412387  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.413126  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.413921  8393 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.414356  9222 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:01:35.412467  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.418748  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.408972  9299 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:35.423311  9066 raft_consensus.cc:1240] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.424036  9299 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.411089  8536 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.446556  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.447203  8543 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.722779  9228 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.448699  8540 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.411398  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.451893  8468 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.456521  9297 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.409448  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.457432  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.457698  8538 raft_consensus.cc:2393] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.458138  8462 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.459298  9274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6becd976429a45a3874a10895b19b63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.451254  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 502) took 2055 ms. Trace:
W20260709 13:01:35.475412  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.476874  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.468106  8540 rpcz_store.cc:276] 0709 13:01:33.396035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.396157 (+   122us) service_pool.cc:224] Handling call
0709 13:01:33.396478 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.449096 (+2052618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.451003 (+  1907us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400189cd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:35.451193 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4718911360}
W20260709 13:01:35.478132  8416 debug-util.cc:398] Leaking SignalData structure 0x7b0800332d00 after lost signal to thread 8494
W20260709 13:01:35.478471  8416 debug-util.cc:398] Leaking SignalData structure 0x7b0800332ca0 after lost signal to thread 8495
I20260709 13:01:35.478575  9246 consensus_queue.cc:1059] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:35.479429  8416 debug-util.cc:398] Leaking SignalData structure 0x7b080034a640 after lost signal to thread 8568
I20260709 13:01:35.479626  9246 raft_consensus.cc:3055] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.479969  9246 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:01:35.480535  8416 debug-util.cc:398] Leaking SignalData structure 0x7b0800330040 after lost signal to thread 9093
W20260709 13:01:35.481000  8416 debug-util.cc:398] Leaking SignalData structure 0x7b0800330240 after lost signal to thread 9244
W20260709 13:01:35.481283  8416 debug-util.cc:398] Leaking SignalData structure 0x7b0800330540 after lost signal to thread 9250
W20260709 13:01:35.481621  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.487498  9228 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:35.487780  9286 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.491942  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.480736  9246 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:35.493409  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.494087  9246 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.494675  9286 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.497844  9290 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.498245  8289 catalog_manager.cc:5697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 2 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:35.499161  8390 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.506542  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.507191  8390 raft_consensus.cc:2393] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.508519  8543 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 2.
I20260709 13:01:35.407894  9301 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:35.528503  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.543450  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.591697  8392 raft_consensus.cc:2393] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.539716  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.544658  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.538166  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.527611  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.593518  8390 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.543067  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.546134  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.599177  8543 raft_consensus.cc:2393] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.593612  8395 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.541224  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.594844  8535 raft_consensus.cc:1240] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.544260  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.596314  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.543841  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.545297  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.518510  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:35.527557  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.601096  8393 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.599884  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.599779  8466 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
W20260709 13:01:35.615530  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 391344us
I20260709 13:01:35.615842  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.616096  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.616627  8393 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.616751  8469 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.517920  9293 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.520007  9290 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.618662  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.619273  8470 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.619989  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.531924  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.621979  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.544823  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.539222  9301 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.621308  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.617734  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.628523  8466 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.628903  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.630802  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:35.631711  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 115381us
I20260709 13:01:35.632146  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.632766  9299 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:35.614174  8463 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.633338  9299 raft_consensus.cc:697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:35.634514  9299 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:35.635480  8393 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:35.638617  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.639277  8470 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.630880  8394 raft_consensus.cc:2393] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.641625  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.642899  8393 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.647691  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.648802  8393 raft_consensus.cc:2393] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.649945  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.650691  8543 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.652405  9275 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:35.653693  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.654414  8536 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.653666  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.651901  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:35.655812  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.656708  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:35.643337  9289 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.660171  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.661142  8539 raft_consensus.cc:2393] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.662082  8465 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:35.662225  9294 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.662170  8535 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:35.662961  9298 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.663414  9298 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:35.663833  9298 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.650974  8386 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.664436  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.666563  9307 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.670368  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:35.672202  9279 consensus_meta.cc:287] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.523s	user 0.015s	sys 0.000s
I20260709 13:01:35.676656  9279 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.679075  9279 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.680747  8536 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:35.670799  9307 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:35.682061  9307 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.666515  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:35.683719  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.682571  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.683311  8465 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.685073  8395 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.685177  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.686772  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:35.671657  9296 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.691965  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.687372  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.693189  8395 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.683812  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.686132  9294 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.694204  9300 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.694447  9294 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:35.694662  9300 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:35.694903  9294 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.695070  9300 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.683032  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.697271  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:35.691316  9296 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:35.698966  9296 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.700145  9296 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.701246  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.706189  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.707734  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.705577  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.709570  8465 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:35.710709  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.711092  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.711381  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.711970  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.709614  8469 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.797640  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.712553  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:35.766345  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 69144us
I20260709 13:01:35.797300  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.748978  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.801888  8395 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.797613  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.703249  9221 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:01:35.803547  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.803586  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.806354  8465 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.807333  8464 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.801815  8393 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:35.805619  8467 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.809703  8392 raft_consensus.cc:1240] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.803920  8386 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.811075  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.815250  9296 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.817045  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.743858  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.812570  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.731564  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.827664  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.819314  8461 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.820287  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.703320  9265 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 13:01:35.836320  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.837474  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.819555  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.846611  8388 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.828909  9307 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.849401  9294 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.819816  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.837651  8389 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.839035  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.820024  9296 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:35.852970  9296 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.841156  8392 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.812022  8465 raft_consensus.cc:2376] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2. Re-sending same reply.
I20260709 13:01:35.842260  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.823300  9299 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:01:35.882822  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.906939  8395 raft_consensus.cc:2393] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.909014  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.882256  8387 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:35.900043  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.911019  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.909183  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:35.886193  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.882207  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.854331  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.906394  9265 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.916177  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.918319  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.927829  8393 raft_consensus.cc:2393] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.915676  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.931205  8462 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:35.932538  9307 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.925952  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.920854  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.930189  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.909934  9294 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:35.849068  9298 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:35.937073  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:35.937904  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:35.947013  8394 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.882296  9309 consensus_queue.cc:1059] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:01:35.933136  8464 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:35.933652  9265 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:35.959426  8388 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:35.963496  8387 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.965638  8470 raft_consensus.cc:2393] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:35.965652  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.966729  8390 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:35.984050  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51214.8us
I20260709 13:01:35.991233  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:35.988255  8461 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:35.992657  8390 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:35.998008  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 192107us
I20260709 13:01:35.998389  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:35.999249  8543 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:36.003924  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.004886  8543 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:36.002781  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.006075  8541 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.000180  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:36.007701  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.020955  8543 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:36.010746  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.022293  8542 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:36.009516  8387 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.007627  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.017056  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.029712  8544 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:36.023463  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:36.009752  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.015800  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.034083  8540 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:36.042615  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:36.042948  9315 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.043335  9315 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.043689  9315 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.044806  8394 raft_consensus.cc:2393] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:36.045720  9294 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.046135  9294 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.046533  9294 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.046744  9296 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.048032  8466 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:36.048899  9296 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.049187  9317 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.049584  9317 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.050628  9317 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.009631  9300 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.055538  9300 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:36.056737  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.066392  8541 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:36.059628  9274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58874 (request call id 14) took 3625 ms. Trace:
I20260709 13:01:36.073454  9274 rpcz_store.cc:276] 0709 13:01:32.434536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.437175 (+  2639us) service_pool.cc:224] Handling call
0709 13:01:33.115534 (+678359us) ts_tablet_manager.cc:934] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
0709 13:01:35.384070 (+2268536us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:35.811604 (+427534us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:35.819675 (+  8071us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:36.058822 (+239147us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:36.059179 (+   357us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.059493 (+   314us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:36.059566 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":355,"tablet-copy.queue_time_us":475224,"thread_start_us":395678,"threads_started":2}
I20260709 13:01:36.075028  9274 tablet_copy_client.cc:806] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:36.075541  9274 tablet_copy_client.cc:670] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:36.077098  9298 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:36.078121  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.070289  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.084081  9294 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.087817  8387 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:36.015987  9265 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.090318  9275 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:36.090740  9265 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.049518  9296 consensus_queue.cc:1059] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:01:36.095964  9307 raft_consensus.cc:3055] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.096356  9307 raft_consensus.cc:740] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:36.096638  9317 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.097188  9298 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.098523  9298 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:36.099212  9317 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.099471  9298 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.100817  9294 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.097169  9307 consensus_queue.cc:260] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.106618  9307 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.112324  9263 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:36.115991  9222 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:36.151763  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.157428  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 153091us
I20260709 13:01:36.157132  9222 tablet_bootstrap.cc:492] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
W20260709 13:01:36.163632  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 155668us
I20260709 13:01:36.176622  9221 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:36.178486  9221 tablet_bootstrap.cc:492] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:01:36.180131  9221 ts_tablet_manager.cc:1403] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.477s	user 0.020s	sys 0.027s
I20260709 13:01:36.134187  9315 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.183525  9263 tablet_bootstrap.cc:492] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:01:36.184911  9263 ts_tablet_manager.cc:1403] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 1.008s	user 0.036s	sys 0.038s
I20260709 13:01:36.187039  9222 ts_tablet_manager.cc:1403] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.773s	user 0.051s	sys 0.029s
W20260709 13:01:36.196902  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 153396us
I20260709 13:01:36.206465  9222 raft_consensus.cc:359] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.207767  9222 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:01:36.208794  9222 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.212734  9222 ts_tablet_manager.cc:1434] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:01:36.201762  9298 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:36.218357  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.201763  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:36.247035  9315 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:36.254820  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 53143.6us
W20260709 13:01:36.257319  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58872.9us
I20260709 13:01:36.258950  9232 consensus_queue.cc:1059] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:36.259995  9326 raft_consensus.cc:3055] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.260401  9326 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:36.261448  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-ef4deccb7c274fec97786db5d6131514 received from {username='slave'} at 127.0.0.1:60598
I20260709 13:01:36.262180  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-ef4deccb7c274fec97786db5d6131514 on tablet ef4deccb7c274fec97786db5d6131514 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:36.257206  9228 raft_consensus.cc:2764] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:01:36.265003  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.268085  9221 raft_consensus.cc:359] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.269181  9221 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:01:36.261340  9326 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.271334  9221 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.272152  9326 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.275185  8508 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.276736  9319 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.277215  9066 raft_consensus.cc:1217] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:36.282097  9263 raft_consensus.cc:359] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.283226  9263 raft_consensus.cc:740] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:01:36.284421  9263 consensus_queue.cc:260] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.287288  9263 ts_tablet_manager.cc:1434] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.000s
I20260709 13:01:36.294768  8508 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.273900  9221 ts_tablet_manager.cc:1434] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.001s
I20260709 13:01:36.276034  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.301090  8508 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.304052  9314 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.304582  9314 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.305043  9314 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.305490  9233 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.306003  9233 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.306416  9233 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:36.314306  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55828us
I20260709 13:01:36.314518  8508 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.315128  8358 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:36.315368  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.316313  9228 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.316313  9315 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.316869  9279 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.316990  9228 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.317462  9279 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:36.317564  9228 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.318697  9279 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.321965  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:36.322263  8480 tablet_copy_service.cc:342] P d2a645dcec4c479ba4c94d075b1bc98c: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-13811dee93af4290bdcf7d73b527d0f4 received from {username='slave'} at 127.0.0.1:48784
I20260709 13:01:36.322649  9298 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.323966  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-7219cc411cf6498f8f250f689007874f received from {username='slave'} at 127.0.0.1:60598
I20260709 13:01:36.324815  8480 tablet_copy_service.cc:434] P d2a645dcec4c479ba4c94d075b1bc98c: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-13811dee93af4290bdcf7d73b527d0f4 on tablet 13811dee93af4290bdcf7d73b527d0f4 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:36.325083  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-7219cc411cf6498f8f250f689007874f on tablet 7219cc411cf6498f8f250f689007874f with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:36.326001  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.328543  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.328895  8508 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.330741  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.332320  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.338099  9324 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.338186  9296 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.338755  9324 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.338806  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.339227  9324 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.339720  9296 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.340071  9296 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.340143  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.340520  9296 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.340958  9307 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.344303  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.342146  8289 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 2 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.346154  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:01:36.347254  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.347206  9258 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.348105  9258 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.348563  9258 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.331933  9230 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.351477  9230 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.351874  9230 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.352900  9296 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.356587  9258 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.327737  9298 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.357618  9307 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.357395  9228 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.330447  9326 consensus_queue.cc:1059] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:01:36.370198  9319 raft_consensus.cc:3055] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.370620  9319 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:36.371522  9319 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.372818  9319 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.380133  9230 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.359071  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.357467  9273 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:36.380856  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 48970us
I20260709 13:01:36.381520  9314 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.382833  9296 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.355896  8508 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.385380  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.384392  9273 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.387377  9273 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.387511  9265 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.388336  9314 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.387004  9298 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.388922  9232 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.389035  8433 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.390754  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.391280  9298 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.391664  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.392400  9232 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.392885  9296 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.393417  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.383314  9307 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.394266  9232 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.394666  9307 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.385423  8358 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:36.395459  9289 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.396030  9289 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:36.395370  8508 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.396855  9232 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.396862  9289 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.402935  8508 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.404949  9232 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.405453  9232 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.405890  9232 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.394121  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.407828  9324 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.408681  9298 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.394837  9233 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.383793  9228 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.435858  8508 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.408280  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.420677  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.436990  8394 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:36.437395  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.423473  9315 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.439721  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.427901  9230 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.428763  9314 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:36.431044  9273 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.442543  9230 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.442945  9230 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:36.444000  9230 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.445701  9315 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:36.450188  8359 leader_election.cc:336] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.500s (SENT)
I20260709 13:01:36.446252  9315 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.451566  9315 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.453397  9307 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:36.465709  8359 leader_election.cc:336] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.511s (SENT)
I20260709 13:01:36.469367  9307 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.444882  9273 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.431583  9232 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.433750  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:36.474061  8359 leader_election.cc:336] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.521s (SENT)
I20260709 13:01:36.422691  8539 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.474588  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.479425  9315 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.482616  8538 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.483289  9232 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.488399  9292 consensus_queue.cc:1059] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:36.489972  9279 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.490412  9279 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:36.491331  9279 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.492688  9279 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.497002  9328 consensus_queue.cc:1059] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:36.437636  8508 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.437999  9298 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.438323  9324 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.438447  9228 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.435717  9258 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.421659  8536 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.502192  9301 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.507355  9292 consensus_queue.cc:1059] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:36.508337  9292 raft_consensus.cc:3055] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.508675  9292 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:01:36.498589  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 61008.1us
I20260709 13:01:36.503867  8539 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.510833  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.504325  9315 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.504703  9328 raft_consensus.cc:3055] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.511685  9328 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:36.509575  9292 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.512640  9233 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.512601  9328 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.513933  9292 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.515064  9228 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.502560  9232 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.514055  9328 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.515633  9228 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.516098  9228 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.518884  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.520598  9233 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.521003  9233 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.521351  9233 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.515825  9232 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.522485  9232 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.520071  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:36.525260  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 109286us
I20260709 13:01:36.524891  8508 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.527163  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.528172  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:36.528350  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.529350  8508 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.530267  8508 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.531701  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.532500  8508 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.533342  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.535120  8508 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.524852  9258 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.530804  9273 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.540933  9273 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.541141  9258 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.541360  9273 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.541908  9258 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.542564  9258 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.543264  9307 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.543676  9307 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.544065  9307 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.512529  9301 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:01:36.533648  9319 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.540216  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.535867  9326 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.551033  9326 raft_consensus.cc:697] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:36.552121  9326 consensus_queue.cc:237] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.553419  9298 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.553083  9273 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.553853  9298 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.553966  9230 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.554291  9298 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.555524  9273 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.533327  9324 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.533522  9296 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.562844  9296 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.563268  9296 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:36.565138  8359 leader_election.cc:336] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.615s (SENT)
I20260709 13:01:36.565639  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.569358  9228 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.571723  9228 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.572945  9328 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.573447  9328 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:36.574648  9328 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:36.575513  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.576120  8359 leader_election.cc:336] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.531s (SENT)
I20260709 13:01:36.576628  8359 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.579150  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.557035  9258 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.585944  9258 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:36.588198  9258 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:36.595227  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:36.596177  9066 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:36.598625  8509 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:36.603614  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 91668.4us
I20260709 13:01:36.599680  9289 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.606449  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.610725  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.601364  9292 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.609525  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.601640  9230 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:36.617825  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 84547.4us
I20260709 13:01:36.619498  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.614329  9265 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.620886  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.620262  9324 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.618350  9230 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.609134  9307 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.622402  9315 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.628188  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.625598  9265 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.628607  9230 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.641062  8507 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.643257  9328 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.648075  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.630483  9315 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.639045  9265 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.649577  8289 catalog_manager.cc:5697] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.648531  9336 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.633452  9298 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.654107  9315 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.655676  9298 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.660966  9233 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.664084  9307 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.654605  8289 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.664983  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.670115  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.634943  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.653192  9324 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.694177  9296 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.696331  9296 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.634202  9232 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:36.699784  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 164728us
I20260709 13:01:36.700672  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:36.701864  8508 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.703022  8508 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:36.703227  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 75124.2us
I20260709 13:01:36.704427  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.706786  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.707301  9319 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.707679  9233 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.703799  9258 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.707960  9319 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.708977  9265 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:36.711624  9275 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.712218  8288 catalog_manager.cc:5697] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 2, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.713375  8539 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.713953  8538 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.725020  9275 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:36.714228  8536 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.714100  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.702308  9336 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.726830  9336 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:36.727233  9336 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.727650  9275 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.729348  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:36.730039  8392 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 1.
I20260709 13:01:36.703887  9228 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.731218  9032 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:01:36.704463  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:36.720259  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.734889  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.735029  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:36.735460  9265 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.735751  8463 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 2.
I20260709 13:01:36.739504  9275 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:36.739912  9275 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.740747  9336 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.742364  9232 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.742729  9336 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:36.742967  9275 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.744616  9319 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.736195  9265 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.736335  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.736604  9296 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.707887  8508 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.749536  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.751227  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.720992  9315 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.759531  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.760869  8394 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:36.761991  8536 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:36.762941  9307 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.765156  9315 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:36.765951  9289 consensus_queue.cc:1059] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:36.766207  9328 consensus_queue.cc:1059] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:36.767043  9301 raft_consensus.cc:3055] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.767271  9328 raft_consensus.cc:3055] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.767391  9301 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:36.768332  9301 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.768752  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:36.748875  9265 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.769865  9324 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.770887  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:36.771147  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 63321.1us
I20260709 13:01:36.770010  9335 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:01:36.769551  9292 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:36.885428  9292 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.885993  9292 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:36.886564  8387 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:36.886942  9292 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.760264  9339 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.773335  9319 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.767716  9328 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:36.889457  9328 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.890805  9328 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.773563  9315 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.895743  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:36.809162  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 231478us
I20260709 13:01:36.900009  8541 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:36.901897  8359 leader_election.cc:336] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.628s (SENT)
I20260709 13:01:36.868376  8538 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.902350  8541 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.869244  8536 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.903996  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:36.905347  9336 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.905752  8507 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:36.906031  9336 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:36.907054  9334 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.907588  9334 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:36.907176  9336 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.907897  8541 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.908434  9334 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:36.910624  8359 leader_election.cc:336] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.563s (SENT)
W20260709 13:01:36.912755  8359 leader_election.cc:336] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.588s (SENT)
W20260709 13:01:36.866271  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.769456  9301 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:36.874873  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.875105  8388 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:36.917749  8538 raft_consensus.cc:1240] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.875227  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:36.877336  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.919763  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 44616.6us
I20260709 13:01:36.920056  9338 raft_consensus.cc:1064] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:36.920898  8508 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.921044  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.921953  9233 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.922745  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.922461  9338 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:36.773244  9324 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:36.924226  9324 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:36.926221  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.773392  9307 consensus_queue.cc:1059] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:36.927161  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.929066  9296 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.929447  9296 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:36.930169  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.930620  9296 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:36.931345  8388 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:36.932377  8538 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.932492  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.931787  9296 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.934195  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.934646  8468 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.935921  8535 raft_consensus.cc:1240] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.935945  8461 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.937582  8535 raft_consensus.cc:1240] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.938846  8466 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.939160  8468 raft_consensus.cc:1240] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.939260  8535 raft_consensus.cc:1240] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.772307  9265 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.871459  9275 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:36.951321  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.914888  8541 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.921993  9232 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.769492  9230 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:36.944809  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.946108  8470 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.966297  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.946499  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.946666  8507 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:36.967199  8466 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.967370  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.946899  8538 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.947299  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.947762  8535 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.949643  8465 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.979243  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.949733  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.952867  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.981840  8393 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:36.955423  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.983191  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.960860  8390 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.914083  9292 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.987208  8537 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.972376  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:36.972675  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 59947.1us
I20260709 13:01:36.966645  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.986533  8544 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.987154  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.933579  9233 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.970928  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.948393  9319 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:36.988991  8359 leader_election.cc:336] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.591s (SENT)
I20260709 13:01:36.989367  8469 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.995301  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.995573  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:36.947984  8464 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.989640  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.990612  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.988883  8470 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.992486  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.999626  8467 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:36.988883  8465 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:36.994457  8393 raft_consensus.cc:1240] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.947975  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.997084  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:36.998805  8390 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.000324  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:36.993037  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.000938  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:36.962329  9335 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:37.007268  8465 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.012449  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.008256  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.004375  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.986246  9340 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.016474  8542 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.993372  8468 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.010694  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:36.991802  9342 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.995018  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.037534  9352 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:37.041621  8465 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:37.042954  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.046868  9275 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:37.035452  8540 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.048596  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.048818  9324 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:36.990281  9289 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:36.990407  9301 consensus_queue.cc:1059] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:37.051595  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.017747  8461 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.994438  9279 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:37.056015  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.056651  8467 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.019402  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.026993  8539 raft_consensus.cc:2368] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3.
I20260709 13:01:37.055168  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.054400  8469 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.017303  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.052026  8391 raft_consensus.cc:1240] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.063851  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.017935  9335 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:37.064381  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.064754  8469 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:37.073307  8470 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.073884  9230 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:37.074128  8462 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.078032  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.079115  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.064091  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.082074  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.082748  8467 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.083688  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.084208  8467 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.053224  9342 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.089263  8466 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.089649  8468 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.090633  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.058533  8463 raft_consensus.cc:1240] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.074731  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:37.082185  9344 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:01:37.091150  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.098870  8466 raft_consensus.cc:2393] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.099751  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.099670  9342 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:37.101047  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.101692  8466 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:37.102515  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.092425  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.102890  9315 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.098126  8464 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.098556  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:37.103947  9066 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.104199  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.104898  8464 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.105765  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.087067  9340 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.083968  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.111379  8470 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:37.116063  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.118618  8470 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.113862  8466 raft_consensus.cc:2393] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.091180  8468 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:37.113122  8464 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.121465  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.126875  8470 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:37.129936  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.135361  8470 raft_consensus.cc:2393] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.140154  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.141265  8466 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.144313  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.142257  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.146106  8466 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.147622  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.148397  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.149159  8469 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:37.148411  8468 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.153702  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.109529  9265 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.158087  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.163821  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.166970  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.164589  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.168018  8466 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.156982  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.170825  8465 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.171933  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.173075  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.174649  8461 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.175040  8462 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.175782  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.176061  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.176357  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.176770  8462 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:37.177024  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.176879  8464 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.180744  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:37.180374  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 191398us
I20260709 13:01:37.176136  9232 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:37.183884  8359 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.595s (SENT)
W20260709 13:01:37.184283  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 188721us
I20260709 13:01:37.187147  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.180357  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.186092  8467 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.189467  8541 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:37.186305  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:37.190987  8359 leader_election.cc:336] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.598s (SENT)
W20260709 13:01:37.191876  8359 leader_election.cc:336] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.628s (SENT)
I20260709 13:01:37.192225  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:37.193106  8359 leader_election.cc:336] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.632s (SENT)
I20260709 13:01:37.196367  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:37.197284  8359 leader_election.cc:336] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.637s (SENT)
I20260709 13:01:37.197654  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.198675  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.199295  8468 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.179869  9066 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:37.194842  9338 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.201870  8541 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.202164  9338 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:37.202232  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.202643  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.203406  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.203147  9338 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.203917  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.204454  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.205118  8467 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.206737  9338 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.207391  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.207973  8387 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.206811  9265 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:37.214268  8509 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:37.218273  9349 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.204738  8462 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.218966  9349 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.219549  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.220849  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.221589  8462 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:37.223721  9066 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:37.224932  9274 tablet_copy_client.cc:538] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:37.225989  9324 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:37.226790  9233 consensus_queue.cc:1059] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:37.226850  9348 consensus_queue.cc:1059] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:37.227582  9230 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:37.227929  9233 raft_consensus.cc:3055] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.182929  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.226871  9273 consensus_queue.cc:1059] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:37.228113  9348 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.228583  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.228790  9348 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.229097  9273 raft_consensus.cc:3055] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.229446  9335 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:37.229678  9348 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.231205  9348 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.228097  9230 raft_consensus.cc:697] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.232621  8466 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.219760  9338 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.235733  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.235948  8541 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.237524  8390 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:37.238224  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.238940  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.239328  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:37.241124  9335 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:37.242813  8389 raft_consensus.cc:1240] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.229488  9273 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.244524  8468 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.238862  8469 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.247385  8390 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:37.248430  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.248922  8466 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.250229  8470 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.252907  8393 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.254801  8393 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:37.254902  8508 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.257258  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.257566  8470 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.259356  8469 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.260010  8466 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 3.
I20260709 13:01:37.263388  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:37.267099  8466 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.268296  8466 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.266268  8386 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.268831  9033 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:37.271003  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.272748  8465 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.274655  8465 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.201561  9336 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:01:37.275717  8465 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.271744  8466 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.228298  9233 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.258973  9232 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.278864  8469 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.279058  8468 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.279387  8466 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.261267  9351 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.266166  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.285836  8466 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.287608  8466 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.261456  9314 consensus_queue.cc:1059] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:37.261445  9258 consensus_queue.cc:1059] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:37.292512  8467 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:37.293957  8468 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.281293  9275 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:37.281468  8388 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.282326  9355 consensus_queue.cc:1059] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:37.285756  9319 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.309073  9358 consensus_queue.cc:1059] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:01:37.311103  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 47787us
I20260709 13:01:37.268671  9273 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.294612  9301 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:01:37.309988  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.313499  9273 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.314335  9233 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.315078  9275 raft_consensus.cc:697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
W20260709 13:01:37.316111  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 118825us
I20260709 13:01:37.291172  8535 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:37.337713  8359 leader_election.cc:336] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.691s (SENT)
I20260709 13:01:37.307091  9279 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:01:37.338716  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.325312  8386 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:37.339607  8288 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:37.341444  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.641s (SENT) [suppressed 86 similar messages]
W20260709 13:01:37.342819  8359 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.765s (SENT)
I20260709 13:01:37.347867  8359 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.311242  8387 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 3.
I20260709 13:01:37.281325  9230 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:37.317266  8464 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.355389  8468 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.353235  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:37.354408  8359 leader_election.cc:336] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.770s (SENT)
I20260709 13:01:37.356662  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.352880  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.358199  9359 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.361984  9292 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.342934  9319 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.363574  8462 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:37.363538  9319 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.364506  9233 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.336876  9351 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.344547  9279 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:01:37.365432  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 47589.6us
I20260709 13:01:37.368858  9279 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.369773  9279 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.370595  8508 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:37.372267  8508 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:01:37.365621  8359 leader_election.cc:336] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.794s (SENT)
I20260709 13:01:37.367005  9353 raft_consensus.cc:3055] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.353216  9349 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.367048  9334 consensus_queue.cc:1059] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:37.367569  9275 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:37.373219  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.380183  9361 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.366472  8461 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:37.383463  8359 leader_election.cc:336] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.885s (SENT)
I20260709 13:01:37.386123  8467 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.366576  9351 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:37.387485  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.375231  9353 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:37.390369  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.390973  8469 raft_consensus.cc:2376] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2. Re-sending same reply.
I20260709 13:01:37.379011  9359 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.398550  8469 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.377056  9258 consensus_queue.cc:1059] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:01:37.396942  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.402360  8468 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:37.402874  8467 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.403081  8469 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.405031  9228 raft_consensus.cc:3055] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.405296  9362 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.405469  9228 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.405905  9362 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.403280  8467 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:37.392993  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.408170  9292 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:37.410221  8541 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:37.413360  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.418398  8392 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:37.413126  9362 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.403462  8469 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:37.430570  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.434013  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.390995  9336 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 13:01:37.460521  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.468807  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.433946  8467 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.470378  8465 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.473069  8469 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:37.478484  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.478655  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.406417  9228 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.479317  8463 raft_consensus.cc:2376] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2. Re-sending same reply.
I20260709 13:01:37.456734  9279 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:01:37.460638  9351 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.485677  8467 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.489001  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.491135  8469 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.507002  9340 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.490633  9328 raft_consensus.cc:3055] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.487033  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.521011  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.507566  9340 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:01:37.534432  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.512775  9228 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:37.537364  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.519011  9328 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:01:37.546058  8359 leader_election.cc:336] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.056s (SENT)
I20260709 13:01:37.555653  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:37.556217  8359 leader_election.cc:336] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.095s (SENT)
W20260709 13:01:37.557204  8359 leader_election.cc:336] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.128s (SENT)
I20260709 13:01:37.522501  8463 raft_consensus.cc:2376] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2. Re-sending same reply.
I20260709 13:01:37.529778  9351 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.557755  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.554828  9361 raft_consensus.cc:697] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.564812  9361 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:37.482746  9353 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.580770  8467 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:37.591394  8469 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:37.563323  9279 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.590667  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.597653  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:37.598685  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.597223  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.590135  9354 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.600865  8469 raft_consensus.cc:2376] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2. Re-sending same reply.
I20260709 13:01:37.602622  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.603008  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:37.603235  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.599550  9353 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.611150  8391 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.611872  8387 raft_consensus.cc:1240] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.613276  8388 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:37.617440  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 245208us
W20260709 13:01:37.617566  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 244618us
I20260709 13:01:37.621189  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.602181  9354 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:37.624164  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.624379  8392 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.610062  9274 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:01:37.593184  9340 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.637347  9354 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.638302  9340 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:37.638813  9363 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:37.638914  9354 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.599771  9328 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.620330  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.643777  8464 raft_consensus.cc:2376] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2. Re-sending same reply.
I20260709 13:01:37.644696  9326 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.645169  9326 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.646152  9326 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.647562  9326 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:37.650736  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.653306  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.642410  8535 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.657737  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:37.659543  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.663751  8538 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.658382  8461 raft_consensus.cc:2376] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2. Re-sending same reply.
I20260709 13:01:37.666508  9338 consensus_queue.cc:1059] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:37.667475  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:37.671087  8389 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:37.672547  8462 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.681479  8394 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:37.643144  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:37.685922  8387 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:37.667598  9338 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:37.687992  9356 raft_consensus.cc:3055] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.688390  9356 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:37.688509  9338 raft_consensus.cc:3055] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.686954  9258 raft_consensus.cc:3055] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.697755  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.699425  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.700805  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:37.702266  9292 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.703642  9352 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:37.705711  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 84588.3us
I20260709 13:01:37.705962  9364 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.706598  8508 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:37.706748  9364 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.707854  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:37.688937  9338 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:37.710239  9376 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.710836  9362 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.694860  9258 raft_consensus.cc:740] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.705404  9273 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.716487  9359 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.717099  9355 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:37.721372  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:37.735317  9334 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:37.726583  9362 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:37.735541  9367 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
I20260709 13:01:37.742869  9232 raft_consensus.cc:3055] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.743479  9232 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.746186  9228 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:37.747324  9351 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.747677  9351 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:37.748576  9351 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.750630  9351 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.727421  9273 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.752494  9273 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:37.719417  9328 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.733000  9258 consensus_queue.cc:260] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:37.737560  9362 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.733441  9359 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:37.740262  9349 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.733282  9352 raft_consensus.cc:3055] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.765691  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:37.766002  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.731969  9369 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.770354  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:37.772828  8393 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.774910  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:37.775578  8390 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:37.773391  8508 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:37.775703  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.777128  8507 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:37.777887  9230 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.745491  9356 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:37.785149  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.787233  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:37.779376  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:37.771680  9352 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:37.774037  9289 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.782567  9301 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.775508  9265 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.766749  9348 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:37.780910  9232 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.798393  9352 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.767470  9338 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.804052  8386 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:37.765349  9228 consensus_queue.cc:1059] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:01:37.806206  9372 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:37.809878  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.820317  9358 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:37.827798  9358 consensus_queue.cc:1243] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:37.826884  9380 consensus_queue.cc:1059] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:01:37.791348  9292 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:01:37.808125  9364 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:37.821681  9361 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:37.824671  9372 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.842005  9372 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:37.847546  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.857561  9358 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.834578  9301 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.837846  9352 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.838694  9361 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.843888  9232 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.869418  9338 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.877765  9258 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:37.888550  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 108261us
I20260709 13:01:37.880993  9361 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:37.894822  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 121485us
I20260709 13:01:37.833277  9359 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.908331  9336 consensus_queue.cc:1059] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:01:37.955155  9372 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:37.975793  9372 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:37.951817  8461 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:37.956977  9314 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.988782  9357 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:01:37.992616  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.998018  9357 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:38.001031  8289 catalog_manager.cc:5697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 3 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.004153  9356 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.990195  9314 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:38.016479  8468 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.023298  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:38.024197  8470 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:38.023537  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.041476  8464 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.028833  9349 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:38.059038  9066 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Advancing to term 2
I20260709 13:01:38.035734  9314 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.075842  9314 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.059068  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:38.081108  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.083848  9067 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:38.059882  9265 raft_consensus.cc:697] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:38.091255  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.090904  9386 consensus_queue.cc:1059] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:38.084611  8464 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:38.097435  8462 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.106921  9289 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.093928  9326 raft_consensus.cc:3055] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.108199  9385 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:38.071540  9349 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.121373  8288 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50744 (request call id 155) took 1108 ms. Trace:
I20260709 13:01:38.123189  9361 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.127921  9258 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.128621  9258 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.110083  9326 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:38.140218  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 360891us
I20260709 13:01:38.150636  8468 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.151775  8470 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.124828  8288 rpcz_store.cc:276] 0709 13:01:37.012694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.012883 (+   189us) service_pool.cc:224] Handling call
0709 13:01:38.121252 (+1108369us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:37.598114 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:37.657195 (+ 59081us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:37.657230 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:37.657248 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:37.657584 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:37.657654 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:37.657685 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:37.657902 (+   217us) tablet.cc:701] Row locks acquired
0709 13:01:37.657922 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:37.658057 (+   135us) write_op.cc:270] Start()
0709 13:01:37.658160 (+   103us) write_op.cc:276] Timestamp: P: 1783602097658019 usec, L: 0
0709 13:01:37.658191 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:01:37.684911 (+ 26720us) log.cc:844] Serialized 537 byte log entry
0709 13:01:37.731063 (+ 46152us) op_driver.cc:464] REPLICATION: finished
0709 13:01:38.085403 (+354340us) write_op.cc:301] APPLY: starting
0709 13:01:38.087010 (+  1607us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:38.087146 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:38.087292 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:38.099382 (+ 12090us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:38.108694 (+  9312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:38.109692 (+   998us) write_op.cc:312] APPLY: finished
0709 13:01:38.113086 (+  3394us) log.cc:844] Serialized 22 byte log entry
0709 13:01:38.113299 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:38.113391 (+    92us) write_op.cc:454] Released schema lock
0709 13:01:38.113445 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:38.113934 (+   489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:38.113973 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":341168,"apply.run_cpu_time_us":2448,"apply.run_wall_time_us":32887,"num_ops":1,"prepare.queue_time_us":243338,"prepare.run_cpu_time_us":3271,"prepare.run_wall_time_us":93836,"replication_time_us":72684,"thread_start_us":364661,"threads_started":2}]]}
I20260709 13:01:38.141312  9265 consensus_queue.cc:237] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.160028  9258 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.161289  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:38.179694  8470 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.184790  8470 raft_consensus.cc:1240] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.199262  8392 raft_consensus.cc:1240] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:38.197533  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.200265  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:38.200922  8390 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:38.201097  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:38.201867  8394 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.171201  9369 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:38.203240  8462 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.171418  9380 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.181348  9386 raft_consensus.cc:3055] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.172049  9273 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:01:38.209100  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 317368us
I20260709 13:01:38.189684  8464 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.223289  8394 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:38.207373  9232 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.213225  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:38.173417  9326 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:38.210179  9386 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:38.231201  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 444038us
I20260709 13:01:38.232336  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:38.241847  8359 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:38.243268  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:38.244848  8359 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:38.225970  9230 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:38.226909  9395 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:38.247349  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:38.250133  8394 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:38.285748  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:38.227730  9232 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.292972  9394 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.279850  9389 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:01:38.245571  9340 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.245596  9289 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.246485  9338 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.211216  9380 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:38.297994  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 50725.7us
I20260709 13:01:38.245083  9326 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:38.301080  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51077.5us
I20260709 13:01:38.283335  9233 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.251276  9328 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.205054  9369 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.302762  9390 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.304353  8507 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:38.251014  9376 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.305951  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:38.294440  8463 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:38.315121  9324 raft_consensus.cc:3055] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.275528  9301 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:01:38.250793  9354 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:01:38.293694  9394 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:38.245476  9387 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.325376  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:38.338541  9319 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:38.352520  8394 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.352383  9393 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:38.338678  9364 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:01:38.353725  9392 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.354395  9392 raft_consensus.cc:697] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:38.340169  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.341514  9324 raft_consensus.cc:740] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:38.347553  9403 consensus_queue.cc:1059] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:38.321014  9340 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:38.356796  9403 consensus_queue.cc:1059] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:38.357756  9340 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.322547  9233 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:38.359010  8394 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:38.316638  9338 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:38.329372  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:38.331380  9351 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:38.362241  9351 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:38.363300  9351 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.363786  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:38.365720  9319 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:38.360884  9233 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.366475  9319 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:38.367667  9319 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:38.365900  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.368196  9392 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.356181  9324 consensus_queue.cc:260] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.371409  9324 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.376139  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:38.377115  8394 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:38.334110  9328 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:38.379616  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 50357.8us
W20260709 13:01:38.385282  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 47169.5us
I20260709 13:01:38.385615  8359 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:38.378959  8507 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:38.360546  9338 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.390146  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:38.320930  9361 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.386317  9358 raft_consensus.cc:2764] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:01:38.405530  9404 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.405881  9232 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.406026  9404 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:38.401676  9069 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.280117  9386 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.397243  9390 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.399343  9273 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.333418  9376 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.420450  9376 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.421144  9391 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.421937  9388 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.422483  9388 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.422848  9388 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.407040  9404 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.428843  9404 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.415076  9273 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.425545  9275 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:01:38.410538  9361 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.430065  9361 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.390028  9387 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.429452  9396 raft_consensus.cc:3055] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.412509  9368 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.385396  9230 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.420490  9066 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.433264  9273 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.448171  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:38.432730  9391 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.450647  8467 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.447731  8469 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.446697  9370 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:01:38.449842  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:38.451102  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:38.445159  9386 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.442243  9396 raft_consensus.cc:740] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:38.446640  9385 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:38.492451  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:38.440012  9376 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:01:38.481334  9361 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.482584  8464 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:38.486578  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:38.489274  9391 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:38.524498  9397 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:38.510254  9380 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:38.487682  9314 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:38.484375  9368 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.539846  9368 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.525492  9400 raft_consensus.cc:3055] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:01:38.542356  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 315220us
I20260709 13:01:38.593276  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:38.540328  9410 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.596562  9395 consensus_queue.cc:1059] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:38.596909  9410 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.599713  9410 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.601616  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:38.607275  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.590054  9390 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.569826  9376 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.578163  8535 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.633590  8467 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:38.619835  9380 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.592900  9394 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:38.578822  9396 consensus_queue.cc:260] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.598006  9398 consensus_queue.cc:1059] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:01:38.540313  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:38.643431  9340 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:01:38.643363  9396 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.643342  9390 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.626765  9376 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:38.670192  9401 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:01:38.680697  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:38.681743  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.676285  9356 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.644300  9400 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:38.702265  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:38.702728  9356 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.703274  9400 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.704259  9400 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:38.679903  9405 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:01:38.693810  9391 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:38.697280  9273 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:38.702102  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:38.702976  8538 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:38.682098  9390 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:38.704891  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.676507  9387 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:38.729676  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:38.701409  9386 consensus_queue.cc:1059] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:01:38.732081  8541 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:38.733678  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:38.734731  9391 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.694382  9362 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.735203  9391 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.741732  9265 raft_consensus.cc:3055] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.775718  8358 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:38.731178  9356 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:38.782368  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.756440  9392 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.759513  9387 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:38.769941  9328 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:38.778335  9069 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:01:38.776866  9391 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.777052  9265 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:38.771320  9362 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.774606  9390 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:38.809731  9069 pending_rounds.cc:85] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Aborting all ops after (but not including) 2
I20260709 13:01:38.802795  9356 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.800695  9392 raft_consensus.cc:697] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:38.826395  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 224859us
I20260709 13:01:38.798799  9352 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:38.808665  9380 raft_consensus.cc:697] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:38.801177  9387 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.867918  9356 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.866391  9289 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.817245  9328 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:38.900555  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 124893us
W20260709 13:01:38.903023  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.904621  8462 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:01:38.905131  9413 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:38.905997  9338 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.907968  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:38.906579  9338 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:38.909179  9420 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:01:38.909636  9426 consensus_queue.cc:1059] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.909282  9392 consensus_queue.cc:237] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:38.910794  9426 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.911239  9426 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:38.912112  9426 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.913394  9426 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:38.916899  9411 log.cc:927] Time spent T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:01:38.898284  9356 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.919688  9387 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:38.924119  9388 consensus_meta.cc:287] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.501s	user 0.004s	sys 0.006s
I20260709 13:01:38.924614  9388 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.929494  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:38.931169  8469 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:38.933090  9336 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.933566  9232 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.933710  9336 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.934167  9232 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.936335  9336 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.936784  9232 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.938856  9342 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.880939  9352 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.867758  9390 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:38.928419  9324 consensus_meta.cc:287] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.001s
I20260709 13:01:38.941927  9395 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:38.942067  9419 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:01:38.885609  9069 pending_rounds.cc:107] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:01:38.955492  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:38.924145  9338 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:38.941036  8508 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:38.963919  9319 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.964258  9340 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.964483  9319 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.965039  9319 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.964864  9340 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.967103  9340 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:38.970683  9067 raft_consensus.cc:1217] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:38.971577  9069 raft_consensus.cc:2917] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:01:38.972256  9069 raft_consensus.cc:2889] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.971702  9380 consensus_queue.cc:237] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.973987  9352 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:38.946414  9376 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.907430  9289 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.941191  9230 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:01:38.958252  9387 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.926295  9423 consensus_queue.cc:1059] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:01:38.976400  9390 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.001214  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:38.977150  9273 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:38.984423  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:38.942062  9265 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:38.984617  9351 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:38.964581  9424 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.981437  9324 consensus_queue.cc:1059] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:01:39.033120  8535 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:39.034149  9362 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.034770  9352 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.035386  9352 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:39.038390  9404 consensus_meta.cc:287] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.009s
I20260709 13:01:39.038757  9328 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.039078  8466 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:39.039754  9265 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.040565  9352 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.020587  9395 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.047864  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:39.048710  8535 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:39.048923  9391 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:39.055863  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67771.6us
I20260709 13:01:39.060901  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:39.058248  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 108947us
I20260709 13:01:39.061515  8543 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:39.039276  9404 raft_consensus.cc:3055] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.031792  9338 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.016772  9369 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:01:39.060168  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:39.067690  8541 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:39.065235  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:39.069695  8358 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:39.031380  9387 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.081696  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:39.084945  8358 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:39.071595  9342 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.083163  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:39.053980  9351 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.053623  9395 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.064182  9404 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:39.085748  9336 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.074024  9328 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:39.078017  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:39.091527  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:39.092940  8541 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.065949  9352 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:39.082489  9429 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:01:39.079484  9340 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:39.081672  9230 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.091229  8358 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:39.086630  9388 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.075218  9338 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.051403  9424 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.148630  9340 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:39.098839  9390 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:39.089838  9372 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.149168  9230 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.158195  9437 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.100421  9328 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:39.158668  9351 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:39.161213  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 70054.9us
I20260709 13:01:39.163173  9338 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:39.154901  9274 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:01:39.168594  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:39.169219  8541 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:39.169430  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:39.169965  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:39.170580  8394 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:39.099045  9342 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:39.162750  9435 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:01:39.102711  9336 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.156136  9340 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.177816  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:39.206252  9431 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:39.164604  9372 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.156719  9390 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.146513  9352 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.214195  9441 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.182185  9289 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.188704  9338 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:39.219370  9391 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.220072  9319 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:39.221470  9396 consensus_meta.cc:287] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.007s
W20260709 13:01:39.213902  9400 consensus_meta.cc:287] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.005s
I20260709 13:01:39.209394  9437 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.173722  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:39.212983  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:39.151274  8535 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:39.215886  9390 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.167361  9328 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.181962  9349 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:39.164305  9404 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:39.245343  8359 leader_election.cc:336] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.833s (SENT)
I20260709 13:01:39.266208  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:39.251502  9418 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:01:39.221658  9441 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.356671  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:39.256093  9422 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:01:39.257318  9230 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.221982  9436 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.264621  9395 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.225538  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:39.272197  9388 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:39.350257  8359 leader_election.cc:336] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.816s (SENT)
I20260709 13:01:39.404906  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:39.272859  9424 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.234984  9396 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.381880  9441 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.424640  8543 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:39.255216  9356 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.227620  9338 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.258710  9289 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:39.258117  8388 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:39.216923  9431 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:39.451393  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 491663us
I20260709 13:01:39.462836  9393 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.463485  9230 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.463668  9258 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.463888  9314 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.463973  9326 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.379361  9404 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.352406  9400 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.373167  9387 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.517804  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 717) took 1071 ms. Trace:
I20260709 13:01:39.527004  9336 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.437904  9388 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.438400  8386 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:40.014859  9450 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.440227  9396 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.517800  9393 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:40.017356  9396 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:40.017472  9393 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.508940  9431 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:39.584347  9426 consensus_meta.cc:287] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.003s
I20260709 13:01:39.585569  9342 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.586346  9372 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.588420  9338 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.589388  9319 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.597653  9361 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.547961  8465 rpcz_store.cc:276] 0709 13:01:38.446054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.448578 (+  2524us) service_pool.cc:224] Handling call
0709 13:01:38.448821 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.449085 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.449109 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.476462 (+ 27353us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.917835 (+441373us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b18003420a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:01:38.989848 (+ 72013us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:38.989893 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.989977 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.516955 (+526978us) raft_consensus.cc:1685] finished
0709 13:01:39.516984 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.517723 (+   739us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2435,"raft.queue_time_us":41846,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4463,"spinlock_wait_cycles":14639488,"thread_start_us":71815,"threads_started":1,"wal-append.queue_time_us":599813}
I20260709 13:01:41.356793  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.357388  8465 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:39.788902  9460 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.360000  9460 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.362049  9460 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.810431  8464 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:39.904497  9453 raft_consensus.cc:1064] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:41.363611  9478 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.363786  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 727) took 2434 ms. Trace:
I20260709 13:01:41.364094  9478 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.364224  8464 rpcz_store.cc:276] 0709 13:01:38.929373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.941853 (+ 12480us) service_pool.cc:224] Handling call
0709 13:01:39.809846 (+867993us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:39.810057 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.363445 (+1553388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.363694 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6114560}
I20260709 13:01:41.365635  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.365814  9453 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:41.366663  8464 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:41.367254  8464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 751) took 1403 ms (client timeout 1772 ms). Trace:
W20260709 13:01:41.367614  8464 rpcz_store.cc:269] 0709 13:01:39.963957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.365363 (+1401406us) service_pool.cc:224] Handling call
0709 13:01:41.367199 (+  1836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.368103  9478 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.368633  9478 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.369253  8465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 752) took 1405 ms (client timeout 1654 ms). Trace:
W20260709 13:01:39.950412  8463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.012s	sys 0.029s
W20260709 13:01:41.378468  8463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.197s	user 0.013s	sys 0.030s
I20260709 13:01:39.954255  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.379616  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 731) took 1426 ms. Trace:
I20260709 13:01:41.379932  8467 rpcz_store.cc:276] 0709 13:01:39.953189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.953993 (+   804us) service_pool.cc:224] Handling call
0709 13:01:41.379559 (+1425566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.380792  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.381461  8467 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:39.955017  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:39.958079  9463 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:39.965276  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:39.967211  8390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.000s	sys 0.029s
W20260709 13:01:39.970006  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.976425  8433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.015s	sys 0.023s
I20260709 13:01:41.403409  8470 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:41.403748  8433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.253s	user 0.017s	sys 0.024s
W20260709 13:01:41.403905  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.403990  8470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 730) took 1451 ms (client timeout 1580 ms). Trace:
I20260709 13:01:39.988039  8289 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:41.404481  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.404305  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 2.31264e+06us
I20260709 13:01:41.405701  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:40.013053  8358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.004s	sys 0.008s
W20260709 13:01:40.033001  8359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.012s	sys 0.014s
W20260709 13:01:41.406718  8358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.222s	user 0.005s	sys 0.009s
W20260709 13:01:41.407047  8359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.968s	user 0.013s	sys 0.014s
W20260709 13:01:41.407142  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 2.22241e+06us
W20260709 13:01:41.407904  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 2.05751e+06us
I20260709 13:01:40.045517  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.410298  8462 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:41.411170  8462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 723) took 2483 ms (client timeout 1889 ms). Trace:
W20260709 13:01:41.411698  8462 rpcz_store.cc:269] 0709 13:01:38.928175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.941948 (+ 13773us) service_pool.cc:224] Handling call
0709 13:01:40.045299 (+1103351us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:41.411019 (+1365720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8151808}
I20260709 13:01:41.414111  8289 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.048048  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 720) took 1597 ms. Trace:
I20260709 13:01:41.415735  8466 rpcz_store.cc:276] 0709 13:01:38.450761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.450875 (+   114us) service_pool.cc:224] Handling call
0709 13:01:40.047816 (+1596941us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54000d8754. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:40.047979 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280216320}
I20260709 13:01:41.368641  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.417426  8464 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.418227  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 742) took 1457 ms. Trace:
W20260709 13:01:39.658941  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 155797us
W20260709 13:01:39.792553  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 262346us
W20260709 13:01:39.659490  9069 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.030s	sys 0.038s
W20260709 13:01:39.663645  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.016s
I20260709 13:01:39.796777  9232 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.472281  9068 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:41.480611  9232 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:41.451282  9483 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.531330  9258 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.523938  9230 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.641896  9274 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:39.632381  9265 consensus_meta.cc:287] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.001s
W20260709 13:01:39.715930  9275 raft_consensus.cc:670] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:39.508744  9289 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.492892  9274 tablet_bootstrap.cc:492] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:01:41.492794  9453 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:40.251669  9324 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:41.494670  9230 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:41.494880  9324 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:39.547487  9314 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:41.500209  9314 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.632709  9328 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.504103  9328 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.547919  9326 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.508121  9326 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.524709  9349 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.509666  9349 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.510087  9289 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.511255  9324 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:41.512162  9349 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.827958  9351 raft_consensus.cc:1064] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:01:41.515470  9351 raft_consensus.cc:1068] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:39.614377  9356 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.518107  9486 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:40.025198  9361 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.525344  9361 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.691779  9359 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:40.485466  9459 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.527138  9459 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.529295  9459 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.563225  9369 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:41.530537  9369 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.532547  9369 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.606115  9387 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.533823  9387 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.535717  9387 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:39.617733  9388 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:39.668257  9390 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.539067  9390 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:39.758452  9398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.079s	user 0.015s	sys 0.014s
W20260709 13:01:41.540660  9398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.862s	user 0.016s	sys 0.015s
I20260709 13:01:40.361063  9396 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.542227  9396 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.544601  9396 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.545145  9423 consensus_queue.cc:1059] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.555591  9400 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.550326  9400 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.552438  9386 raft_consensus.cc:3055] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:41.552994  9386 raft_consensus.cc:740] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:41.553931  9386 consensus_queue.cc:260] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.555430  9386 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.918937  9399 raft_consensus.cc:1064] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:41.560716  9399 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:41.561975  8461 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:41.564608  8461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 722) took 2636 ms (client timeout 2161 ms). Trace:
W20260709 13:01:41.565034  8461 rpcz_store.cc:269] 0709 13:01:38.927789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.928386 (+   597us) service_pool.cc:224] Handling call
0709 13:01:39.356519 (+428133us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2eee 0000000000375939 00007fbe184361e0 00007fbe184ff0c4 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:41.564332 (+2207813us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b540040cc54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:41.564510 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5047582336}
I20260709 13:01:39.958127  9404 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.572384  9404 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:39.919328  9409 raft_consensus.cc:3055] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:41.575160  9409 raft_consensus.cc:740] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:40.289736  9426 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.578208  9426 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:40.030730  9431 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.582202  9431 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.284591  9476 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.582959  9476 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.585184  9476 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.290823  9475 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.585911  9475 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.588049  9475 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.298379  9474 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.588703  9474 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.590960  9474 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.299448  9477 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.317061  9479 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.591601  9477 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.591708  9479 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:41.320235  8361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.862s	user 0.014s	sys 0.049s
W20260709 13:01:41.335561  9471 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.747s	user 0.003s	sys 0.008s
W20260709 13:01:39.947489  8360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.032s	sys 0.014s
I20260709 13:01:41.369279  9478 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.595360  9404 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:41.375110  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.376780  9342 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.602324  9342 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.603122  9478 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.604506  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 733) took 1650 ms. Trace:
I20260709 13:01:41.604681  9342 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:41.385213  8465 rpcz_store.cc:269] 0709 13:01:39.964206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.356556 (+1392350us) service_pool.cc:224] Handling call
0709 13:01:41.369192 (+ 12636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.605520  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:41.606165  8465 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.382069  8469 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.608392  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 732) took 1655 ms. Trace:
I20260709 13:01:41.608719  8469 rpcz_store.cc:276] 0709 13:01:39.953477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.954787 (+  1310us) service_pool.cc:224] Handling call
0709 13:01:41.608336 (+1653549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.609520  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:41.610080  8469 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.382512  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 741) took 1420 ms. Trace:
W20260709 13:01:41.404521  8470 rpcz_store.cc:269] 0709 13:01:39.952858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.964947 (+ 12089us) service_pool.cc:224] Handling call
0709 13:01:41.403925 (+1438978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.612126  8467 rpcz_store.cc:276] 0709 13:01:39.960976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.380556 (+1419580us) service_pool.cc:224] Handling call
0709 13:01:41.381766 (+  1210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.612603  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:39.995213  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:39.999145  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 579) took 1045 ms. Trace:
I20260709 13:01:41.418551  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:41.405138  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 725) took 2476 ms. Trace:
I20260709 13:01:41.419512  9463 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:41.418572  8464 rpcz_store.cc:276] 0709 13:01:39.961244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.368389 (+1407145us) service_pool.cc:224] Handling call
0709 13:01:41.418169 (+ 49780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.415897  8289 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:01:41.421777  9460 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.422490  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.422891  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:41.638470  8537 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:41.423980  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:41.417346  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.426344  9480 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:01:41.426224  8359 connection.cc:256] RPC call timeout handler was delayed by -2.0369673760000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:01:41.413295  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.640291  9289 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.431617  8390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.246s	user 0.001s	sys 0.030s
I20260709 13:01:41.435954  8507 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:41.443949  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:41.444640  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:41.442528  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:41.640538  9359 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.641153  9390 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:41.478751  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.491s	user 0.015s	sys 0.016s
I20260709 13:01:41.641000  9478 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.465775  9348 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.477063  8544 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:41.469466  9485 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.473256  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:41.476333  9069 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.336s	user 0.033s	sys 0.038s
I20260709 13:01:41.486570  9232 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:41.487790  9258 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:41.490216  9473 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.493772  9274 ts_tablet_manager.cc:1403] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 3.893s	user 0.005s	sys 0.055s
I20260709 13:01:39.612579  9340 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.643211  9480 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:41.516126  9324 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.516556  9483 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.647061  9485 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.517201  9482 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:41.519114  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.615031  9352 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.527544  9486 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:40.380159  9403 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.576217  9409 consensus_queue.cc:260] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:41.595078  9477 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.595242  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.375497  9362 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.604913  8468 rpcz_store.cc:276] 0709 13:01:39.953767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.036407 (+ 82640us) service_pool.cc:224] Handling call
0709 13:01:40.036789 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.037179 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.037211 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.037726 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.296254 (+258528us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:40.823297 (+527043us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.122002 (+298705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.122109 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.334905 (+212796us) spinlock_profiling.cc:243] Waited 930 us on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:41.604222 (+269317us) raft_consensus.cc:1685] finished
0709 13:01:41.604326 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.604449 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":979888,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":1486,"raft.queue_time_us":474765,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":230,"spinlock_wait_cycles":2139904,"thread_start_us":990131,"threads_started":3,"wal-append.queue_time_us":458279}
I20260709 13:01:41.622231  8469 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:41.627233  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:41.768671  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 738) took 1808 ms. Trace:
I20260709 13:01:41.768918  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.769121  9258 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:41.769018  8469 rpcz_store.cc:276] 0709 13:01:39.960220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.609299 (+1649079us) service_pool.cc:224] Handling call
0709 13:01:41.768620 (+159321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.769668  8468 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.769804  9258 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.632452  8538 rpcz_store.cc:276] 0709 13:01:38.954227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.958500 (+  4273us) service_pool.cc:224] Handling call
0709 13:01:39.943478 (+984978us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:39.943711 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.943983 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.944016 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.944524 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.998584 (+ 54060us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:39.998632 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.998719 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.998779 (+    60us) raft_consensus.cc:1685] finished
0709 13:01:39.998795 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.999040 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11038592,"thread_start_us":53642,"threads_started":1,"wal-append.queue_time_us":34797,"wal-append.run_cpu_time_us":1603,"wal-append.run_wall_time_us":1001591}
I20260709 13:01:41.446584  9376 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.770303  9258 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.770697  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.770828  9376 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.768270  9362 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.773469  9376 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:41.644064  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 201620us
W20260709 13:01:41.642760  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 206884us
I20260709 13:01:41.773921  8542 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.773602  9362 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:41.647370  9066 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:41.641153  8539 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:41.640899  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 754) took 1676 ms. Trace:
I20260709 13:01:41.720124  8465 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:41.775028  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:41.775279  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 753) took 1810 ms. Trace:
I20260709 13:01:41.770226  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.775673  8465 rpcz_store.cc:276] 0709 13:01:39.964464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.605285 (+1640821us) service_pool.cc:224] Handling call
0709 13:01:41.775222 (+169937us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.776631  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.776751  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.776907  9477 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:41.641252  9387 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.776566  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:41.641355  9356 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.641040  9431 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.640542  8536 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:41.646199  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 19) took 2679 ms. Trace:
I20260709 13:01:41.781934  9431 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.648501  9479 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.641484  8462 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:41.723791  9489 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:41.717090  9463 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.722321  9404 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.782006  9067 rpcz_store.cc:276] 0709 13:01:38.966538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.969925 (+  3387us) service_pool.cc:224] Handling call
0709 13:01:38.970562 (+   637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.645661 (+2675099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.645713 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.645775 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:41.645861 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.645955 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.646107 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7021,"raft.queue_time_us":480171,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"thread_start_us":2660121,"threads_started":1}
W20260709 13:01:41.784382  8462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 749) took 1821 ms (client timeout 2247 ms). Trace:
I20260709 13:01:41.784679  9404 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:41.784853  8462 rpcz_store.cc:269] 0709 13:01:39.963444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.412920 (+1449476us) service_pool.cc:224] Handling call
0709 13:01:41.784308 (+371388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.785256  8542 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:41.786093  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.785988  9356 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:41.646059  9348 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.786839  9404 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.787252  8543 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.768234  9409 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:41.788192  9348 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:41.645772  9478 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.788189  9356 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.790220  9478 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.734066  9357 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.645905  9359 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.727007  9426 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.642872  9342 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:41.655218  9386 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:41.516770  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:41.645380  9390 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.795514  8543 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:41.641595  9289 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.722541  9473 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.741453  9480 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:41.742906  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:41.796705  9359 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.737933  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58874 (request call id 29) took 2752 ms. Trace:
I20260709 13:01:41.777954  9387 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.779971  9477 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:41.797884  9485 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:41.797729  9069 rpcz_store.cc:276] 0709 13:01:39.018251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.042275 (+ 24024us) service_pool.cc:224] Handling call
0709 13:01:39.064857 (+ 22582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.079740 (+ 14883us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:41.647682 (+2567942us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.730667 (+ 82985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.732335 (+  1668us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:41.732734 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.734451 (+  1717us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.737310 (+  2859us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":371397,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":800,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1703,"thread_start_us":2620066,"threads_started":2,"wal-append.queue_time_us":90306}
I20260709 13:01:41.754288  9482 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.634793  8463 rpcz_store.cc:276] 0709 13:01:38.928793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.941908 (+ 13115us) service_pool.cc:224] Handling call
0709 13:01:38.976885 (+ 34977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.085445 (+108560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.085497 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.180782 (+ 95285us) spinlock_profiling.cc:243] Waited 9.78 ms on lock 0x7b2c00040298. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:01:39.181272 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.378875 (+2197603us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:41.378917 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.378991 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.379034 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:41.379045 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.402703 (+ 23658us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38690,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":22485376,"thread_start_us":2266038,"threads_started":2,"wal-append.queue_time_us":609891,"wal-append.run_cpu_time_us":2278,"wal-append.run_wall_time_us":1042508}
W20260709 13:01:41.594261  8361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.136s	user 0.015s	sys 0.050s
I20260709 13:01:41.623512  8387 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:41.866822  8387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 726) took 2700 ms (client timeout 2371 ms). Trace:
W20260709 13:01:41.867581  8387 rpcz_store.cc:269] 0709 13:01:39.166274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.171392 (+  5118us) service_pool.cc:224] Handling call
0709 13:01:39.995058 (+823666us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:41.866453 (+1871395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11954048}
I20260709 13:01:41.744266  9324 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:41.840469  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.641202  8359 leader_election.cc:336] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.979s (SENT)
I20260709 13:01:41.871886  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:41.764535  9340 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.628136  9388 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:41.642357  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 733) took 2472 ms. Trace:
I20260709 13:01:41.873950  9340 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.778703  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:41.875015  9340 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.786828  8462 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.878391  9359 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.796666  9390 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.879647  9359 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.880322  9390 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:41.880635  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.777462  8465 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.797279  8461 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.882198  9354 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.883369  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.883211  9354 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.884078  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 736) took 1924 ms. Trace:
I20260709 13:01:41.884300  8465 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.843645  8470 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.775044  8466 rpcz_store.cc:276] 0709 13:01:39.964728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.417025 (+1452297us) service_pool.cc:224] Handling call
0709 13:01:41.640844 (+223819us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.886308  9352 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:41.845111  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 737) took 1884 ms. Trace:
I20260709 13:01:41.781332  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
W20260709 13:01:41.843318  8435 consensus_peers.cc:597] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:41.887837  9324 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.866376  9328 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.877652  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 98852.9us
W20260709 13:01:41.888300  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 45832.2us
I20260709 13:01:41.806389  9274 raft_consensus.cc:359] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:41.890350  9274 raft_consensus.cc:740] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:01:41.890779  9324 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:41.594910  8360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.385s	user 0.033s	sys 0.014s
I20260709 13:01:41.889950  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:41.891788  9274 consensus_queue.cc:260] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:41.790897  9357 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:01:41.897055  8491 debug-util.cc:398] Leaking SignalData structure 0x7b08001578a0 after lost signal to thread 7286
I20260709 13:01:41.897382  8465 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.898262  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 739) took 1937 ms. Trace:
I20260709 13:01:41.898164  9477 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:41.898876  8491 debug-util.cc:398] Leaking SignalData structure 0x7b080015e2a0 after lost signal to thread 8327
I20260709 13:01:41.783882  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 735) took 1824 ms. Trace:
I20260709 13:01:41.902832  8462 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.887159  8464 rpcz_store.cc:276] 0709 13:01:39.959978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.641620 (+1681642us) service_pool.cc:224] Handling call
0709 13:01:41.651801 (+ 10181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.731236 (+ 79435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.731961 (+   725us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.736784 (+  4823us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.792286 (+ 55502us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:41.792337 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.794366 (+  2029us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.844175 (+ 49809us) raft_consensus.cc:1685] finished
0709 13:01:41.844205 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.844779 (+   574us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":835,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":1021,"thread_start_us":47014,"threads_started":1,"wal-append.queue_time_us":32313}
W20260709 13:01:41.768848  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 141859us
I20260709 13:01:41.904793  9301 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.887573  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 246385us
I20260709 13:01:41.888939  9328 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.905866  9301 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:41.804256  9387 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.874260  8390 rpcz_store.cc:276] 0709 13:01:39.170214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.170617 (+   403us) service_pool.cc:224] Handling call
0709 13:01:39.175893 (+  5276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.176155 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:39.176517 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.642018 (+2465501us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.642076 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:41.642115 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.642182 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.642284 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8336,"prepare.queue_time_us":184,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":51,"raft.queue_time_us":49157,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4551,"thread_start_us":2456820,"threads_started":1}
W20260709 13:01:41.639182  8358 connection.cc:256] RPC call timeout handler was delayed by -1.065052369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:01:41.889331  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 107847us
W20260709 13:01:41.910641  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.765971  9403 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.805469  9431 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.777468  8469 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.801543  9473 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.762609  9475 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.740782  9483 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.781213  9486 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.804698  9482 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.641942  9460 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:41.942476  9258 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.943930  9388 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:41.949051  8387 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:01:41.949929  8387 pending_rounds.cc:85] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 2
I20260709 13:01:41.950372  8387 pending_rounds.cc:107] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:01:41.950914  8387 raft_consensus.cc:2917] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:01:41.951174  8389 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.951871  8387 raft_consensus.cc:2889] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.952857  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:41.954780  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 740) took 1993 ms. Trace:
I20260709 13:01:41.955258  8466 rpcz_store.cc:276] 0709 13:01:39.960734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.886445 (+1925711us) service_pool.cc:224] Handling call
0709 13:01:41.886982 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.942863 (+ 55881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.942909 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.942982 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:41.943039 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.954427 (+ 11388us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b54000d6e54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:41.954474 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.954580 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116064128}
I20260709 13:01:41.960443  8469 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 3.
I20260709 13:01:41.961126  8389 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.962648  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 746) took 2000 ms. Trace:
I20260709 13:01:41.963172  9359 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.963765  9033 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:41.794237  9342 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.803850  9289 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.881450  9390 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:41.990744  9289 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.991499  9289 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.992189  9390 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:41.898814  8465 rpcz_store.cc:276] 0709 13:01:39.960474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.885159 (+1924685us) service_pool.cc:224] Handling call
0709 13:01:41.885728 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.897893 (+ 12165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.898176 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.884685  8461 rpcz_store.cc:276] 0709 13:01:39.959737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.594971 (+1635234us) service_pool.cc:224] Handling call
0709 13:01:41.883616 (+288645us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54003cd7d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:41.883854 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67195264}
I20260709 13:01:41.902499  9354 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.903213  8467 rpcz_store.cc:276] 0709 13:01:39.959472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.612744 (+1653272us) service_pool.cc:224] Handling call
0709 13:01:41.613028 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.613384 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.613410 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.623406 (+  9996us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.723949 (+100543us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:41.723989 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.724056 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.783681 (+ 59625us) raft_consensus.cc:1685] finished
0709 13:01:41.783702 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.783829 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":12158,"thread_start_us":92757,"threads_started":1,"wal-append.queue_time_us":107293}
W20260709 13:01:41.910864  8491 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcfe0 after lost signal to thread 8419
I20260709 13:01:41.783849  9376 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:01:41.999665  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 755) took 2034 ms. Trace:
I20260709 13:01:42.000213  8467 rpcz_store.cc:276] 0709 13:01:39.964970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.998601 (+2033631us) service_pool.cc:224] Handling call
0709 13:01:41.998983 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.999323 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.999348 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.999390 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:41.999420 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.999480 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.999592 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.901199  9352 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.926939  8470 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:41.932081  9431 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.935397  8462 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.935266  9475 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:41.939306  8468 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.641461  9349 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.008782  9475 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.009807  9349 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.013015  9349 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.946177  9460 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:41.946105  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:41.947288  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.008903  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 23) took 1999 ms. Trace:
W20260709 13:01:41.959268  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.014396  8468 rpcz_store.cc:276] 0709 13:01:40.009353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.007563 (+1998210us) service_pool.cc:224] Handling call
0709 13:01:42.008070 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.008514 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.008548 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.008602 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:42.008637 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.008707 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.008844 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.015549  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 748) took 2052 ms. Trace:
I20260709 13:01:42.016093  8465 rpcz_store.cc:276] 0709 13:01:39.963195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.993144 (+2029949us) service_pool.cc:224] Handling call
0709 13:01:41.993559 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.003741 (+ 10182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.003771 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.003817 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:42.015279 (+ 11462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.015346 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.015448 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.017100  9274 ts_tablet_manager.cc:1434] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.300s	user 0.022s	sys 0.011s
I20260709 13:01:42.017438  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 24) took 2007 ms. Trace:
I20260709 13:01:41.963147  8469 rpcz_store.cc:276] 0709 13:01:39.962685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.961490 (+1998805us) service_pool.cc:224] Handling call
0709 13:01:41.961999 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.962322 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.962348 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.962390 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:41.962424 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.962477 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.962575 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.003520  9431 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.014489  8391 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.021047  9431 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.949028  8507 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:41.997736  8491 debug-util.cc:398] Leaking SignalData structure 0x7b080034a260 after lost signal to thread 8420
W20260709 13:01:42.023000  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 102531us
W20260709 13:01:42.024092  8491 debug-util.cc:398] Leaking SignalData structure 0x7b0800237b00 after lost signal to thread 8494
I20260709 13:01:41.949252  8386 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:41.971953  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:41.972607  9387 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.028913  9387 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.030902  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 734) took 2071 ms. Trace:
I20260709 13:01:42.031805  9387 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.973820  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 744) took 2011 ms. Trace:
I20260709 13:01:42.002244  9352 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:42.032596  8464 rpcz_store.cc:276] 0709 13:01:39.962161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.904984 (+1942823us) service_pool.cc:224] Handling call
0709 13:01:41.905756 (+   772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.973385 (+ 67629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.973420 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.973493 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:41.973530 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.973600 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.973741 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.973035  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.034078  8388 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.034534  8387 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:41.966666  8466 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:42.035497  9352 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.035813  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 745) took 2073 ms. Trace:
I20260709 13:01:42.036363  8466 rpcz_store.cc:276] 0709 13:01:39.962415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.956709 (+1994294us) service_pool.cc:224] Handling call
0709 13:01:41.957338 (+   629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.035499 (+ 78161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.035744 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.974573  9275 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.972715  8508 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.037597  9275 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:42.038225  9275 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:42.038475  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 117827us
I20260709 13:01:42.038825  8390 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:42.039701  8508 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:41.976075  9328 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:41.975682  8463 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:42.042330  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 747) took 2079 ms. Trace:
I20260709 13:01:42.042435  9348 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:41.978327  9357 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.043035  9348 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.964736  9356 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:41.941644  9483 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.043529  9301 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.043651  9348 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.042758  8463 rpcz_store.cc:276] 0709 13:01:39.962941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.974467 (+2011526us) service_pool.cc:224] Handling call
0709 13:01:41.974978 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.041951 (+ 66973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.042260 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.045145  9356 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.046269  9485 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.046842  9485 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.047298  9485 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.024619  8507 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:41.988193  9498 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.981716  9258 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:41.989642  9342 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.980799  9359 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.964095  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 70365.8us
I20260709 13:01:42.052024  8469 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:42.026640  9388 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:42.027704  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.024636  8491 debug-util.cc:398] Leaking SignalData structure 0x7b08000f8340 after lost signal to thread 8495
I20260709 13:01:41.976861  9403 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.014904  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 743) took 2053 ms. Trace:
I20260709 13:01:42.049018  8468 rpcz_store.cc:276] 0709 13:01:40.009568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.016085 (+2006517us) service_pool.cc:224] Handling call
0709 13:01:42.016649 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.017008 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.017041 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.017092 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:42.017121 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.017221 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.017354 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.047973  9356 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.031483  8470 rpcz_store.cc:276] 0709 13:01:39.959188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.612377 (+1653189us) service_pool.cc:224] Handling call
0709 13:01:42.030591 (+418214us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002e7a54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:42.030793 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529211648}
I20260709 13:01:42.053355  9388 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.056186  9359 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:42.079066  9340 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.079891  9258 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.080361  9258 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.080407  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:42.080827  9258 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.052279  9498 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:42.078250  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 53857us
I20260709 13:01:42.069950  8462 rpcz_store.cc:276] 0709 13:01:39.961896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.903828 (+1941932us) service_pool.cc:224] Handling call
0709 13:01:41.904379 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.003636 (+ 99257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.014630 (+ 10994us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b54001cb1d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:42.014842 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46898048}
I20260709 13:01:42.054579  9301 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:42.081550  9388 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.080866  9359 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:42.090899  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 127448us
I20260709 13:01:42.101202  8508 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.100580  8388 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:42.085767  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.104616  8387 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.103462  8393 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.086082  9403 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:42.106639  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45858.5us
I20260709 13:01:42.082854  9289 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.110721  9232 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:42.111358  9232 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:42.112555  9232 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:42.107075  8359 leader_election.cc:336] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.918s (SENT)
I20260709 13:01:42.119763  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:42.120297  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:42.121009  8391 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.122921  9498 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.123997  8508 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.125545  8508 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.127028  9362 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.127585  9362 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:42.127630  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.128163  9362 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.129096  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.130324  9399 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:42.130471  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:42.131196  9399 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:42.132596  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:42.133859  9483 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.134243  9351 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.134652  9351 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.134734  9483 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.135075  9351 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:42.143913  9496 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 13:01:42.146116  8288 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:42.148344  8387 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:42.132714  9399 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.154395  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:42.163106  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:42.148890  8288 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:01:42.194574  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.196892  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67891.2us
I20260709 13:01:42.153697  9301 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.214389  9275 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:42.215626  9069 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.216430  8358 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:42.216809  9275 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.217463  9289 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.218153  9376 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.218259  9289 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.218637  9376 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.218753  9289 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.219065  9376 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.219707  8391 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:42.226858  9498 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.227840  9351 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:42.228412  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 132619us
I20260709 13:01:42.228338  9289 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:42.229573  8359 connection.cc:256] RPC call timeout handler was delayed by -1.3616651419999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:01:42.230041  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1628369690000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 13:01:42.230432  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0972842840000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:01:42.230746  8359 connection.cc:256] RPC call timeout handler was delayed by -1.066441712000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:01:42.231072  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0569889380000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:01:42.231137  9289 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.230968  9485 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:42.231662  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0467369689999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 13:01:42.231928  9289 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.232492  9289 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.233304  9485 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.234032  8508 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.217712  8358 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:42.237020  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 104595us
I20260709 13:01:42.246667  9498 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:42.247367  9498 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:42.247937  9498 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.264115  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 750) took 2300 ms. Trace:
I20260709 13:01:42.241583  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.268139  9351 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.270913  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:42.234879  9289 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:42.281334  8491 debug-util.cc:398] Leaking SignalData structure 0x7b0800314460 after lost signal to thread 8568
W20260709 13:01:42.284219  8491 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8880 after lost signal to thread 9093
W20260709 13:01:42.285403  8491 debug-util.cc:398] Leaking SignalData structure 0x7b0800327d40 after lost signal to thread 9389
W20260709 13:01:42.285768  8491 debug-util.cc:398] Leaking SignalData structure 0x7b0800357060 after lost signal to thread 9391
W20260709 13:01:42.290356  8491 debug-util.cc:398] Leaking SignalData structure 0x7b0800304760 after lost signal to thread 9402
I20260709 13:01:42.271692  9342 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.293362  9342 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:42.302481  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 47300.9us
I20260709 13:01:42.304742  8433 leader_election.cc:400] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3.
I20260709 13:01:42.305195  8433 leader_election.cc:403] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:42.270206  9485 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.279924  8388 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:42.341487  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 85971.8us
W20260709 13:01:42.339267  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 128411us
I20260709 13:01:42.338454  9403 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3.
I20260709 13:01:42.340565  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:42.351796  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 756) took 2386 ms. Trace:
I20260709 13:01:42.338361  9485 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:42.348621  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.352176  8467 rpcz_store.cc:276] 0709 13:01:39.965226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.001336 (+2036110us) service_pool.cc:224] Handling call
0709 13:01:42.002379 (+  1043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.084792 (+ 82413us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:42.205527 (+120735us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.272475 (+ 66948us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b1800340c60. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9
0709 13:01:42.283968 (+ 11493us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b1800340c60. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a 00007fbe134f1a2a
0709 13:01:42.351380 (+ 67412us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.351450 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:42.351499 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.351588 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.351732 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14780,"prepare.queue_time_us":144743,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":2721,"spinlock_wait_cycles":15651072,"thread_start_us":141265,"threads_started":2}
I20260709 13:01:42.357934  9301 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.358124  9258 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.360940  9258 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.308944  9351 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:01:42.353768  9289 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:42.368260  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 63873.9us
W20260709 13:01:42.355901  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.355347  9485 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.380232  9376 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.380383  9498 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.375319  8358 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:42.383796  9348 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.384675  8508 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.387614  9388 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.370657  8462 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.377084  9351 raft_consensus.cc:3055] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.394933  9362 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.369138  9289 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:42.396791  8507 connection.cc:256] RPC call timeout handler was delayed by -2.2704266210000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:01:42.420120  8507 connection.cc:256] RPC call timeout handler was delayed by -1.7151266210000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
I20260709 13:01:42.397418  9258 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.410983  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:42.411274  9376 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:42.411729  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.516s (SENT) [suppressed 24 similar messages]
I20260709 13:01:42.412178  9065 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Advancing to term 2
I20260709 13:01:42.409356  9351 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:42.268611  8461 rpcz_store.cc:276] 0709 13:01:39.963710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.997039 (+2033329us) service_pool.cc:224] Handling call
0709 13:01:41.999215 (+  2176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.036651 (+ 37436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.036704 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.037425 (+   721us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.096693 (+ 59268us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:42.212185 (+115492us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.213390 (+  1205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.263530 (+ 50140us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b54000974d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:42.263602 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.263684 (+    82us) raft_consensus.cc:1685] finished
0709 13:01:42.263821 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.264014 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12694,"prepare.queue_time_us":141483,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":5513,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":306,"spinlock_wait_cycles":84744192,"thread_start_us":139110,"threads_started":2,"wal-append.queue_time_us":53607}
I20260709 13:01:42.427150  9398 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.414180  9498 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.417580  8358 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:42.417426  9340 consensus_queue.cc:1059] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:42.429463  9340 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:42.429963  9340 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:42.429423  9351 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:42.431012  9340 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.431492  9351 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.417409  9500 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.432348  9340 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.432679  9500 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.433228  9500 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.434682  8358 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:42.435850  9301 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:42.436373  9301 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:42.436867  9301 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.422230  9289 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:42.424273  8507 connection.cc:256] RPC call timeout handler was delayed by -1.6323266210000611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22890000000000002s for a response
W20260709 13:01:42.438426  8507 connection.cc:256] RPC call timeout handler was delayed by -1.5585266210000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2371s for a response
W20260709 13:01:42.438786  8507 connection.cc:256] RPC call timeout handler was delayed by -1.3218266210000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2634s for a response
W20260709 13:01:42.439078  8507 connection.cc:256] RPC call timeout handler was delayed by -1.1760266210000623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2796s for a response
I20260709 13:01:42.440294  9498 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.440706  9498 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.441054  9498 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:42.442421  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 71202.3us
I20260709 13:01:42.443576  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:42.446167  9398 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.442987  8358 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:42.452143  9387 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:42.452730  9387 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:42.454190  9387 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:42.458189  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.422880  9258 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.458948  9258 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.462422  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:42.463354  9328 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:42.463883  9328 raft_consensus.cc:697] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:42.464427  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.464879  9328 consensus_queue.cc:237] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.472395  9388 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.507376  9399 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.507997  9399 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.508433  9399 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.509967  9342 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.510474  9342 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.510905  9342 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:42.532398  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.526597  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:42.588871  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 147805us
I20260709 13:01:42.573813  9362 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.600759  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:42.621569  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.624076  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 212356us
I20260709 13:01:42.624764  8508 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.614996  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:42.628052  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:42.628276  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:42.628412  9512 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:01:42.628858  8544 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:42.631016  8359 leader_election.cc:336] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.958s (SENT)
I20260709 13:01:42.631871  8462 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
W20260709 13:01:42.632884  8359 leader_election.cc:336] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.060s (SENT)
I20260709 13:01:42.633378  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:42.634213  9431 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.638314  8388 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:42.638952  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.639624  8389 raft_consensus.cc:1240] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:42.639709  8387 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:42.639899  8390 raft_consensus.cc:2410] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:42.641162  8391 raft_consensus.cc:1240] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:42.642293  8359 leader_election.cc:336] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.189s (SENT)
I20260709 13:01:42.637265  9289 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.643652  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:42.645190  9431 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.618350  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:42.650606  9232 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.651261  9232 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.651706  9232 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.655315  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.618388  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.660792  8544 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:42.666110  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.666463  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.674604  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.675588  8390 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:42.675686  8539 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.666100  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.676748  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.680272  8388 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.683516  9500 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.688323  9485 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.690014  8536 raft_consensus.cc:2368] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:42.696318  8388 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:42.685663  9500 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.702255  8387 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.703835  9498 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.705386  9258 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.709518  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.710021  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.710275  9258 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.712028  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.712517  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.712869  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.713140  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.713589  8540 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.713872  8544 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:42.713629  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.714118  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.714483  8541 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.714583  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.714807  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.715274  8540 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:42.715369  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.715615  8544 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:42.716173  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.716217  9232 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.717015  8538 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.718107  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:42.707432  9521 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:01:42.661376  9348 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.724403  8542 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
W20260709 13:01:42.724551  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55090us
I20260709 13:01:42.727543  8539 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.721848  9289 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.733335  9033 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.734380  9499 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:42.734846  9499 raft_consensus.cc:697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:42.734630  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.735661  8539 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.735932  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.736164  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.735854  9499 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:42.736783  8537 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.738075  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:42.738214  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.738643  8537 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.748013  8387 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:42.745679  8290 catalog_manager.cc:5697] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.732595  9301 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.742072  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 156) took 3785 ms. Trace:
I20260709 13:01:42.750459  8290 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.760766  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.761574  8542 raft_consensus.cc:2393] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:01:42.763324  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.776736  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 115272us
I20260709 13:01:42.746184  9498 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.766320  8290 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.790524  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.792101  8393 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:42.797519  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.793327  8290 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.802505  8537 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:42.803388  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.751073  8289 rpcz_store.cc:276] 0709 13:01:38.956204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.956352 (+   148us) service_pool.cc:224] Handling call
0709 13:01:39.608740 (+652388us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b5400002490. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c30b2 00007fbe1933ca89 00007fbe192d4da6 00007fbe192a6088 00007fbe193a437e 00007fbe178652a4 00007fbe17865232 00007fbe17865161 00007fbe178650dc
0709 13:01:42.741872 (+3133132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:41.764244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:41.767921 (+  3677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:41.767956 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:41.767974 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:41.812908 (+ 44934us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:41.813092 (+   184us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:41.813113 (+    21us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:41.813598 (+   485us) tablet.cc:701] Row locks acquired
0709 13:01:41.813621 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:01:41.813831 (+   210us) write_op.cc:270] Start()
0709 13:01:41.813946 (+   115us) write_op.cc:276] Timestamp: P: 1783602101813747 usec, L: 0
0709 13:01:41.813968 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:41.814801 (+   833us) log.cc:844] Serialized 1307 byte log entry
0709 13:01:42.351188 (+536387us) op_driver.cc:464] REPLICATION: finished
0709 13:01:42.408158 (+ 56970us) write_op.cc:301] APPLY: starting
0709 13:01:42.408273 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:42.408457 (+   184us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:42.498339 (+ 89882us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:42.600781 (+102442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:42.601077 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:42.601150 (+    73us) write_op.cc:312] APPLY: finished
0709 13:01:42.601459 (+   309us) log.cc:844] Serialized 34 byte log entry
0709 13:01:42.601685 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:42.601779 (+    94us) write_op.cc:454] Released schema lock
0709 13:01:42.601906 (+   127us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:42.602354 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:42.602381 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":33812736,"child_traces":[["op",{"apply.queue_time_us":56680,"apply.run_cpu_time_us":3516,"apply.run_wall_time_us":194146,"num_ops":3,"prepare.queue_time_us":118864,"prepare.run_cpu_time_us":5460,"prepare.run_wall_time_us":191997,"raft.queue_time_us":142556,"raft.run_cpu_time_us":28407,"raft.run_wall_time_us":201380,"replication_time_us":537043,"spinlock_wait_cycles":3328,"thread_start_us":360689,"threads_started":4,"wal-append.queue_time_us":1355}]]}
I20260709 13:01:42.806234  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.806988  8388 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:42.807358  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.807914  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.808547  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.795490  9512 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:42.810083  9232 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.804164  8392 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.787351  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.786187  8535 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.812273  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.814059  8393 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.779498  9399 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.819804  9524 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.820261  9524 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.820622  9524 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.800738  9485 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.822408  9301 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:42.793046  9342 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:42.824940  9342 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.825721  8538 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:42.830477  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.835309  8392 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.815348  8290 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.814435  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.808558  8388 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:42.841260  8389 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:42.844956  8386 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:42.848248  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.845510  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.851763  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.851912  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.852402  8536 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:42.852967  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.853128  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.853492  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.854296  8544 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:42.854599  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.855212  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.855916  8543 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.846552  8290 catalog_manager.cc:5697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 2, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.850205  8395 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:42.861078  9512 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:42.861214  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:42.863222  9399 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.863545  9485 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:42.864687  8538 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:42.863756  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.865496  8391 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:42.866366  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.866640  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.867005  8392 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.867338  8391 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.867866  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.868242  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.868425  8392 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:42.857853  8389 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
W20260709 13:01:42.873633  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.872289  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.874336  8391 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:42.875636  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.874081  9362 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:42.876864  8539 raft_consensus.cc:2393] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:42.877249  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.877699  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.878077  8389 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.878885  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.879038  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.880045  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.880261  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.880842  8388 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:42.881561  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.881848  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.882520  8388 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:42.883121  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.883438  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.883809  8391 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:42.884202  8388 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:42.887759  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:42.888248  9485 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:42.889962  9232 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:42.890152  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.890527  9232 raft_consensus.cc:697] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:42.890915  8544 raft_consensus.cc:2393] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:42.891841  8394 raft_consensus.cc:2410] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:42.891642  9232 consensus_queue.cc:237] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:42.892335  9351 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:42.894182  9342 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:42.889647  9485 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:01:42.875552  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.896085  9512 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:42.896495  8537 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:42.874490  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.905462  8391 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:42.907769  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.909044  8389 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.909626  8386 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:42.910995  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.909080  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.916124  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.914255  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.911775  8386 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:42.927167  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.928797  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.928982  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.929627  8462 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.930279  8544 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.930327  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.930722  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.931173  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.931419  8465 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.931432  8467 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.930647  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:42.934489  8461 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.931313  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:42.939302  9524 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.942888  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.943639  8386 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:42.944528  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.944598  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.945351  8386 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:42.945706  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.946101  8462 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:42.946161  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.946808  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.947013  8387 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:42.947533  8394 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:42.948004  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.948638  8467 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.911809  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.949658  8389 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.950495  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.951382  8467 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:42.952167  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.952744  8392 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:42.957698  8390 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:42.962693  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.962738  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:42.963603  8462 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.963083  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.963680  8463 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.964494  8461 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.963977  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.971889  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:42.941651  9524 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:42.977402  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.978734  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.979188  8391 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:42.979355  8393 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:42.978246  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.980561  8470 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:42.976593  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:42.982220  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 54178.3us
I20260709 13:01:42.983124  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.990674  8393 raft_consensus.cc:2410] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:42.987540  9398 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.983381  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:42.991653  8461 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.991338  9398 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:42.985564  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:42.986553  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:42.993216  8464 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.984905  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:42.994266  8470 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.985509  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:42.988252  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:42.966789  8538 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:42.987090  9399 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:42.997467  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:42.998147  8467 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.006268  8470 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.018970  8390 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:43.025906  8466 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.026517  8465 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.033226  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.038196  8554 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-6becd976429a45a3874a10895b19b63e received from {username='slave'} at 127.0.0.1:56998
I20260709 13:01:43.038878  8554 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-6becd976429a45a3874a10895b19b63e on tablet 6becd976429a45a3874a10895b19b63e with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:43.040345  8464 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.041365  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.041890  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.042484  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.042886  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.080964  8544 raft_consensus.cc:2393] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.043802  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.045825  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.054694  8465 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.082144  8542 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.071729  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.082392  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.045557  8463 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.073529  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.045864  9398 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:43.074501  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.054829  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.082083  8395 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.084766  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:43.085484  8390 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:43.077919  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.050384  9399 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.094224  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.094830  8463 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.095404  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.095983  8391 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.096182  9399 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:43.086134  8393 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.098712  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.099772  9398 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.100274  9398 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.102274  9398 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:43.101687  8463 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.103708  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.106235  8463 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.110081  8388 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.090155  8466 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.090669  8465 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.086292  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.091917  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.102186  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.105626  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.086788  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.051424  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:43.115345  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.116149  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.157164  8466 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.116811  8392 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.157977  8541 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:01:43.158658  8391 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.119202  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.120457  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.121899  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.123706  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:43.124022  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:43.161623  8394 raft_consensus.cc:2368] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3.
I20260709 13:01:43.125655  8463 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.125473  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.118222  8469 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.150375  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.173693  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.243564  8394 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.155334  8467 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.249105  8463 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:43.118774  8536 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.148797  8393 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.259009  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.259709  8393 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.153878  8465 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.116767  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:43.123116  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:43.271261  8395 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:01:43.118341  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 72206.2us
I20260709 13:01:43.174353  8390 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:43.272147  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.278190  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.242868  8386 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.284200  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:43.285245  8541 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.285491  8466 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.263083  8542 raft_consensus.cc:2376] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4. Re-sending same reply.
I20260709 13:01:43.161729  8389 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:43.145426  8538 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.118669  8539 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:43.269380  8392 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.291344  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:43.296146  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:43.135026  8462 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.244506  8464 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.296974  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:43.301239  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.301690  8543 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.299774  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:43.299773  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:43.303468  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:43.311018  8393 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.314015  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.314965  8395 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.315563  8470 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.300408  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.270978  8461 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.321105  8540 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.321321  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:43.321641  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.325318  8392 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.289037  8387 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:43.330067  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 44005.7us
I20260709 13:01:43.332284  8508 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.330381  8507 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.337988  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.338608  8391 raft_consensus.cc:2376] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3. Re-sending same reply.
W20260709 13:01:43.346050  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.350267  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.351815  8392 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.353150  8469 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.355847  8358 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.356778  8358 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.357692  9301 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.358502  8391 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:43.359236  8508 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.365432  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.366389  8393 raft_consensus.cc:2376] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3. Re-sending same reply.
I20260709 13:01:43.376194  8470 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.384503  8388 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.369979  8536 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:43.390892  8541 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:43.392294  8462 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.392609  8461 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:43.393064  9340 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.393347  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.393606  9340 raft_consensus.cc:697] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:43.393939  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.394531  8544 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
W20260709 13:01:43.398015  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 67713.2us
I20260709 13:01:43.398566  9485 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.403064  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.403198  8395 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.405570  8394 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:01:43.406454  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 49744.5us
I20260709 13:01:43.437289  9485 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.442478  9485 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.443174  8358 leader_election.cc:400] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:43.443684  8358 leader_election.cc:403] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.446216  9541 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:43.445268  8358 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:43.448006  9541 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:43.449769  8358 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.451292  9541 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.451798  9541 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.452256  9541 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.456619  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.457407  8470 raft_consensus.cc:2368] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:43.460456  8507 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:43.463302  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 60318.4us
I20260709 13:01:43.470613  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.471204  8508 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.472076  9388 raft_consensus.cc:2764] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:43.472190  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.473318  8462 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:01:43.474360  9533 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:01:43.401012  9512 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.375422  9524 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.433959  9301 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:43.459816  9258 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.494570  8358 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.494774  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.509330  8470 raft_consensus.cc:2393] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.508431  8508 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.512147  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.492219  9512 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.407064  9232 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:01:43.513245  9388 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:43.519299  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58915.3us
I20260709 13:01:43.514267  8461 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.524178  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.508380  9524 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.532825  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:43.535027  8358 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.550563  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.518998  9512 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.552913  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.518019  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.522541  9388 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.550794  8389 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:43.556095  8467 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:43.563062  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.531209  9524 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.565184  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.566397  8467 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.571440  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.572400  8467 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.573601  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.586330  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.557973  9362 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.588147  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.559544  9388 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.595744  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.597060  8467 raft_consensus.cc:2410] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:43.599320  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.604382  8467 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
W20260709 13:01:43.589711  9496 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:01:43.606721  8470 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.593403  8462 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:01:43.610229  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 101866us
I20260709 13:01:43.611227  8508 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.612810  8390 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.588184  8461 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:43.590304  9362 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.614400  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.603953  8464 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.594331  9540 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.626981  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.627588  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.628247  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.628441  8467 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:43.629688  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.631065  8467 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.627914  8470 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.588243  9485 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.614853  9541 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.640277  9541 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:43.564925  9340 consensus_queue.cc:237] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.569249  9301 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.617156  9362 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.658325  8467 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:43.626444  9540 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.662963  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.646057  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.677605  8461 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.660106  9549 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:43.682175  9549 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:43.682413  9546 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:43.682737  9549 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.683663  9551 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.684376  9551 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:43.666208  9065 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 1 LEARNER]: Advancing to term 3
I20260709 13:01:43.685611  9551 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:43.666971  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.669050  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.670293  9258 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.674628  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.675293  9543 raft_consensus.cc:1064] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:01:43.690570  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 99020.4us
I20260709 13:01:43.690876  8467 raft_consensus.cc:2393] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.645310  9485 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:43.730396  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 195456us
I20260709 13:01:43.662874  9550 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.691017  9540 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.741611  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.699262  9258 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:43.703624  9543 raft_consensus.cc:1068] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:43.746060  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.736888  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.748675  8470 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:43.704315  8386 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:43.704241  8464 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:43.730335  9485 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.745985  8462 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.784921  8358 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:43.790323  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 175856us
I20260709 13:01:43.786823  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.729054  9399 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:01:43.760097  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.795626  8470 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.786408  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.799768  8467 raft_consensus.cc:2393] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:01:43.747748  9537 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.241s	user 0.000s	sys 0.004s
I20260709 13:01:43.802651  8507 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:43.747440  9550 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:43.808930  8358 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.810325  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.763351  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:43.813481  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 185301us
I20260709 13:01:43.823917  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.829635  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.831177  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.832437  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.833241  8464 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.804706  9485 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:43.834707  9485 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.813592  8467 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.838181  8358 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:43.809624  9555 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.808198  9563 raft_consensus.cc:2764] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:43.817301  9232 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.817991  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:43.818374  9552 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:43.819443  9558 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.811421  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.759419  9065 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:43.829226  9549 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.846633  8508 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.847896  8358 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:43.865859  8540 consensus_meta.cc:287] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.534s	user 0.003s	sys 0.007s
I20260709 13:01:43.869333  8540 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:43.867246  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.870294  8467 raft_consensus.cc:2376] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3. Re-sending same reply.
I20260709 13:01:43.871496  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.873250  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.874189  8467 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.875120  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.876096  8467 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.877039  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.878367  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.879278  8467 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:43.880235  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.881587  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.889597  8470 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.868459  8462 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:43.863698  9541 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.887247  9388 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.886358  9560 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:43.890254  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 47034.5us
I20260709 13:01:43.863175  9554 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:43.893116  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.895802  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.895866  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.862071  9232 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.901652  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.902388  8470 raft_consensus.cc:2393] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.868471  9555 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:43.889212  8463 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:43.881044  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.829234  9258 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.888855  9549 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:43.903075  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.864616  9399 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:01:43.909138  8465 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:43.906931  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.932595  8467 raft_consensus.cc:2368] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:43.935072  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.914831  8508 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:43.897603  9541 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.937130  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:43.913275  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:43.909951  9564 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
W20260709 13:01:44.060695  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 145702us
W20260709 13:01:43.938059  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 90255.8us
I20260709 13:01:44.155539  8507 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:43.997737  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.157073  8465 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:43.937750  8470 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:43.910015  9558 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.907569  9232 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.909101  9340 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.907176  9554 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.936638  8464 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:44.179406  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 791) took 1193 ms. Trace:
I20260709 13:01:44.167126  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.174537  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.181365  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.180042  8468 rpcz_store.cc:276] 0709 13:01:42.985751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.160401 (+174650us) service_pool.cc:224] Handling call
0709 13:01:43.160733 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.161058 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.161081 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.266048 (+104967us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.503114 (+237066us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:43.503185 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.503285 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.008921 (+505636us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b24000ee148. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe102809c4 00007fbe1027eacb 00007fbe10439dc9 00007fbe10439a55 00007fbe10438fb0 00007fbe130af488 00007fbe130afbe8 00007fbe13087398 00007fbe1308276a 00007fbe13081bb6
0709 13:01:44.009364 (+   443us) raft_consensus.cc:1685] finished
0709 13:01:44.009386 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.179338 (+169952us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23915,"raft.queue_time_us":760,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":63913,"spinlock_wait_cycles":35121920,"thread_start_us":175769,"threads_started":1,"wal-append.queue_time_us":320612}
I20260709 13:01:44.182938  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.183096  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.183627  8469 raft_consensus.cc:2376] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3. Re-sending same reply.
I20260709 13:01:44.184662  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:44.185487  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.012288  9538 raft_consensus.cc:1064] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:43.914373  9543 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.939132  9541 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.190611  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:44.186103  9560 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.171854  8462 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.913400  9550 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:43.987519  9258 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:44.009208  9388 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:44.005918  9561 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.189106  8468 raft_consensus.cc:2376] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3. Re-sending same reply.
I20260709 13:01:44.159896  8358 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:44.179386  9563 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.224121  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.102183  8461 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:44.180601  9554 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.011165  9524 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:44.120729  9571 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:44.012593  9362 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:44.229317  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 314556us
I20260709 13:01:44.231931  8469 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:44.230896  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.233040  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.221028  9577 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:44.211977  9538 raft_consensus.cc:1068] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:44.212126  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 807) took 1067 ms. Trace:
I20260709 13:01:44.235260  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:44.243924  8465 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:44.243824  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.235260  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.236441  8470 raft_consensus.cc:2410] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:44.244835  8469 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:01:44.244985  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 54449.9us
I20260709 13:01:44.245535  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.245893  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.246853  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.247304  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.247800  8470 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:01:44.237021  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.190796  9558 raft_consensus.cc:697] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:44.231520  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 71700.1us
I20260709 13:01:44.214310  9340 raft_consensus.cc:697] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:44.250258  9340 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.250859  8358 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:44.250352  9558 consensus_queue.cc:237] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.251955  9301 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:44.240449  8467 raft_consensus.cc:2368] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:44.254230  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 808) took 1141 ms. Trace:
I20260709 13:01:44.255170  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 809) took 1142 ms. Trace:
I20260709 13:01:44.255894  8467 rpcz_store.cc:276] 0709 13:01:43.112682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.254331 (+1141649us) service_pool.cc:224] Handling call
0709 13:01:44.254633 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.254809 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.254844 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.254895 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:44.254936 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.255001 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.255108 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.258350  9549 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:44.259372  8468 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:44.260275  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 810) took 1147 ms. Trace:
I20260709 13:01:44.262104  8467 rpcz_store.cc:276] 0709 13:01:43.113185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.257030 (+1143845us) service_pool.cc:224] Handling call
0709 13:01:44.257330 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.257601 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.257634 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.257702 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:44.257743 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.260063 (+  2320us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.260190 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.249234  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 807) took 1137 ms. Trace:
I20260709 13:01:44.264897  8469 rpcz_store.cc:276] 0709 13:01:43.112174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.248338 (+1136164us) service_pool.cc:224] Handling call
0709 13:01:44.248676 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.248862 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.248899 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.248951 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:44.248992 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.249058 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.249178 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.254736  8470 rpcz_store.cc:276] 0709 13:01:43.112422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.248442 (+1136020us) service_pool.cc:224] Handling call
0709 13:01:44.253569 (+  5127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.253779 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.253833 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.253888 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:44.253932 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.254001 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.254123 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.269912  8470 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:44.006217  9555 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.272445  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.273973  8466 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:44.008244  9512 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.271407  8469 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:44.275238  8466 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:44.289168  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 808) took 1148 ms. Trace:
I20260709 13:01:44.232132  9561 raft_consensus.cc:697] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.232524  9563 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.289568  8391 rpcz_store.cc:276] 0709 13:01:43.141025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.399630 (+258605us) service_pool.cc:224] Handling call
0709 13:01:43.399996 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.615239 (+215243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.615286 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.625272 (+  9986us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.890281 (+265009us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:43.890332 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.890402 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.288935 (+398533us) raft_consensus.cc:1685] finished
0709 13:01:44.288962 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.289104 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5461,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"thread_start_us":408508,"threads_started":2,"wal-append.queue_time_us":343168}
I20260709 13:01:44.275228  9572 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:44.294029  9549 raft_consensus.cc:697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:01:44.287015  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.298638  9547 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:44.300549  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 233152us
I20260709 13:01:44.301400  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 802) took 1162 ms. Trace:
I20260709 13:01:44.303695  8469 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:44.301854  8392 rpcz_store.cc:276] 0709 13:01:43.139423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.360063 (+220640us) service_pool.cc:224] Handling call
0709 13:01:43.360403 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.525645 (+165242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.525676 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.689771 (+164095us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b2c00000c88. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:01:43.690154 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.838515 (+148361us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:43.930165 (+ 91650us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.300929 (+370764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.301014 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.301054 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:44.301156 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.301322 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":111798,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":273621,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":7669,"spinlock_wait_cycles":4469888,"thread_start_us":670871,"threads_started":4,"wal-append.queue_time_us":196006}
W20260709 13:01:44.308492  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.243238  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:44.317525  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 65428.1us
I20260709 13:01:44.318814  8470 raft_consensus.cc:3055] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:44.319402  8470 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:44.320580  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 85124.3us
I20260709 13:01:44.302867  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.230376  9543 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.321669  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:44.323784  8359 leader_election.cc:336] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.516s (SENT)
I20260709 13:01:44.329464  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:44.329964  8358 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:44.331404  8508 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:44.349213  8470 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:44.417483  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 86228.8us
W20260709 13:01:44.384366  9570 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:01:44.420075  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 116226us
I20260709 13:01:44.320528  9258 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:01:44.418002  8461 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:01:44.439302  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.417098  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 114918us
I20260709 13:01:44.420928  8470 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:44.442637  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 112723us
I20260709 13:01:44.311460  9578 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:44.421964  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:44.383767  9362 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:44.348080  8464 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:44.455869  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:44.444303  8507 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:44.451071  8358 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:44.386073  9572 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:44.462426  9581 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:44.540580  9581 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:44.540957  8462 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:44.472725  9541 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.541523  9581 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.543006  9581 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.478420  9550 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.543889  9541 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:44.464327  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:44.463546  9543 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:44.465131  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:44.466298  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:44.543889  9550 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.547025  8465 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:44.468823  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.474711  9398 raft_consensus.cc:1064] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:44.547706  9550 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
W20260709 13:01:44.548537  9398 raft_consensus.cc:1068] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:44.441685  9340 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:01:44.328856  9561 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.243387  8388 rpcz_store.cc:276] 0709 13:01:43.140727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.385477 (+244750us) service_pool.cc:224] Handling call
0709 13:01:43.407276 (+ 21799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.515764 (+108488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.518513 (+  2749us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.576478 (+ 57965us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.813109 (+236631us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:43.823292 (+ 10183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.845597 (+ 22305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.003256 (+157659us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b5400380520. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe1345cdbe 00007fbe13467930 00007fbe134678d8 00007fbe13467858 00007fbe13467813 00007fbe13466a9c 00007fbe19352626 00007fbe1934cdd8 00007fbe134a37cb 00007fbe134a62c0
0709 13:01:44.166402 (+163146us) raft_consensus.cc:1685] finished
0709 13:01:44.171522 (+  5120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.208052 (+ 36530us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79262,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":26441,"spinlock_wait_cycles":22596352,"thread_start_us":195548,"threads_started":1,"wal-append.queue_time_us":216338}
I20260709 13:01:44.310751  9560 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.451862  9232 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:44.558632  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50744 (request call id 156) took 2186 ms. Trace:
I20260709 13:01:44.421741  9564 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.530747  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.458552  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 616) took 1056 ms. Trace:
I20260709 13:01:44.532848  9585 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:44.532786  9586 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:44.537889  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:44.571779  8392 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
W20260709 13:01:44.538039  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 58975.3us
I20260709 13:01:44.443786  9399 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.325513  9549 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.541872  9524 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:44.551942  8289 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 4 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.561267  9340 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.529002  8508 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:44.599222  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 71113.9us
I20260709 13:01:44.599725  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:44.531649  9592 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.421314  9301 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
W20260709 13:01:44.522918  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 78690.8us
I20260709 13:01:44.568025  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:44.578888  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:44.578888  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:44.557569  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 106558us
I20260709 13:01:44.607041  8466 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:44.607295  8540 raft_consensus.cc:2410] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:44.589869  8289 catalog_manager.cc:5697] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 2 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:44.592465  9585 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:44.559139  8290 rpcz_store.cc:276] 0709 13:01:42.372374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.372605 (+   231us) service_pool.cc:224] Handling call
0709 13:01:44.558572 (+2185967us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:43.395218 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:43.395758 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:43.395788 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:01:43.395805 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:43.396618 (+   813us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:43.396680 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:43.396713 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:01:43.397195 (+   482us) tablet.cc:701] Row locks acquired
0709 13:01:43.397216 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:43.397346 (+   130us) write_op.cc:270] Start()
0709 13:01:43.397454 (+   108us) write_op.cc:276] Timestamp: P: 1783602103397305 usec, L: 0
0709 13:01:43.397477 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:43.469993 (+ 72516us) log.cc:844] Serialized 2520 byte log entry
0709 13:01:43.913343 (+443350us) op_driver.cc:464] REPLICATION: finished
0709 13:01:44.302456 (+389113us) write_op.cc:301] APPLY: starting
0709 13:01:44.305256 (+  2800us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:44.326477 (+ 21221us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:44.342336 (+ 15859us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:44.343466 (+  1130us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:44.343780 (+   314us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:01:44.343855 (+    75us) write_op.cc:312] APPLY: finished
0709 13:01:44.344256 (+   401us) log.cc:844] Serialized 52 byte log entry
0709 13:01:44.344478 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:44.344648 (+   170us) write_op.cc:454] Released schema lock
0709 13:01:44.344704 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:44.345065 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:44.345091 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6936,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":330358,"apply.run_cpu_time_us":3541,"apply.run_wall_time_us":54921,"num_ops":6,"prepare.queue_time_us":395059,"prepare.run_cpu_time_us":3698,"prepare.run_wall_time_us":75095,"replication_time_us":515699,"thread_start_us":576553,"threads_started":2}]]}
I20260709 13:01:44.600014  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:44.560719  9485 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.599884  8508 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:44.588696  9399 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.610941  8544 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
W20260709 13:01:44.615114  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.617866  8507 leader_election.cc:400] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3.
W20260709 13:01:44.619948  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 296239us
W20260709 13:01:44.620638  8359 leader_election.cc:336] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.516s (SENT)
I20260709 13:01:44.620822  8540 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:44.622062  8470 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:44.622540  8470 pending_rounds.cc:85] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 1
I20260709 13:01:44.622828  8470 pending_rounds.cc:107] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:44.624044  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:44.575471  9564 raft_consensus.cc:697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.619457  8507 leader_election.cc:403] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.628335  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:44.629215  8541 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:01:44.633615  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.634285  8466 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:44.627161  8508 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:44.616948  8463 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:44.635099  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:44.598521  9512 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:44.599009  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.569000  8461 rpcz_store.cc:276] 0709 13:01:43.398286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.243379 (+845093us) service_pool.cc:224] Handling call
0709 13:01:44.454775 (+211396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.630704  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:44.594710  9572 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.640149  8466 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:44.640468  8470 raft_consensus.cc:2889] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:44.616309  9594 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.642089  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.642954  9258 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3.
I20260709 13:01:44.643522  8508 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:44.666528  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.707566  8359 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.530s (SENT)
W20260709 13:01:44.650286  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.672415  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.644778  9232 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:44.712916  8468 raft_consensus.cc:2410] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:01:44.707762  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 64323.8us
W20260709 13:01:44.682062  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 64352.9us
I20260709 13:01:44.619772  9592 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.707862  8543 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.638303  9578 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.634409  9398 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.635986  9340 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:44.718629  8507 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:44.707048  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 582) took 1322 ms. Trace:
I20260709 13:01:44.666930  9485 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.639907  9586 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:44.644521  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:44.771032  8467 rpcz_store.cc:276] 0709 13:01:43.385044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.264056 (+879012us) service_pool.cc:224] Handling call
0709 13:01:44.264452 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.265497 (+  1045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.265540 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.267033 (+  1493us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.313861 (+ 46828us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:44.643870 (+330009us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.706527 (+ 62657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.706650 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.706727 (+    77us) raft_consensus.cc:1685] finished
0709 13:01:44.706748 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.706956 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1520,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":36686,"thread_start_us":360994,"threads_started":2,"wal-append.queue_time_us":189497}
W20260709 13:01:44.773026  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 65498.2us
W20260709 13:01:44.775674  8359 leader_election.cc:336] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.540s (SENT)
I20260709 13:01:44.644526  9551 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.776604  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:44.771478  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.713631  9577 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.743810  8539 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:44.733402  9563 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:44.773247  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:44.770735  9594 raft_consensus.cc:697] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.770118  9301 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.801841  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:44.802155  8462 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:44.644608  9584 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.340s
I20260709 13:01:44.785864  9398 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:44.817032  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 98491.5us
I20260709 13:01:44.801776  9598 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:01:44.825285  9398 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:44.829842  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.832520  9554 consensus_meta.cc:287] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 13:01:44.801932  8536 raft_consensus.cc:2368] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:44.645201  9583 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 13:01:44.833062  9554 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:01:44.837105  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.795228  9551 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:44.806449  9543 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.844928  8359 leader_election.cc:336] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.643s (SENT)
W20260709 13:01:44.843983  9589 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:01:44.860530  8359 leader_election.cc:336] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.732s (SENT)
I20260709 13:01:44.835011  9399 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.810587  9301 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.784854  9586 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.902124  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:44.862814  9538 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.911702  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:44.918845  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.898630  9398 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.934662  9615 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:44.803236  9585 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:44.935747  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 114212us
I20260709 13:01:44.941175  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:44.852901  9543 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:44.910770  9598 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:44.948130  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 96224.9us
I20260709 13:01:44.854382  9340 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:44.904487  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 66273us
I20260709 13:01:44.938695  9581 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:44.845620  9564 consensus_queue.cc:237] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.859074  9485 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.946297  9590 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:44.856144  9592 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:45.010913  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 97363.8us
I20260709 13:01:44.984166  9581 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:44.947484  9398 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.045199  9587 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:45.045699  9587 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:45.046075  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:45.047189  9563 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.048357  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:45.049306  9563 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:45.053031  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 60417.6us
I20260709 13:01:44.943904  9538 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.060328  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:45.022927  9581 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:45.064497  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:45.066403  9606 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.067008  9606 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:45.068874  9549 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:44.936714  9594 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:44.987780  9551 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.076568  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:45.082099  9549 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.071358  9563 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.094982  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:45.082121  9577 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:45.106437  8543 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:45.093921  9554 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:45.108037  9524 raft_consensus.cc:2764] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:45.136096  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.115950  9563 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:45.140955  9603 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:01:45.141455  9611 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:45.114812  9301 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:45.124455  9540 consensus_meta.cc:287] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 1.341s	user 0.009s	sys 0.005s
I20260709 13:01:45.169730  9398 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:45.165197  9586 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:45.173930  9608 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:01:45.178443  9614 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:01:45.181978  9619 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.182642  9619 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:45.193101  9605 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:01:45.163208  9540 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.194073  9618 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:01:45.195042  9577 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:45.199600  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 104726us
I20260709 13:01:45.204442  8359 leader_election.cc:400] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:45.163393  9543 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:45.210739  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.165606  9611 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:45.224339  9538 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:45.208039  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 166173us
I20260709 13:01:45.232403  9388 raft_consensus.cc:1064] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:01:45.251893  9388 raft_consensus.cc:1068] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:45.269040  9340 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:45.273999  9578 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:45.278512  9578 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.281360  9069 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:45.283502  9611 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:45.284842  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:45.285246  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:45.286689  9606 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:45.287130  9540 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:45.288657  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:45.298075  8543 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:45.298468  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.298868  9616 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:45.299408  9616 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:45.301518  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:45.301765  9575 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:45.302143  8543 raft_consensus.cc:2376] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4. Re-sending same reply.
I20260709 13:01:45.302242  9575 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.305255  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:45.306054  8541 raft_consensus.cc:2376] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4. Re-sending same reply.
I20260709 13:01:45.313722  9538 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:45.314320  9538 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.326503  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:45.326927  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:45.327358  8543 raft_consensus.cc:2393] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:45.328223  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:45.328764  8540 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:45.329360  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 55426.1us
I20260709 13:01:45.314514  9618 raft_consensus.cc:1064] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:45.293604  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:45.339534  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:45.340483  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:45.343693  8542 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:45.314761  9538 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.356983  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:45.334451  9340 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:45.341197  9543 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.351843  9615 raft_consensus.cc:1064] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:45.371918  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:45.374500  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:45.375250  8395 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:45.342449  9618 raft_consensus.cc:1068] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:45.374048  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:45.351693  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:45.381265  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:45.388695  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:45.389472  8468 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.382982  8358 leader_election.cc:400] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:45.386273  8466 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:45.390293  8358 leader_election.cc:403] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:45.391369  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:45.391311  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:45.392153  8394 raft_consensus.cc:2393] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:45.395717  8358 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:45.396986  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:45.344967  9581 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.396989  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:45.403671  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:45.404204  8466 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.397686  8465 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.402536  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:45.405370  8469 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.405556  8467 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:01:45.382575  9615 raft_consensus.cc:1068] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:45.363816  9606 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:45.370523  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:45.408655  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:45.409580  8395 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:45.450248  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 46645.9us
I20260709 13:01:45.449558  9575 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:45.455626  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:45.380519  9340 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.456306  9619 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:45.487859  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:45.596398  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 184150us
I20260709 13:01:45.387105  9618 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.596884  8395 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:45.407663  9512 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.597282  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 223306us
I20260709 13:01:45.598701  9581 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:45.600374  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 191748us
I20260709 13:01:45.396904  9631 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:01:45.391861  9301 consensus_queue.cc:1059] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:01:45.403043  9549 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:45.402477  9577 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.601604  8469 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:01:45.604511  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.398116  8386 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.375809  9586 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:01:45.311818  9550 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:45.485953  9610 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.362458  9590 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:45.481963  9623 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.641526  8465 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:45.413183  9543 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.642132  8468 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:01:45.643704  8359 leader_election.cc:336] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.557s (SENT)
I20260709 13:01:45.644655  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:45.647490  8467 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.660290  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:45.682793  8539 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:45.743602  8466 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:45.650665  9606 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:45.803850  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 160175us
W20260709 13:01:45.804701  8359 leader_election.cc:336] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.558s (SENT)
I20260709 13:01:45.805187  8359 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:45.692298  9616 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:45.807367  8468 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:45.689432  9512 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.669680  9618 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.821280  9554 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:45.703289  9577 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:45.747008  9538 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:45.839365  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 91313.2us
W20260709 13:01:45.960546  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 310817us
W20260709 13:01:45.999492  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 354888us
I20260709 13:01:46.000056  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:45.864529  8469 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:45.801563  9581 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.995581  8467 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:01:45.924389  9643 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:01:46.000854  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:46.012954  9069 consensus_meta.cc:287] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 0.729s	user 0.014s	sys 0.021s
I20260709 13:01:45.994295  9549 raft_consensus.cc:697] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:46.002434  9623 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.011053  9543 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:46.022771  9606 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:46.040834  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:46.044482  8466 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:46.039958  9665 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:46.049965  9638 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:01:46.051301  9648 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.051949  9648 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:46.059803  9651 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:01:46.060035  8461 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.060993  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 647) took 1444 ms. Trace:
I20260709 13:01:46.061414  8538 rpcz_store.cc:276] 0709 13:01:44.616437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.618802 (+  2365us) service_pool.cc:224] Handling call
0709 13:01:44.801405 (+182603us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2eee 0000000000375939 00007fbe184361e0 00007fbe184ff0c4 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:44.801561 (+   156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.848505 (+ 46944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.851214 (+  2709us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.882503 (+ 31289us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.314671 (+432168us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b180023e000. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:01:45.645382 (+330711us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:45.645452 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.645561 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.060718 (+415157us) raft_consensus.cc:1685] finished
0709 13:01:46.060753 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.060908 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45674,"raft.queue_time_us":76598,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":14294,"spinlock_wait_cycles":29371008,"thread_start_us":330482,"threads_started":1,"wal-append.queue_time_us":861474}
I20260709 13:01:46.062613  9549 consensus_queue.cc:237] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.068567  9586 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.071125  9340 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.018355  9581 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:46.082969  9650 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:01:46.086405  9618 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.090956  9648 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.091426  9581 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.034937  9543 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:46.049553  9640 log.cc:927] Time spent T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:01:46.093648  8461 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:46.121101  9626 log.cc:927] Time spent T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.918s	user 0.001s	sys 0.000s
I20260709 13:01:46.109946  8469 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.079881  9623 consensus_queue.cc:1059] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:01:46.123155  9619 raft_consensus.cc:3055] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:46.123565  9619 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:46.124630  9619 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.115279  9618 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.126722  9618 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.126919  9587 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.128307  9587 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.128902  9618 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.093529  9543 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:46.132088  9512 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:46.096846  9577 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:46.137343  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 649) took 1156 ms. Trace:
I20260709 13:01:46.137917  8536 rpcz_store.cc:276] 0709 13:01:44.980472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.986590 (+  6118us) service_pool.cc:224] Handling call
0709 13:01:45.061518 (+ 74928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.275043 (+213525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.275097 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.396897 (+121800us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.002997 (+606100us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:46.014257 (+ 11260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.023396 (+  9139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.137040 (+113644us) raft_consensus.cc:1685] finished
0709 13:01:46.137066 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.137267 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":153954,"raft.queue_time_us":165500,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":137,"thread_start_us":364934,"threads_started":2,"wal-append.queue_time_us":647080}
I20260709 13:01:46.147478  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:46.109470  8464 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:46.109097  9496 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.713s	user 0.001s	sys 0.001s
I20260709 13:01:46.159842  8468 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:46.095824  9538 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.165314  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:46.166117  8468 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:46.167058  8464 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.167407  8468 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.147650  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 650) took 1165 ms. Trace:
I20260709 13:01:46.165153  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:46.183458  8541 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:46.184630  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 148538us
I20260709 13:01:46.186837  8392 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:46.189055  8538 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.189455  8391 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.182538  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:46.190812  9618 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:46.192198  8393 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.193959  8536 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.191193  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:46.215195  8392 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.215803  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.217526  8395 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:46.217998  8395 pending_rounds.cc:85] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 1
I20260709 13:01:46.218251  8395 pending_rounds.cc:107] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:46.218474  8395 raft_consensus.cc:2889] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:46.223150  8508 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:46.224568  8390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.021s
I20260709 13:01:46.198729  9618 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.185297  8461 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:46.232697  8538 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:46.225978  8390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.003s	sys 0.022s
I20260709 13:01:46.183597  9543 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.235846  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:46.172714  8539 rpcz_store.cc:276] 0709 13:01:44.982586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.983872 (+  1286us) service_pool.cc:224] Handling call
0709 13:01:45.213405 (+229533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.809385 (+595980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.139973 (+330588us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54000b54d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:46.142593 (+  2620us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493782784}
I20260709 13:01:46.221575  8462 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.240696  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:46.245771  8395 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:46.239022  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:46.262013  8508 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:46.236792  9618 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:46.265712  9618 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.221284  9665 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:46.266440  9618 raft_consensus.cc:1064] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:46.267544  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:46.268967  8508 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:46.276532  8508 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:46.278782  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.239024  9564 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:46.224607  9582 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:01:46.316298  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.226269  9584 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:01:46.360589  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 80973.6us
I20260709 13:01:46.266885  8389 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:46.357347  9575 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.273056  9558 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:46.352528  9301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.015s
I20260709 13:01:46.273178  9232 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:46.355195  9524 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:46.293045  9618 raft_consensus.cc:1068] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:46.273298  9615 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:46.372225  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 95759.3us
I20260709 13:01:46.373363  8391 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:46.389534  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 102860us
I20260709 13:01:46.395335  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:46.395744  9667 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:01:46.375332  9637 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:46.372195  9661 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:01:46.375140  9658 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:46.370573  9572 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.399580  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:46.413897  9301 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:46.414736  9572 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.417011  9572 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.375833  9575 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.424160  9575 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:46.359912  9671 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.406551  9663 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:46.428092  9671 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.425534  9564 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:46.429803  9564 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.430389  9671 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.407472  9543 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.448511  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:46.454039  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 50716.4us
I20260709 13:01:46.454815  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:46.464133  9584 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:46.464630  9584 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:46.461732  9547 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.465068  9584 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.468293  9558 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:46.469024  9558 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.471782  9558 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:46.461740  9637 raft_consensus.cc:697] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:46.473479  9637 consensus_queue.cc:237] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.454089  9663 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.486590  9663 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.480734  9673 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.095285  8386 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:46.526470  9673 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.527343  9543 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.527961  9585 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.541569  9661 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.564893  8467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.066s	sys 0.088s
I20260709 13:01:46.547188  9540 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
W20260709 13:01:46.571477  8467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.067s	sys 0.088s
I20260709 13:01:46.559373  9543 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.562340  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 815) took 1230 ms. Trace:
I20260709 13:01:46.567015  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 833) took 1177 ms. Trace:
I20260709 13:01:46.593335  8470 rpcz_store.cc:276] 0709 13:01:45.389631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.806243 (+416612us) service_pool.cc:224] Handling call
0709 13:01:45.849605 (+ 43362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.849877 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:46.173536 (+323659us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.566669 (+393133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.566724 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:46.566770 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.566851 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.566960 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79589,"prepare.queue_time_us":177219,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2023,"raft.queue_time_us":2213,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3358,"thread_start_us":579009,"threads_started":2}
I20260709 13:01:46.562361  9661 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.560773  9585 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:46.575673  9549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.014s	sys 0.033s
I20260709 13:01:46.692142  8391 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:46.688597  9572 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.696864  9676 log.cc:927] Time spent T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:46.696996  9673 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.591270  8386 rpcz_store.cc:276] 0709 13:01:45.327321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.334569 (+  7248us) service_pool.cc:224] Handling call
0709 13:01:46.557552 (+1222983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.699486  8469 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.665756  9575 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.665331  9618 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.741712  8433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.021s	sys 0.055s
W20260709 13:01:46.788416  8433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.022s	sys 0.055s
I20260709 13:01:46.788313  9618 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:46.789122  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 573394us
I20260709 13:01:46.789925  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:46.790931  9665 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.777429  9671 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:46.791586  9618 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.791899  9671 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:46.787055  9575 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.795742  9543 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.705904  9663 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.702306  9572 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.808681  9584 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:46.810997  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.811751  9585 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:46.854513  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 43634.9us
I20260709 13:01:46.855463  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.862233  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:46.862665  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.823395  9671 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:46.848762  9543 raft_consensus.cc:2764] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:46.870294  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 415525us
I20260709 13:01:46.875176  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.862249  9618 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:46.862141  9662 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:46.874557  9615 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:46.864996  9578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.022s
I20260709 13:01:46.887807  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.870558  9524 raft_consensus.cc:697] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:46.873852  9671 raft_consensus.cc:2764] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:46.892611  9578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.023s
I20260709 13:01:46.900897  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.881167  9618 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:46.884627  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:46.891649  9665 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:46.884827  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:46.882359  9232 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:46.895645  9575 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:46.899262  9543 raft_consensus.cc:2764] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:46.886991  9561 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:01:46.912120  9618 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.894219  9662 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:46.959515  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58727.5us
W20260709 13:01:46.961340  9678 log.cc:927] Time spent T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:01:46.966004  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46536.1us
I20260709 13:01:46.922662  9671 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:46.967641  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.984164  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.979393  8508 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:46.966836  9681 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:01:46.991528  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 837) took 1321 ms. Trace:
I20260709 13:01:46.994222  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:46.994257  8467 rpcz_store.cc:276] 0709 13:01:45.670201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.003664 (+333463us) service_pool.cc:224] Handling call
0709 13:01:46.004081 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.004331 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:46.578057 (+573726us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.991090 (+413033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.991171 (+    81us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:46.991231 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.991332 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.991476 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":153865,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":1050,"raft.queue_time_us":3458,"thread_start_us":963695,"threads_started":2}
I20260709 13:01:46.953541  9550 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:01:46.966513  9578 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:46.981833  9572 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:46.982213  9584 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:46.989682  9665 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:47.009120  8508 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:46.985544  9637 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:01:46.982683  9671 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:46.995419  9693 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:46.993321  9538 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:47.008649  9564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.014s	sys 0.036s
I20260709 13:01:46.997325  9399 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:01:47.017922  9682 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:47.043404  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:47.042662  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49581.1us
I20260709 13:01:46.986703  9615 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.041302  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.034996  9693 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:47.032392  9671 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:47.037724  9564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.015s	sys 0.037s
I20260709 13:01:47.050144  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:46.996640  9524 consensus_queue.cc:237] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:47.051517  9687 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:01:47.053090  9679 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:01:47.048885  9684 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:01:47.070546  8508 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:47.046411  9682 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:47.003732  9232 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:47.077111  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 82928.6us
I20260709 13:01:47.067108  9693 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.094419  8466 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:47.095649  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:47.095721  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:47.096223  8466 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.096710  8468 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:47.082726  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:47.072324  9584 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:47.072894  9637 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:47.080753  9691 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:47.110754  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:47.111223  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:47.111899  8469 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:47.080060  9682 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.166812  9662 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:47.169478  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 86862.4us
W20260709 13:01:47.314592  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.125478  8539 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:47.319187  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.343643  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.334719  9618 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.064342  9258 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:47.326586  8466 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:47.350991  8543 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:47.327665  9671 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.335469  9572 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:47.124899  9665 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:47.341166  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.321943  9693 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.352639  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.352316  8543 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:47.363391  9585 consensus_queue.cc:1059] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:01:47.370050  9585 consensus_queue.cc:1243] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:47.371201  9068 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:47.361495  9572 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:47.376293  8359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.570s	user 0.013s	sys 0.025s
W20260709 13:01:47.376688  8359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.571s	user 0.013s	sys 0.025s
W20260709 13:01:47.377187  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.57238e+06us
I20260709 13:01:47.381057  9623 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:47.385773  8359 leader_election.cc:336] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.565s (SENT)
I20260709 13:01:47.386449  8359 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:47.426749  9572 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:47.427031  9682 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:47.431874  9618 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:47.432694  9671 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:47.438735  8540 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:47.362574  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 829) took 1991 ms. Trace:
I20260709 13:01:47.443133  9663 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:47.479023  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 840) took 1280 ms. Trace:
I20260709 13:01:47.479689  8394 rpcz_store.cc:276] 0709 13:01:46.198847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.199005 (+   158us) service_pool.cc:224] Handling call
0709 13:01:46.199374 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.199608 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:46.219140 (+ 19532us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.209182 (+990042us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800347500. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a 00007fbe134f1a2a
0709 13:01:47.478486 (+269304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.478566 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:47.478634 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.478734 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.478936 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13428,"prepare.queue_time_us":19310,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"spinlock_wait_cycles":4720512,"thread_start_us":140237,"threads_started":1}
I20260709 13:01:47.487150  9558 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:47.486788  9543 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:47.515094  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 159629us
I20260709 13:01:47.489123  9661 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:47.519515  9682 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:47.523871  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.526717  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:47.525490  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:47.570202  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 229134us
I20260709 13:01:47.550551  9661 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:01:47.582324  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.594116  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.583920  9693 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:47.586591  9716 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:47.586875  9713 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:47.617439  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:47.629422  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 243667us
W20260709 13:01:47.630249  8359 connection.cc:256] RPC call timeout handler was delayed by -1.8556332960000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 13:01:47.635481  8359 leader_election.cc:336] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.579s (SENT)
W20260709 13:01:47.637135  8359 leader_election.cc:336] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.580s (SENT)
I20260709 13:01:47.637933  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:47.446406  8388 rpcz_store.cc:276] 0709 13:01:45.362748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.450776 (+ 88028us) service_pool.cc:224] Handling call
0709 13:01:45.639278 (+188502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.161737 (+522459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.163070 (+  1333us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.183461 (+ 20391us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.591047 (+407586us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:46.640854 (+ 49807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.647822 (+  6968us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.336931 (+689109us) raft_consensus.cc:1685] finished
0709 13:01:47.337933 (+  1002us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.349948 (+ 12015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13268,"raft.queue_time_us":359708,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":16280,"thread_start_us":789598,"threads_started":2,"wal-append.queue_time_us":634604}
I20260709 13:01:47.609061  9716 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:01:47.645247  8359 connection.cc:256] RPC call timeout handler was delayed by -1.839620352000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:01:47.619611  9717 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:47.615056  9713 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:47.647001  8359 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.005s (SENT)
I20260709 13:01:47.646467  9709 raft_consensus.cc:2764] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:47.662725  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.626842  9708 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:47.668270  9714 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:01:47.648384  9661 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:47.662894  9713 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:47.666973  9712 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:01:47.683408  9716 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.694912  9716 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:47.706228  9707 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:01:47.706470  9690 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.706991  9690 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:47.707798  9720 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:01:47.708621  9710 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:47.709939  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 831) took 2320 ms. Trace:
I20260709 13:01:47.710289  8465 rpcz_store.cc:276] 0709 13:01:45.389144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.800072 (+410928us) service_pool.cc:224] Handling call
0709 13:01:45.800437 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.826919 (+ 26482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.850038 (+ 23119us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.850474 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.211093 (+1360619us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b1800341320. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:01:47.483911 (+272818us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:47.483969 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.484069 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.709632 (+225563us) raft_consensus.cc:1685] finished
0709 13:01:47.709656 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.709864 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26239,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8353,"spinlock_wait_cycles":12250368,"thread_start_us":163250,"threads_started":1,"wal-append.queue_time_us":1665659}
I20260709 13:01:47.709297  9690 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:47.713682  8507 connection.cc:256] RPC call timeout handler was delayed by -1.1059762350000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:01:47.714329  9563 raft_consensus.cc:3055] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:47.714176  9690 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.714707  9563 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:47.715837  9563 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.717075  9563 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.718470  9592 raft_consensus.cc:1064] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:01:47.718891  9592 raft_consensus.cc:1068] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:47.720188  9577 raft_consensus.cc:1064] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:01:47.720583  9577 raft_consensus.cc:1068] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:01:47.714596  8507 connection.cc:256] RPC call timeout handler was delayed by -1.0924762349999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:01:47.721988  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 59388.3us
W20260709 13:01:47.723517  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 76461us
I20260709 13:01:47.662194  9717 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.726287  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.730770  8507 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:47.727921  8359 connection.cc:256] RPC call timeout handler was delayed by -1.752648186999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 13:01:47.734099  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.682s (SENT) [suppressed 54 similar messages]
I20260709 13:01:47.738001  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.746852  8507 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:47.750921  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.751437  8470 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:47.764844  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.763439  9709 raft_consensus.cc:2764] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:47.749392  9577 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:47.768627  9693 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:47.769541  9607 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:47.770648  9607 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:47.771106  9607 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.778674  9717 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:47.779358  9607 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.714915  9690 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.753149  9592 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:47.791469  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.760524  9718 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:47.795928  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.797960  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.799459  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:47.789443  9607 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:47.793694  9717 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:47.807896  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 73818.8us
I20260709 13:01:47.818408  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:47.818732  9692 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:47.811153  9682 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:47.861912  9733 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:01:47.859503  9706 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:01:47.898407  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.918524  8359 connection.cc:256] RPC call timeout handler was delayed by -1.5610926699999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260709 13:01:47.919106  9577 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:47.919827  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 110035us
I20260709 13:01:47.918975  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.920919  9672 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.920701  9713 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:47.801988  9708 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:47.800122  9709 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:47.926014  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 841) took 1726 ms. Trace:
I20260709 13:01:47.800510  9721 raft_consensus.cc:2764] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:47.928066  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 848) took 1726 ms. Trace:
I20260709 13:01:47.928398  9690 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:47.929265  8469 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:47.930228  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 678) took 1059 ms. Trace:
I20260709 13:01:47.802549  9715 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:48.007236  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:47.934501  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.938688  9538 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.012848  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:47.946350  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 668) took 1125 ms. Trace:
I20260709 13:01:47.949862  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.013669  8469 raft_consensus.cc:2368] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:48.014139  8466 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.950320  8543 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:47.831141  9578 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:47.952610  8464 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:47.953223  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.954687  9619 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.956167  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:47.964807  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.022065  8392 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:47.965989  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.023197  8394 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:47.970796  8537 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:47.971855  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:47.974119  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:47.975312  8359 connection.cc:256] RPC call timeout handler was delayed by -1.4402220919999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 13:01:47.978653  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:47.982368  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:47.983052  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.003937  9717 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.005746  8391 rpcz_store.cc:276] 0709 13:01:46.212426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.409999 (+197573us) service_pool.cc:224] Handling call
0709 13:01:46.411117 (+  1118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.692775 (+281658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.927832 (+1235057us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540010c054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:47.928008 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645096320}
I20260709 13:01:48.007624  8540 rpcz_store.cc:276] 0709 13:01:46.871308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.344676 (+473368us) service_pool.cc:224] Handling call
0709 13:01:47.344955 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.439350 (+ 94395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.929976 (+490626us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b5400189cd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:47.930162 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215065984}
I20260709 13:01:48.004681  9682 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.011575  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.012084  9693 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:47.997260  9708 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.019899  9538 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:48.024228  8359 connection.cc:256] RPC call timeout handler was delayed by -1.2565003729999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:01:48.024468  8395 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
W20260709 13:01:48.037727  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1242003730000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 13:01:48.038141  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1026003730000298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:01:48.038544  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0963003730000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 13:01:48.038926  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0936003730000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:01:48.024219  8393 raft_consensus.cc:2410] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:48.039296  8359 connection.cc:256] RPC call timeout handler was delayed by -1.075600373000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 13:01:48.026669  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:48.007323  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.028628  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:48.029006  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.029395  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:48.030231  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 669) took 1209 ms. Trace:
I20260709 13:01:48.032028  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:48.008777  9715 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.018332  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.005419  9606 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:48.040937  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:48.041770  8542 rpcz_store.cc:276] 0709 13:01:46.821302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.821490 (+   188us) service_pool.cc:224] Handling call
0709 13:01:46.845008 (+ 23518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.057741 (+212733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.057774 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.057834 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:47.057863 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.030033 (+972170us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54000fb254. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:48.030076 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.030181 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488698752}
W20260709 13:01:48.039721  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0387003730000401s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:01:48.046430  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0018003730000373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
I20260709 13:01:48.045199  8395 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:48.046331  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:47.997876  9672 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:48.044687  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.048013  8465 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:48.027662  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 665) took 1780 ms. Trace:
I20260709 13:01:48.010407  9637 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:48.063182  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:48.088225  8466 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:48.067485  9662 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.065801  8538 rpcz_store.cc:276] 0709 13:01:46.241636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.277993 (+ 36357us) service_pool.cc:224] Handling call
0709 13:01:47.820646 (+1542653us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2eee 0000000000375939 00007fbe184361e0 00007fbe184ff0c4 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:48.020743 (+200097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5887872}
I20260709 13:01:48.068749  8391 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:48.032970  9693 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:01:48.099459  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 87827.1us
I20260709 13:01:48.013804  8539 rpcz_store.cc:276] 0709 13:01:46.820880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.822733 (+  1853us) service_pool.cc:224] Handling call
0709 13:01:46.866763 (+ 44030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.353108 (+486345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.946110 (+593002us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002b7854. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:47.946287 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522319232}
I20260709 13:01:48.075703  9713 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:48.077742  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.077919  9692 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:48.036713  9708 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.036546  9709 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:01:48.037063  8536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 664) took 1797 ms (client timeout 2213 ms). Trace:
I20260709 13:01:48.079730  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:48.081372  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.048736  9715 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.998425  8387 rpcz_store.cc:276] 0709 13:01:46.199122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.201289 (+  2167us) service_pool.cc:224] Handling call
0709 13:01:47.925277 (+1723988us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:47.925487 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.925659 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.925685 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.925731 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:47.925763 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.925843 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.925959 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5039872}
I20260709 13:01:48.069451  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:48.092357  8359 leader_election.cc:336] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.549s (SENT)
I20260709 13:01:48.096093  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.097059  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:48.118185  8359 leader_election.cc:336] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.605s (SENT)
I20260709 13:01:48.118398  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:48.118602  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.099570  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:48.119828  8359 leader_election.cc:336] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.701s (SENT)
I20260709 13:01:48.120136  8540 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:48.120225  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.097828  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:48.123476  8469 raft_consensus.cc:2368] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:48.101106  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:48.036036  9682 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.125238  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.125839  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:48.106418  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 96407.6us
I20260709 13:01:48.081630  9558 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:48.063968  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.132434  8395 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.033208  9717 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.045544  9524 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:01:48.103499  9693 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.070390  9672 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:48.099025  9598 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.032888  8462 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:48.133891  9558 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:48.134517  8359 leader_election.cc:336] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.803s (SENT)
I20260709 13:01:48.131891  9716 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:48.135533  8508 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:48.126128  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.137174  8388 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:01:48.152076  8465 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.114809  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.136672  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:48.157648  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.125666  9540 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.107044  9662 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:01:48.112912  8536 rpcz_store.cc:269] 0709 13:01:46.239534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.241919 (+  2385us) service_pool.cc:224] Handling call
0709 13:01:47.820331 (+1578412us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2eee 0000000000375939 00007fbe184361e0 00007fbe184ff0c4 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:48.035236 (+214905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42469632}
I20260709 13:01:48.131232  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:48.150422  8359 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.805s (SENT)
I20260709 13:01:48.207324  8359 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:48.208201  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 57828.1us
I20260709 13:01:48.116199  9709 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:48.209146  8359 leader_election.cc:336] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.813s (SENT)
I20260709 13:01:48.159067  8395 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:48.210227  9709 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:48.210461  9672 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.136749  8386 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:48.142009  9578 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:01:48.214643  9751 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:48.215049  9751 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:01:48.215258  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54445us
I20260709 13:01:48.216001  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:48.216323  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 54809.3us
I20260709 13:01:48.217729  9592 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:48.218114  9592 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:48.218454  9592 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:48.213611  8359 leader_election.cc:336] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.830s (SENT)
I20260709 13:01:48.222514  8468 raft_consensus.cc:2410] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:48.222433  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.215425  9751 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.302429  8465 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:48.153405  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:48.318711  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 101500us
W20260709 13:01:48.320168  9746 log.cc:927] Time spent T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:01:48.404273  9747 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.405s	user 0.003s	sys 0.003s
I20260709 13:01:48.405444  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 868) took 1312 ms. Trace:
I20260709 13:01:48.406363  9718 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.406646  9584 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:48.407260  9584 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.406957  9718 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.409267  9718 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:48.235927  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 75788.1us
I20260709 13:01:48.148391  9598 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.307371  8464 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:48.143414  9577 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:01:48.390414  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 867) took 1297 ms. Trace:
W20260709 13:01:48.393697  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 180094us
I20260709 13:01:48.434578  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:48.146096  9637 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.148s
W20260709 13:01:48.399253  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 182110us
I20260709 13:01:48.399587  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.403084  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:48.403226  8389 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
W20260709 13:01:48.435148  8359 leader_election.cc:336] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.837s (SENT)
I20260709 13:01:48.406759  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 861) took 1315 ms. Trace:
I20260709 13:01:48.439760  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.398625  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.405854  8467 rpcz_store.cc:276] 0709 13:01:47.092979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.116496 (+ 23517us) service_pool.cc:224] Handling call
0709 13:01:47.975228 (+858732us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:47.975426 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.975786 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.975814 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.978808 (+  2994us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.999405 (+ 20597us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:47.999447 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.999507 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.403709 (+404202us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:48.405233 (+  1524us) raft_consensus.cc:1685] finished
0709 13:01:48.405253 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.405389 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7684,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2094,"spinlock_wait_cycles":68173952,"thread_start_us":20238,"threads_started":1,"wal-append.queue_time_us":20565}
I20260709 13:01:48.432235  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 27) took 5509 ms. Trace:
I20260709 13:01:48.446699  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.395897  9258 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:01:48.341531  9745 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:01:48.401319  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.444547  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.483860  8390 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:48.444734  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.434818  8468 rpcz_store.cc:276] 0709 13:01:47.092806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.102664 (+  9858us) service_pool.cc:224] Handling call
0709 13:01:48.355481 (+1252817us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400096ad4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:48.390288 (+ 34807us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534214912}
I20260709 13:01:48.398229  9702 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.450206  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.459621  8359 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.840s (SENT)
I20260709 13:01:48.484947  8466 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:48.425067  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.427093  9572 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:48.446478  8289 rpcz_store.cc:276] 0709 13:01:42.904690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.905325 (+   635us) service_pool.cc:224] Handling call
0709 13:01:48.413765 (+5508440us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:44.817124 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:44.817940 (+   816us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:44.817984 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:01:44.818010 (+    26us) tablet.cc:662] Decoding operations
0709 13:01:44.818574 (+   564us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:44.818646 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:44.818688 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:44.819122 (+   434us) tablet.cc:701] Row locks acquired
0709 13:01:44.819143 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:44.819327 (+   184us) write_op.cc:270] Start()
0709 13:01:44.819458 (+   131us) write_op.cc:276] Timestamp: P: 1783602104819269 usec, L: 0
0709 13:01:44.819488 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:01:44.820398 (+   910us) log.cc:844] Serialized 974 byte log entry
0709 13:01:45.059445 (+239047us) op_driver.cc:464] REPLICATION: finished
0709 13:01:45.273641 (+214196us) write_op.cc:301] APPLY: starting
0709 13:01:45.274742 (+  1101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:45.308950 (+ 34208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:45.309078 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:45.309406 (+   328us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:45.342367 (+ 32961us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:45.351970 (+  9603us) write_op.cc:312] APPLY: finished
0709 13:01:45.374610 (+ 22640us) log.cc:844] Serialized 28 byte log entry
0709 13:01:45.412408 (+ 37798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:45.648596 (+236188us) write_op.cc:454] Released schema lock
0709 13:01:45.650624 (+  2028us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:45.736662 (+ 86038us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:45.738998 (+  2336us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20873,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":182574,"apply.run_cpu_time_us":14645,"apply.run_wall_time_us":433394,"num_ops":2,"prepare.queue_time_us":183444,"prepare.run_cpu_time_us":3710,"prepare.run_wall_time_us":7624,"replication_time_us":193392,"thread_start_us":141399,"threads_started":2}]]}
I20260709 13:01:48.481372  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:48.485687  8359 leader_election.cc:336] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.860s (SENT)
I20260709 13:01:48.486776  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.565156  8465 raft_consensus.cc:2376] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3. Re-sending same reply.
W20260709 13:01:48.488458  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 47799us
I20260709 13:01:48.434015  9666 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.496057  8392 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:48.478991  9258 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:48.439831  9716 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.498538  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.436771  9585 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:48.440821  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.574798  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.439782  9682 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:48.577425  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.512570  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.579569  8468 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:48.514086  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.515398  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.581094  8467 raft_consensus.cc:2376] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3. Re-sending same reply.
I20260709 13:01:48.482896  9232 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:48.485692  9672 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.439101  9708 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.517827  9702 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.518131  8387 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:48.550948  9598 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:48.551450  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.551671  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:48.552817  8543 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:48.556178  9748 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:48.557310  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.561959  8463 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:48.492849  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.569530  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.541518  8390 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:48.616034  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.616175  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.616935  8390 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:48.617079  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.571391  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.583850  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.587237  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.593816  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 667) took 2297 ms. Trace:
I20260709 13:01:48.594617  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.594818  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.620837  8468 raft_consensus.cc:2368] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:48.622408  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.600770  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.623219  8465 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:48.602140  8395 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:48.595567  9717 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:48.613308  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.626241  8470 raft_consensus.cc:2393] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:48.603641  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.570796  9582 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:01:48.631359  8389 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:48.639428  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:48.630978  8395 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:48.632150  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.640919  8390 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.619146  8544 rpcz_store.cc:276] 0709 13:01:46.277397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.277503 (+   106us) service_pool.cc:224] Handling call
0709 13:01:48.082104 (+1804601us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:48.082290 (+   186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.082648 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.082685 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.083275 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.203455 (+120180us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:48.203513 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.203610 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.563330 (+359720us) raft_consensus.cc:1685] finished
0709 13:01:48.563350 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.574837 (+ 11487us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":32664448,"thread_start_us":119774,"threads_started":1,"wal-append.queue_time_us":448273}
I20260709 13:01:48.634847  8467 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
W20260709 13:01:48.648032  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 162354us
W20260709 13:01:48.649061  8359 leader_election.cc:336] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.901s (SENT)
I20260709 13:01:48.574069  9666 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:48.653462  8359 leader_election.cc:336] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.942s (SENT)
I20260709 13:01:48.667266  8359 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:48.668462  8359 leader_election.cc:336] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.972s (SENT)
I20260709 13:01:48.669122  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.583339  9716 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.611461  9232 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:48.686328  8390 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:48.594233  9585 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.652503  9637 raft_consensus.cc:1064] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:48.687701  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.688479  8393 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:48.689057  9716 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:48.445601  8461 rpcz_store.cc:276] 0709 13:01:47.091171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.095176 (+  4005us) service_pool.cc:224] Handling call
0709 13:01:47.112971 (+ 17795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.496044 (+383073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.511072 (+ 15028us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.578788 (+ 67716us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.647898 (+ 69110us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:47.661734 (+ 13836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.665881 (+  4147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.405944 (+740063us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b24000ee0b8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe102809c4 00007fbe1027eacb 00007fbe10439dc9 00007fbe10439a55 00007fbe10438fb0 00007fbe130af488 00007fbe130afbe8 00007fbe13087398 00007fbe1308276a 00007fbe13081bb6
0709 13:01:48.406436 (+   492us) raft_consensus.cc:1685] finished
0709 13:01:48.406467 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.406697 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2333,"raft.queue_time_us":263695,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"spinlock_wait_cycles":2533632,"thread_start_us":375049,"threads_started":2,"wal-append.queue_time_us":131810}
I20260709 13:01:48.634516  8464 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:48.690374  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.602491  9584 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.686405  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.708017  8470 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:48.666910  9672 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:48.601250  9693 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:48.708602  8467 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
W20260709 13:01:48.695251  8359 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.984s (SENT)
I20260709 13:01:48.709591  8392 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:01:48.735410  8359 leader_election.cc:336] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.988s (SENT)
I20260709 13:01:48.735811  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.718278  8538 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:48.670836  9598 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.693051  9662 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:48.733939  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.713864  9584 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:48.697042  9572 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:48.707167  9637 raft_consensus.cc:1068] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:48.745123  8393 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:48.750051  8393 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:48.751266  8467 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:48.751714  8467 pending_rounds.cc:85] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 1
I20260709 13:01:48.751991  8467 pending_rounds.cc:107] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:48.752293  8467 raft_consensus.cc:2889] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:48.765465  8467 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:48.750890  8393 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.784973  8393 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.739930  8388 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.731639  8462 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:48.742318  9540 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.754890  8387 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:48.790851  9623 raft_consensus.cc:1064] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:01:48.791282  9623 raft_consensus.cc:1068] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:48.791576  9693 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:48.792527  9708 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:48.753933  9715 consensus_meta.cc:287] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.628s	user 0.004s	sys 0.005s
I20260709 13:01:48.725016  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58874 (request call id 54) took 1020 ms. Trace:
I20260709 13:01:48.785559  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.766353  8386 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:48.783593  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.814357  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.814563  8393 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:48.865152  8393 pending_rounds.cc:85] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 1
I20260709 13:01:48.865499  8393 pending_rounds.cc:107] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:48.865850  8393 raft_consensus.cc:2889] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:48.867726  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.838773  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.872260  8466 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:48.847874  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.874547  8461 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:48.875986  8461 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:48.877884  8461 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.851554  8467 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:48.882653  8467 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:48.860212  8539 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:48.861101  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 248865us
W20260709 13:01:48.863139  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 127746us
W20260709 13:01:48.886658  8359 leader_election.cc:336] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.089s (SENT)
W20260709 13:01:48.887712  8359 leader_election.cc:336] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.129s (SENT)
W20260709 13:01:48.888716  8359 leader_election.cc:336] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.146s (SENT)
I20260709 13:01:48.889209  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.892912  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:48.893174  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:48.903609  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.855839  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.793182  9232 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.908864  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.909559  8465 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:48.913318  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.914024  8392 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.915639  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.894762  8462 raft_consensus.cc:1240] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:48.890112  9577 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:48.926299  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:48.847293  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.921962  9540 consensus_queue.cc:1059] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:48.907562  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:48.953715  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:48.920892  8508 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:48.950866  9592 consensus_meta.cc:287] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.003s
I20260709 13:01:48.956847  9592 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.958678  8395 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:48.959244  9592 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:48.816932  9068 rpcz_store.cc:276] 0709 13:01:47.704443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.704613 (+   170us) service_pool.cc:224] Handling call
0709 13:01:47.705009 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.433435 (+728426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.438985 (+  5550us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.440701 (+  1716us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:48.455664 (+ 14963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.724558 (+268894us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b540034bcd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:48.724674 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.724907 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215578368}
W20260709 13:01:48.960762  9538 consensus_meta.cc:287] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.877s	user 0.004s	sys 0.007s
I20260709 13:01:48.962270  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:48.913506  9598 consensus_queue.cc:1059] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:01:48.897627  9682 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.908106  9666 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:48.817510  9715 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:48.919745  9751 consensus_meta.cc:287] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.000s
I20260709 13:01:48.922204  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:48.841279  9258 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.934724  9718 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:48.935209  9399 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:01:48.948592  9762 consensus_queue.cc:1059] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:01:48.935473  9577 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:49.012137  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:49.037672  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 72374.8us
I20260709 13:01:49.050661  8391 raft_consensus.cc:2410] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:49.055285  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 160369us
W20260709 13:01:49.063714  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 175011us
W20260709 13:01:49.065445  8359 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.157s (SENT)
I20260709 13:01:48.952080  9768 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:49.035327  9763 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:01:49.068238  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:49.072741  8468 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:48.967319  8536 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:48.964857  9585 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.043983  8392 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:48.966140  9592 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:49.036100  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 113986us
I20260709 13:01:48.993755  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:49.086618  8464 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:49.084295  8469 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:01:49.062820  9558 consensus_meta.cc:287] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.005s
I20260709 13:01:49.004446  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:48.966202  9613 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:48.988003  9598 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:49.037266  9718 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.092010  9598 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:49.092342  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:49.050661  9708 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:49.092533  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:49.091398  9613 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.089566  9558 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:48.967089  9538 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.090539  9540 consensus_queue.cc:1243] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:49.105435  9577 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:01:49.109812  8359 leader_election.cc:336] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.233s (SENT)
I20260709 13:01:49.117686  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:48.969453  9682 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.112360  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.101640  8470 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:49.051277  9751 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.090116  9258 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:49.097693  9718 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.089555  8464 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:49.091612  9717 consensus_queue.cc:1059] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:49.138716  8391 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:49.139119  8391 pending_rounds.cc:85] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 1
I20260709 13:01:49.139438  8391 pending_rounds.cc:107] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:49.139693  8391 raft_consensus.cc:2889] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:49.140924  8391 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:49.123718  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.101143  9708 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.141902  9708 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.145236  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 705) took 1071 ms. Trace:
I20260709 13:01:49.145747  8466 rpcz_store.cc:276] 0709 13:01:48.073561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.872937 (+799376us) service_pool.cc:224] Handling call
0709 13:01:48.873203 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.894710 (+ 21507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.894740 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.895254 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.968765 (+ 73511us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:48.968826 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.968927 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.144964 (+176037us) raft_consensus.cc:1685] finished
0709 13:01:49.144993 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.145168 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3170,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7860,"thread_start_us":38400,"threads_started":1,"wal-append.queue_time_us":122424}
I20260709 13:01:49.111580  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 712) took 1033 ms. Trace:
I20260709 13:01:49.150116  8461 rpcz_store.cc:276] 0709 13:01:48.084981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.878833 (+793852us) service_pool.cc:224] Handling call
0709 13:01:48.879203 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.063064 (+183861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.071163 (+  8099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.073609 (+  2446us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:49.090502 (+ 16893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.097853 (+  7351us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.109107 (+ 11254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24898,"raft.queue_time_us":43128,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":20931}
I20260709 13:01:49.155695  8542 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:49.156441  9768 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:49.157069  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.157833  9715 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.105856  9550 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:01:49.159560  9715 raft_consensus.cc:1064] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:01:49.159955  9715 raft_consensus.cc:1068] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:49.161186  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.162070  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.163301  8464 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:49.165200  8464 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:49.116797  9399 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:01:49.166427  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.168437  8467 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:49.168738  9666 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:49.125636  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.107965  9613 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.101349  9592 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:49.171290  8390 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:49.171360  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:49.171747  8390 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:49.172638  8390 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.173432  9558 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:49.176384  9771 log.cc:927] Time spent T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:01:49.178964  9751 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:49.179172  9682 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.094023  9690 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:01:49.136242  9623 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:49.137338  9538 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.138280  9776 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:49.138993  9717 raft_consensus.cc:3055] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:49.173774  8390 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.202984  8390 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:49.131332  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:49.203960  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 72712.3us
I20260709 13:01:49.205142  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:49.206156  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:49.207095  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:49.182595  8391 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:49.189168  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 62139.2us
I20260709 13:01:49.192358  8541 raft_consensus.cc:1240] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:49.215076  8358 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.182898  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.180193  8388 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:49.171685  9592 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.220197  9775 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.220398  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.220896  9778 consensus_queue.cc:1059] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:49.222151  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.222252  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.222878  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.225224  8387 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:49.225706  9585 consensus_queue.cc:1059] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:49.218101  9561 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:49.227231  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:49.220275  8464 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:49.228752  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45945.7us
I20260709 13:01:49.229386  8390 pending_rounds.cc:85] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 1
I20260709 13:01:49.247656  8390 pending_rounds.cc:107] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:49.247897  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.248116  8390 raft_consensus.cc:2889] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:49.218806  9538 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:49.233059  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:49.225356  9613 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.192974  9623 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:49.193938  9717 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:49.226023  9702 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.233079  9776 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:49.237042  9682 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:49.255645  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 48628.9us
I20260709 13:01:49.256582  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:49.249187  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 136908us
I20260709 13:01:49.259215  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.227690  9715 consensus_queue.cc:1059] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:01:49.258827  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:49.252823  9756 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:49.264272  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.267102  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.285410  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.286823  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.251359  9538 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.301183  9232 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:49.258127  9776 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.255795  9682 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:49.313961  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.262449  9768 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:49.273255  9702 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:49.269354  9585 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.247830  9561 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.380162  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:49.301476  9540 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:49.386047  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 127253us
I20260709 13:01:49.305047  9778 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:49.418845  9258 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.300166  9775 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:49.419450  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 114282us
I20260709 13:01:49.304704  9715 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:49.417089  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 49279.6us
I20260709 13:01:49.308053  9538 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:49.429862  9782 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:01:49.311333  9672 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:49.440722  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0494677640000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3347s for a response
W20260709 13:01:49.441229  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.304160  9606 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 13:01:49.372726  9682 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.312974  9776 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.444236  8544 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:49.308331  9758 consensus_queue.cc:1059] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:01:49.418149  9540 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.422559  9789 raft_consensus.cc:3055] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:49.426985  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:49.437105  9716 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:01:49.244066  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:01:49.422868  9778 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.429615  9715 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.378154  9399 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:01:49.431833  9585 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.443058  9672 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.379824  9708 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.421269  9578 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:01:49.432114  9793 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:49.448908  9693 raft_consensus.cc:3055] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:01:49.501253  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 73828.6us
I20260709 13:01:49.508610  9768 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:49.470897  9781 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:01:49.531494  8470 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:49.483212  8464 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.461007  9540 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.524114  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.461670  9789 raft_consensus.cc:740] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:49.459600  9751 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:01:49.502442  8538 raft_consensus.cc:606] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:49.524770  9672 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.473327  9778 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.417128  9717 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.505334  9715 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.539752  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:49.528249  9613 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:49.504815  9797 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.547462  8465 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:49.541652  8290 catalog_manager.cc:5697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:01:49.526671  9693 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:49.572795  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:49.591063  8290 catalog_manager.cc:5697] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.591917  8468 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.592731  9797 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.579113  9811 consensus_queue.cc:1059] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:49.596191  9811 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.596836  9811 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.597318  9811 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.598050  9808 raft_consensus.cc:3055] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:49.598450  9808 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:49.599538  9811 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.599331  9808 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:49.600082  9811 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.600554  9811 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:49.551108  9561 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:49.601857  9764 log.cc:927] Time spent T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.640s	user 0.006s	sys 0.006s
I20260709 13:01:49.457038  9623 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.583531  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:49.531381  9796 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.604308  9708 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.605873  8290 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.526998  9585 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.552534  9798 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.628093  8468 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:49.587275  9787 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:49.614790  8290 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.634415  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:49.644502  8467 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.645812  8290 catalog_manager.cc:5697] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.647720  8290 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.658541  8290 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:01:49.537273  9768 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.600558  9808 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.661770  8290 catalog_manager.cc:5697] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:01:49.633694  9702 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:49.646282  9717 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:49.668632  9792 log.cc:927] Time spent T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:01:49.670734  8290 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 3 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:49.665777  9788 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:01:49.668632  9795 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:01:49.685920  9811 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:49.717406  8290 catalog_manager.cc:5697] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.689869  9801 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.690443  9702 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.668946  9708 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.692698  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:49.693315  9682 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.693610  9538 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.693634  9778 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.695217  9768 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.695147  9540 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.764511  9778 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.765061  9540 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.765291  8469 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:49.698454  8462 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:49.762920  9538 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.635113  9796 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.701306  9797 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.701620  8464 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:01:49.702427  9790 log.cc:927] Time spent T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
W20260709 13:01:49.706651  9572 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:01:49.706542  9748 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:49.708324  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 691) took 1157 ms. Trace:
I20260709 13:01:49.801200  8536 rpcz_store.cc:276] 0709 13:01:48.550735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.551808 (+  1073us) service_pool.cc:224] Handling call
0709 13:01:48.552190 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.090397 (+538207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.708020 (+617623us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54000fd054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:49.708250 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943789952}
I20260709 13:01:49.802166  8464 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:49.709266  8388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 631) took 1389 ms (client timeout 1792 ms). Trace:
W20260709 13:01:49.803592  8388 rpcz_store.cc:269] 0709 13:01:48.391249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.391772 (+   523us) service_pool.cc:224] Handling call
0709 13:01:49.709070 (+1317298us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54003c7154. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:49.709201 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644596096}
I20260709 13:01:49.713517  9756 raft_consensus.cc:1064] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:01:49.714072  9715 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.807752  9715 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:49.715175  9718 consensus_meta.cc:287] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.005s
I20260709 13:01:49.808503  9718 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:49.808367  9756 consensus_queue.cc:237] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:49.715976  9813 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:49.810171  9813 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.810791  9718 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.812314  9813 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.718731  8468 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:49.721493  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 197450us
I20260709 13:01:49.813460  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.721644  8290 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:49.718341  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 287990us
I20260709 13:01:49.744956  9598 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:49.747498  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.815335  8290 catalog_manager.cc:5697] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.748108  9666 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:49.752641  8470 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:49.756116  9752 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.762910  9682 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.697533  9585 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.776067  8467 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
W20260709 13:01:49.782074  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.659994  9798 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:49.789754  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.769644  9796 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.789609  9748 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:49.742939  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 864) took 1177 ms. Trace:
I20260709 13:01:49.816591  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:49.870488  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 54007.3us
I20260709 13:01:49.816377  9776 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.871608  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.872366  9702 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.788614  9708 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.818643  9693 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:49.879200  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:49.879829  8470 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:49.880590  9798 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.880781  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:49.822314  8290 catalog_manager.cc:5697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.877403  8461 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:49.882467  8290 catalog_manager.cc:5697] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 3 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.884217  8290 catalog_manager.cc:5697] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:01:49.826627  9813 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.871618  9793 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:49.887339  9793 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:49.864728  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.867467  8508 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.735391  9801 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.788968  9672 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:49.826143  9666 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:49.850848  9662 raft_consensus.cc:3055] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:49.873205  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.893138  8470 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:49.896386  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.866233  9598 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.889706  8463 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:49.916401  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.876317  9623 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:49.941555  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 68407.1us
I20260709 13:01:49.944754  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.873224  9776 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:49.946668  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.947901  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.949460  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.869735  8389 rpcz_store.cc:276] 0709 13:01:48.565771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.135888 (+570117us) service_pool.cc:224] Handling call
0709 13:01:49.741968 (+606080us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:49.742218 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.742463 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.742502 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.742566 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:49.742613 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.742704 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.742842 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45790080}
I20260709 13:01:49.952931  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.953485  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 890) took 1108 ms. Trace:
I20260709 13:01:49.954020  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.955232  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.965612  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.970275  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:49.906661  9662 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:49.982613  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.944352  9813 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:49.802768  9789 consensus_queue.cc:260] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:49.955471  9798 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:49.981010  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.986073  8395 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:49.995620  8508 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:49.987429  8394 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:49.988157  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:49.997069  8538 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:49.954845  9796 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.992195  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.973852  8470 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:49.861816  9752 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:49.966660  9592 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:01:49.997080  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:49.964632  9682 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:50.008792  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:49.977638  9755 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.001936  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:49.966562  9606 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:49.971835  9821 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.993474  9623 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.998034  9232 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:49.966430  9578 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:49.971880  9702 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.995223  9585 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:01:50.014366  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:50.015357  8465 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:49.976881  9577 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:49.977031  9399 consensus_queue.cc:1059] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:50.003671  9584 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:49.991883  9692 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.016556  9798 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:49.994154  9613 consensus_queue.cc:1059] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:50.009819  9813 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.060720  9258 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:50.057180  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:49.998961  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:49.983067  9666 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:50.084146  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.066370  8387 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:49.967609  9748 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:50.005090  9717 consensus_queue.cc:1175] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "92314b14f5554885a80c3dc87f4beed4" responder_term: 2 status { last_received { term: 2 index: 3 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 3 } }
I20260709 13:01:50.066601  9682 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:50.098533  8359 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:50.071938  9702 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.072898  9584 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:50.161886  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 63451.5us
I20260709 13:01:50.164804  8359 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:50.163686  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:50.018819  9755 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.107447  9798 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.023854  9662 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.167366  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:50.168623  9802 consensus_queue.cc:1059] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:50.169912  9787 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.170365  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 896) took 1062 ms. Trace:
I20260709 13:01:50.108624  9582 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.170608  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:50.132436  9778 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:50.190234  9778 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.190789  9778 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.103938  9682 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:50.193989  9682 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:50.165424  9818 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 13:01:50.166747  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 170381us
I20260709 13:01:49.953938  8386 rpcz_store.cc:276] 0709 13:01:48.845263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.167401 (+322138us) service_pool.cc:224] Handling call
0709 13:01:49.758249 (+590848us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:49.758528 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.759059 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.759094 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.759792 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.873368 (+113576us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:49.876677 (+  3309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.888346 (+ 11669us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.953158 (+ 64812us) raft_consensus.cc:1685] finished
0709 13:01:49.953192 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.953424 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":33048320,"thread_start_us":70098,"threads_started":1,"wal-append.queue_time_us":191762}
I20260709 13:01:50.177146  9748 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.106696  9540 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:01:50.165158  9585 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.162650  9702 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.186275  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.132931  9814 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:01:50.162588  9708 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.190313  9805 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:50.166293  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 198870us
I20260709 13:01:50.177451  9672 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.175321  9796 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.186201  9787 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.184116  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:50.188709  9662 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.263592  8508 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:50.180454  9798 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.198679  9801 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.202194  9775 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:50.241138  9822 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:01:50.215966  8464 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.244694  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.287925  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.215576  9592 consensus_queue.cc:1059] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
W20260709 13:01:50.288412  9817 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:01:50.270262  9692 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:50.298022  9752 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:50.328874  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 892) took 1483 ms. Trace:
I20260709 13:01:50.286576  9577 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:50.333550  8391 rpcz_store.cc:276] 0709 13:01:48.846910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.208872 (+361962us) service_pool.cc:224] Handling call
0709 13:01:49.232338 (+ 23466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.232705 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.232732 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.237464 (+  4732us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.604409 (+366945us) spinlock_profiling.cc:243] Waited 975 us on lock 0x7b1800256c00. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:01:49.830535 (+226126us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:49.830577 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.830644 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.322794 (+492150us) raft_consensus.cc:1685] finished
0709 13:01:50.322817 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.328790 (+  5973us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10493,"raft.queue_time_us":680,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":6688,"spinlock_wait_cycles":2244224,"thread_start_us":225944,"threads_started":1,"wal-append.queue_time_us":705625}
I20260709 13:01:50.186759  8461 rpcz_store.cc:276] 0709 13:01:49.108438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.151952 (+ 43514us) service_pool.cc:224] Handling call
0709 13:01:49.152392 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.882073 (+729681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.170112 (+288039us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54001cacd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:50.170302 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640611072}
I20260709 13:01:50.306530  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:50.292160  9775 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.331813  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:50.275023  9797 consensus_queue.cc:1175] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c45599d1dc3b4823b857cf77f276dc7b" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:50.266527  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:50.187831  9572 consensus_queue.cc:1175] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:50.293256  9796 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.272279  9584 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.352387  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:50.360523  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:50.364300  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:50.341897  9775 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.386723  9798 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.386962  9582 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:50.387219  8464 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:50.389716  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 910) took 1196 ms. Trace:
I20260709 13:01:50.396214  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:50.398000  8391 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.397614  8466 rpcz_store.cc:276] 0709 13:01:49.193583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.802933 (+609350us) service_pool.cc:224] Handling call
0709 13:01:49.803219 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.803568 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.803605 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.804141 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.939579 (+135438us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:49.939621 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.939691 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.389457 (+449766us) raft_consensus.cc:1685] finished
0709 13:01:50.389486 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.389644 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2065,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":85165,"threads_started":1,"wal-append.queue_time_us":204942}
W20260709 13:01:50.394348  9835 log.cc:927] Time spent T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:01:50.361665  9613 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:50.412971  8391 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:50.413977  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:50.414592  8391 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:50.427228  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:50.428292  8391 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:50.367724  9842 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.390174  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.456380  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:50.480772  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 282165us
I20260709 13:01:50.442327  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:50.446736  9672 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.459828  9829 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:01:50.487914  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.429664  9755 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:50.490073  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 226588us
I20260709 13:01:50.449939  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:50.450104  9702 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.408730  9512 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:01:50.440593  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:50.503175  8391 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:50.504730  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.508906  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:50.509591  8391 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:01:50.500342  9598 consensus_meta.cc:287] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.560s	user 0.003s	sys 0.007s
W20260709 13:01:50.503898  9834 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:01:50.512392  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:50.447008  9842 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.515427  8391 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:50.503396  9796 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.520006  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.510730  8464 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:50.484055  9752 consensus_queue.cc:1059] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:50.501760  9802 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.523327  8542 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.492408  9672 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.527675  9856 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.528205  9856 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:50.529955  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.531234  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.533318  9672 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.519919  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.547317  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.521294  9613 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:50.552675  9540 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.551095  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.526845  9598 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.558125  9561 raft_consensus.cc:3055] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:50.508695  9828 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.220s
I20260709 13:01:50.561933  9855 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.558864  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.562543  9855 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.565047  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.565577  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:50.557658  9838 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:01:50.553045  9858 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:01:50.551967  9592 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:50.553818  9672 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:50.570489  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46452.6us
I20260709 13:01:50.560842  9561 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:50.561225  9540 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.563167  9598 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.583662  9592 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:50.598562  9561 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.599123  8461 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:50.599774  9561 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.600271  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:50.601157  8461 raft_consensus.cc:2410] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:50.598580  9592 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.603159  9592 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.604596  9540 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.586618  9672 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:50.606556  9840 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:50.607170  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 888) took 1538 ms. Trace:
I20260709 13:01:50.607563  9856 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.609617  8463 rpcz_store.cc:276] 0709 13:01:49.068359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.071255 (+  2896us) service_pool.cc:224] Handling call
0709 13:01:49.592223 (+520968us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:49.592427 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.946084 (+353657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.606903 (+660819us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54003a07d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:50.607092 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658160768}
I20260709 13:01:50.610472  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.610852  9672 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.539395  9802 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:50.597131  9577 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:50.611783  9613 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.626751  9598 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.629554  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:50.627480  9232 raft_consensus.cc:3055] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:50.639421  9232 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:50.640240  9232 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.618656  9853 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.618816  9842 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.616063  9830 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:01:50.664048  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.641855  8395 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.638671  9598 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.641309  9232 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:50.662724  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.636137  9682 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.592410  9756 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:50.622079  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:50.690343  9778 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.687652  9598 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.692982  9598 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.693226  9778 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.624042  9846 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:50.696382  9846 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:50.696312  9787 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:50.702382  9787 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.640550  9775 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.707683  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 908) took 1538 ms. Trace:
I20260709 13:01:50.708233  8469 rpcz_store.cc:276] 0709 13:01:49.169424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.768239 (+598815us) service_pool.cc:224] Handling call
0709 13:01:49.768492 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.878237 (+109745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.878284 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.878332 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:49.878365 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.707382 (+829017us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000a00d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:50.707445 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.707610 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248590208}
I20260709 13:01:50.717845  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 891) took 1872 ms. Trace:
I20260709 13:01:50.718425  8393 rpcz_store.cc:276] 0709 13:01:48.845578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.170167 (+324589us) service_pool.cc:224] Handling call
0709 13:01:49.524881 (+354714us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:49.525068 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.699376 (+174308us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:49.699717 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.831747 (+132030us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.831822 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:49.831882 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.717579 (+885697us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540036ddd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:50.717636 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.717771 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36794,"prepare.queue_time_us":619,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":36821,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":13022,"spinlock_wait_cycles":426943744,"thread_start_us":128779,"threads_started":1,"wal-append.queue_time_us":116688}
I20260709 13:01:50.723598  8392 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:50.705698  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:01:50.730512  9065 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:01:50.729004  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.685530  9853 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.727166  8388 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:50.734442  9860 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.741268  9855 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:50.743163  8538 raft_consensus.cc:606] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:50.764418  8538 raft_consensus.cc:614] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:50.765225  9582 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:50.766395  9693 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.768553  8539 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.769851  9775 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:50.761114  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.761305  9836 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.453s	user 0.000s	sys 0.002s
I20260709 13:01:50.762321  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.763581  9682 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:50.775839  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.781595  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.750975  8395 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:50.751130  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.783435  8393 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:50.782660  8540 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.701264  9846 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.787168  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.789927  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.792021  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.792248  8386 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:50.793121  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.750145  9860 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:50.794724  9842 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:50.780640  9807 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.787884  9801 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.797931  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 919) took 1495 ms. Trace:
I20260709 13:01:50.795006  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.799971  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:50.795421  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 923) took 1373 ms. Trace:
I20260709 13:01:50.800328  8470 rpcz_store.cc:276] 0709 13:01:49.302263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.022471 (+720208us) service_pool.cc:224] Handling call
0709 13:01:50.068579 (+ 46108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.073655 (+  5076us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:50.177674 (+104019us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.797578 (+619904us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.797628 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:50.797666 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.797729 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.797859 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":370089,"prepare.queue_time_us":104960,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"raft.queue_time_us":370266,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":336339,"threads_started":2,"wal-append.queue_time_us":249737}
I20260709 13:01:50.801249  8465 rpcz_store.cc:276] 0709 13:01:49.421840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.194850 (+773010us) service_pool.cc:224] Handling call
0709 13:01:50.195122 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.195291 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:50.195565 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.795030 (+599465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.795097 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:50.795151 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.795229 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.795357 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479230,"prepare.queue_time_us":1533,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3857,"raft.queue_time_us":481802,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":119833,"threads_started":1,"wal-append.queue_time_us":203794}
I20260709 13:01:50.803575  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.804576  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:50.808686  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:50.809187  8466 raft_consensus.cc:2376] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3. Re-sending same reply.
I20260709 13:01:50.800593  8541 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:50.815018  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:50.818823  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:50.786301  9855 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:50.788512  9585 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:50.843412  8465 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:51.523010  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 714) took 1494 ms. Trace:
I20260709 13:01:51.502357  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:51.533046  8466 raft_consensus.cc:2368] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:01:51.532701  8542 rpcz_store.cc:276] 0709 13:01:50.028745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.028887 (+   142us) service_pool.cc:224] Handling call
0709 13:01:50.029149 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.525176 (+496027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.522689 (+997513us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54000b6dd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:51.522931 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1136081280}
I20260709 13:01:50.986088  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:51.266175  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.894797  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.535570  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:51.535868  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.348588  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 918) took 1357 ms. Trace:
I20260709 13:01:51.335752  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 916) took 1345 ms. Trace:
W20260709 13:01:51.536972  8359 leader_election.cc:336] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.577s (SENT)
I20260709 13:01:50.863746  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:51.536577  8393 rpcz_store.cc:276] 0709 13:01:49.991005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.725619 (+734614us) service_pool.cc:224] Handling call
0709 13:01:50.783238 (+ 57619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.783799 (+   561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.348318 (+564519us) spinlock_profiling.cc:243] Waited 57.2 ms on lock 0x7b5400248e50. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:51.348512 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131490688}
I20260709 13:01:51.537772  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:51.538307  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.537288  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.536332  8467 raft_consensus.cc:2393] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:51.537283  8390 rpcz_store.cc:276] 0709 13:01:49.990427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.595433 (+605006us) service_pool.cc:224] Handling call
0709 13:01:50.595718 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.608127 (+ 12409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.608159 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.608211 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:50.608306 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.335473 (+727167us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b540024a754. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:51.335532 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.335678 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27886464}
W20260709 13:01:51.539497  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.932649  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.268216  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 912) took 2031 ms. Trace:
I20260709 13:01:51.544286  8468 rpcz_store.cc:276] 0709 13:01:49.236748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.813376 (+576628us) service_pool.cc:224] Handling call
0709 13:01:49.813648 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.949637 (+135989us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:50.076374 (+126737us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.763632 (+687258us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18003422e0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe10374c0a 00007fbe19ab4219 00007fbe103fca40 00007fbe103f74e4 00007fbe103f7455 00007fbe134df060 00007fbe134f1716 00007fbe13502287 00007fbe13502208
0709 13:01:50.763776 (+   144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.763826 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:50.763867 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.267905 (+504038us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54000965d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:51.267990 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.268140 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79565,"prepare.queue_time_us":182538,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2373,"raft.queue_time_us":672745,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":316622976,"thread_start_us":119032,"threads_started":2,"wal-append.queue_time_us":164835,"wal-append.run_cpu_time_us":8415,"wal-append.run_wall_time_us":1253572}
I20260709 13:01:51.547613  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.548403  8468 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:51.537520  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:51.515635  9592 consensus_meta.cc:287] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.912s	user 0.008s	sys 0.001s
W20260709 13:01:50.949752  9851 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:01:51.515311  9831 log.cc:927] Time spent T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 1.295s	user 0.004s	sys 0.007s
W20260709 13:01:51.563710  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.549490  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.579090  8467 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.537068  9666 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.588965  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:51.523785  9748 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.555722  8358 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:51.495520  9842 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.516100  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 901) took 1531 ms. Trace:
I20260709 13:01:51.070233  9814 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.589839  8467 raft_consensus.cc:2410] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:51.501637  9693 consensus_meta.cc:287] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.735s	user 0.007s	sys 0.002s
I20260709 13:01:51.551195  9853 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:51.590309  8468 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:50.969936  9768 raft_consensus.cc:3055] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.266780  9850 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.532262  9578 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.506472  9708 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:51.496377  9816 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:50.835809  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:51.295466  9863 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.302s	user 0.000s	sys 0.002s
I20260709 13:01:51.347162  9776 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:51.348176  9751 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.581976  9585 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:51.267884  8536 raft_consensus.cc:1240] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.799847  9801 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.555012  9789 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.799855  9807 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.493551  9598 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:51.504351  9538 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.253244  9778 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:51.347877  9844 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:51.590620  9855 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:51.589982  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.601181  9842 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:51.059059  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 338620us
I20260709 13:01:51.549875  9860 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:51.650106  9853 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.650717  9853 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.602339  8544 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:51.604290  8467 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:51.629376  9751 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:51.652863  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 944) took 1055 ms. Trace:
I20260709 13:01:51.592707  9748 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:51.609988  9578 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.602758  8386 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.505995  9793 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.668686  9807 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:51.668593  9793 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.669108  9748 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.602321  9768 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:51.621343  9869 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.683113  9869 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:51.644760  9598 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:51.619614  9693 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:51.686703  9801 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:51.686260  9693 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.644295  8470 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:51.687258  9598 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:51.687753  9598 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.687990  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:51.688186  9598 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.688966  9693 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:51.689210  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:51.506803  9682 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:51.603217  9814 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.690042  9682 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:51.627516  9816 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:51.626525  9776 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:50.853031  9572 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.743s
I20260709 13:01:51.619794  9850 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:51.646155  9538 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.647114  9778 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.657188  9853 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:51.655175  8467 rpcz_store.cc:276] 0709 13:01:50.597486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.603661 (+1006175us) service_pool.cc:224] Handling call
0709 13:01:51.604053 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.652528 (+ 48475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.652788 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.621569  9708 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:51.598526  8388 rpcz_store.cc:276] 0709 13:01:49.984798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.991801 (+  7003us) service_pool.cc:224] Handling call
0709 13:01:50.565011 (+573210us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:50.565212 (+   201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.744197 (+178985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.515789 (+771592us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003fa2d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:51.516031 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330644224}
I20260709 13:01:51.645946  9844 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:51.675166  9855 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:51.652377  9828 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.675506  9846 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:51.676790  9825 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 1.591s	user 0.004s	sys 0.003s
I20260709 13:01:51.693488  8470 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.658406  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 701) took 1710 ms. Trace:
I20260709 13:01:51.684996  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 907) took 2515 ms. Trace:
I20260709 13:01:51.668622  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:51.670385  9748 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.706336  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:51.707753  8395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.049s	sys 0.076s
I20260709 13:01:51.694371  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 937) took 1098 ms. Trace:
I20260709 13:01:51.700628  9637 raft_consensus.cc:3055] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:51.704080  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 925) took 1678 ms. Trace:
W20260709 13:01:51.720917  8395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.049s	sys 0.076s
I20260709 13:01:51.708858  9793 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:51.732180  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.704953  9572 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.701135  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 914) took 1709 ms. Trace:
I20260709 13:01:51.720959  8467 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:51.670365  9751 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.735801  8470 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:51.735711  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.728957  9855 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.724646  9637 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:51.713850  9768 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.722220  9776 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.713548  9828 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:01:51.778294  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.739897  8467 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:51.833210  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 65) took 1463 ms. Trace:
I20260709 13:01:51.841682  8390 rpcz_store.cc:276] 0709 13:01:50.369322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.555561 (+1186239us) service_pool.cc:224] Handling call
0709 13:01:51.832296 (+276735us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:51.832545 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.832766 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.832803 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.832856 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:51.832898 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.832969 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.833099 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66217216}
I20260709 13:01:51.843045  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.843680  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 931) took 1282 ms. Trace:
W20260709 13:01:51.830893  8544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 627) took 1764 ms (client timeout 2170 ms). Trace:
I20260709 13:01:51.844177  8390 rpcz_store.cc:276] 0709 13:01:50.561716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.842868 (+1281152us) service_pool.cc:224] Handling call
0709 13:01:51.843151 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.843332 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.843356 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.843401 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:51.843430 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.843489 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.843618 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:51.844870  8544 rpcz_store.cc:269] 0709 13:01:50.066701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.554449 (+487748us) service_pool.cc:224] Handling call
0709 13:01:51.830658 (+1276209us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400058cd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:51.830815 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376515968}
I20260709 13:01:51.846016  8390 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:51.846748  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 932) took 1284 ms. Trace:
I20260709 13:01:51.844153  8467 raft_consensus.cc:2410] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:51.739950  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:51.847765  8393 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:51.849640  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 926) took 1822 ms. Trace:
I20260709 13:01:51.849884  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.850214  8393 rpcz_store.cc:276] 0709 13:01:50.026737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.555358 (+1528621us) service_pool.cc:224] Handling call
0709 13:01:51.847429 (+292071us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:51.847605 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.849354 (+  1749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.849573 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66427648}
W20260709 13:01:51.851018  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.851018  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:51.851882  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.850172  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.851964  8470 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:01:51.852733  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.807761  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:51.853569  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.854424  8470 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:51.855468  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.856220  8470 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:51.857322  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.784103  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 921) took 1759 ms. Trace:
I20260709 13:01:51.847208  8390 rpcz_store.cc:276] 0709 13:01:50.562096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.845451 (+1283355us) service_pool.cc:224] Handling call
0709 13:01:51.845857 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.846499 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.846697 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.859428  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 934) took 1293 ms. Trace:
I20260709 13:01:51.859714  8390 rpcz_store.cc:276] 0709 13:01:50.566145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.858748 (+1292603us) service_pool.cc:224] Handling call
0709 13:01:51.859004 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.859162 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.859184 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.859221 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:51.859250 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.859299 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.859390 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.858330  8395 rpcz_store.cc:276] 0709 13:01:50.024564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.785020 (+760456us) service_pool.cc:224] Handling call
0709 13:01:50.785206 (+   186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.817109 (+ 31903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.817151 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.820073 (+  2922us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.729003 (+908930us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:51.729058 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.729161 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.783846 (+ 54685us) raft_consensus.cc:1685] finished
0709 13:01:51.783873 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.784031 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18891,"raft.queue_time_us":31170,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":35076,"thread_start_us":908565,"threads_started":1,"wal-append.queue_time_us":931412}
I20260709 13:01:51.863420  8507 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:51.734165  9814 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:51.865559  8470 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:51.869344  8507 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:51.867019  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.869746  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.731482  9598 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:51.870868  8470 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:51.880419  8508 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:51.738835  9751 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.886797  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.828658  9775 raft_consensus.cc:3055] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:51.917227  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 380253us
I20260709 13:01:51.763624  9585 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:51.805572  9708 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:51.847769  9855 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.794946  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 928) took 1331 ms. Trace:
I20260709 13:01:51.820822  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:51.780692  9869 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:51.769902  9682 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:51.914001  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:51.818110  9578 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:51.809566  9850 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:51.784365  9538 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:51.916124  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.945694  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.919970  9775 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:51.917625  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 910) took 1929 ms. Trace:
I20260709 13:01:51.888589  9258 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:51.933271  9855 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.810127  9778 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:51.795594  9842 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:51.923604  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 367912us
I20260709 13:01:51.710737  8536 rpcz_store.cc:276] 0709 13:01:49.943691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.944670 (+   979us) service_pool.cc:224] Handling call
0709 13:01:51.267450 (+1322780us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:01:51.267680 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.637605 (+369925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.654287 (+ 16682us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12246784}
I20260709 13:01:51.951790  8391 rpcz_store.cc:276] 0709 13:01:49.988676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.516757 (+528081us) service_pool.cc:224] Handling call
0709 13:01:50.517673 (+   916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.517881 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:51.526697 (+1008816us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.915376 (+388679us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.917259 (+  1883us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:51.917334 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.917429 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.917569 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1016082,"prepare.queue_time_us":1009112,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":25713,"raft.queue_time_us":1395,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7854,"thread_start_us":364378,"threads_started":1}
I20260709 13:01:51.728721  8386 rpcz_store.cc:276] 0709 13:01:50.026455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.958217 (+931762us) service_pool.cc:224] Handling call
0709 13:01:51.590555 (+632338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.693088 (+102533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.703162 (+ 10074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.886214  9577 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.763296  9872 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:51.929591  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:52.005647  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 76179.9us
I20260709 13:01:51.886533  9592 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.933538  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.009635  8470 raft_consensus.cc:2410] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:51.936487  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 939) took 1341 ms. Trace:
I20260709 13:01:51.938066  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:51.914995  9768 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.914690  9804 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:51.945860  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 919) took 1926 ms. Trace:
I20260709 13:01:51.916949  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:52.018585  8467 raft_consensus.cc:2393] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:01:51.947677  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.780273  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:51.758919  9844 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:51.955291  9258 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:51.871052  9749 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.010934  8395 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 2.
I20260709 13:01:52.004930  9577 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.946575  9068 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:51.954306  9399 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.023102  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.953881  9850 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:52.031222  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.017969  8392 rpcz_store.cc:276] 0709 13:01:50.019705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.724657 (+704952us) service_pool.cc:224] Handling call
0709 13:01:50.735833 (+ 11176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.739444 (+  3611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.739490 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.743756 (+  4266us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.152800 (+409044us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:51.590318 (+437518us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.945504 (+355186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.945576 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.945616 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:51.945629 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.945762 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374212,"prepare.queue_time_us":434046,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":120363,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":10270,"thread_start_us":757580,"threads_started":2,"wal-append.queue_time_us":896900}
I20260709 13:01:52.035583  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:51.933777  8388 rpcz_store.cc:276] 0709 13:01:50.462400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.721527 (+1259127us) service_pool.cc:224] Handling call
0709 13:01:51.738478 (+ 16951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.752490 (+ 14012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.757573 (+  5083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.760135 (+  2562us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:51.771500 (+ 11365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.781154 (+  9654us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.793316 (+ 12162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.014859  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:52.036940  9878 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.004953  9708 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.044848  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 110104us
I20260709 13:01:52.014200  9592 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.019501  9813 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:52.038578  9258 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.053689  8467 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:52.071262  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.072659  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.057179  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:51.935673  9637 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.067888  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.077564  8470 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
W20260709 13:01:52.068535  8359 leader_election.cc:336] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.659s (SENT)
I20260709 13:01:51.734629  8387 rpcz_store.cc:276] 0709 13:01:49.989837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.538754 (+548917us) service_pool.cc:224] Handling call
0709 13:01:50.562989 (+ 24235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.583214 (+ 20225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.584248 (+  1034us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.614845 (+ 30597us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.152758 (+537913us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:51.183193 (+ 30435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.210085 (+ 26892us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.673052 (+462967us) raft_consensus.cc:1685] finished
0709 13:01:51.673084 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.698729 (+ 25645us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":311254,"threads_started":1,"wal-append.queue_time_us":1043565}
I20260709 13:01:52.073468  8467 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:52.076630  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:52.078527  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:52.080152  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.083875  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.084728  8467 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:52.052011  9778 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.064759  8461 raft_consensus.cc:2410] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:01:52.083359  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.084056  8395 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:52.088510  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 174535us
I20260709 13:01:52.051517  9577 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.087211  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.087394  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:52.090785  8467 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:52.091528  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.056244  9850 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:52.093973  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.094635  8470 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 1.
I20260709 13:01:52.064237  9789 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:52.099094  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.069320  9592 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:52.094112  8359 leader_election.cc:336] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.806s (SENT)
W20260709 13:01:52.101416  8359 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.814s (SENT)
W20260709 13:01:52.102236  8359 leader_election.cc:336] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.827s (SENT)
I20260709 13:01:52.102684  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:52.103688  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.095146  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.108821  8509 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:52.106562  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:52.104959  8467 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:52.034632  9804 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.114962  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:52.081579  9538 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:52.086306  9813 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:52.132972  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.095506  9585 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.139346  9585 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:52.139987  9752 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.061381  9399 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.132994  9802 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:52.142901  9399 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:52.142668  9813 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.045040  9749 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:52.144459  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.145548  9749 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:52.096909  9778 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.126555  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.147853  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 945) took 1550 ms. Trace:
I20260709 13:01:52.125927  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.150086  8468 rpcz_store.cc:276] 0709 13:01:50.597648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.607257 (+1009609us) service_pool.cc:224] Handling call
0709 13:01:51.607650 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.607911 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:52.012731 (+404820us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.147513 (+134782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.147568 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:52.147612 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.147679 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.147792 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":410810,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2567,"raft.queue_time_us":95,"thread_start_us":521177,"threads_started":2}
I20260709 13:01:52.131778  8467 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.072659  9878 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.039674  9775 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.133594  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.122467  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.122444  8540 raft_consensus.cc:1240] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.031615  9872 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:52.094081  9850 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.138677  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.141708  9585 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.091996  9598 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.099354  9682 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.096067  9787 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.133594  8470 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:52.118351  9793 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.161408  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:51.721844  8463 rpcz_store.cc:276] 0709 13:01:50.594319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.610735 (+ 16416us) service_pool.cc:224] Handling call
0709 13:01:50.611071 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.939703 (+328632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.948166 (+  8463us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.058963 (+110797us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.253856 (+194893us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:51.511779 (+257923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.553118 (+ 41339us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.670474 (+117356us) raft_consensus.cc:1685] finished
0709 13:01:51.670507 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.692515 (+ 22008us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198509,"raft.queue_time_us":219403,"raft.run_cpu_time_us":8142,"raft.run_wall_time_us":952258,"spinlock_wait_cycles":30674816,"thread_start_us":169765,"threads_started":1,"wal-append.queue_time_us":581517}
I20260709 13:01:52.115725  9789 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:52.099191  9662 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.130009  9538 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.098784  9880 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.104286  9874 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.107040  9798 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:52.184237  9798 raft_consensus.cc:697] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:52.184106  9874 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:52.185180  9798 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.163005  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.186947  8541 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:01:52.188426  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.170045  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.169864  9598 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.170089  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.170914  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.099494  9708 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.134250  9762 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.107079  9550 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:01:52.146176  9749 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.158944  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.153391  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:52.069590  9816 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.192368  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.191191  8543 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:52.116880  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.632766  8392 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:52.633385  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:52.634506  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.635874  8392 raft_consensus.cc:2410] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:52.637032  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.152149  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.629746  9816 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.166703  8470 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:52.638684  9816 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:52.640959  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.191310  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.628818  9797 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.642877  9797 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.643361  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.645203  9797 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.645151  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.523936  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 930) took 2060 ms. Trace:
I20260709 13:01:52.531955  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 940) took 1935 ms. Trace:
W20260709 13:01:52.544747  8508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.006s	sys 0.003s
W20260709 13:01:52.524260  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.528713  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:52.547303  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:52.524538  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 422153us
I20260709 13:01:52.171160  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:52.559091  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.180469  9538 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.667821  8537 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:51.712510  8462 rpcz_store.cc:276] 0709 13:01:49.169162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.767579 (+598417us) service_pool.cc:224] Handling call
0709 13:01:49.767909 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.949655 (+181746us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:50.101038 (+151383us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.072505 (+971467us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b1800146e60. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe1308f4bc 00007fbe103dd48b 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a
0709 13:01:51.505578 (+433073us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.505697 (+   119us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:51.505764 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.684721 (+178957us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400236c54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:51.684777 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.684929 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":438107,"prepare.queue_time_us":198006,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":424746,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":195,"spinlock_wait_cycles":336366592,"thread_start_us":108395,"threads_started":2,"wal-append.queue_time_us":225951,"wal-append.run_cpu_time_us":2706,"wal-append.run_wall_time_us":1255022}
I20260709 13:01:52.669770  8537 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:52.671341  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.672586  8462 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:52.527062  8388 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:52.675792  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.677058  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:52.521612  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.565171  8386 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:52.524956  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.010708  8465 rpcz_store.cc:276] 0709 13:01:50.594823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.579375 (+984552us) service_pool.cc:224] Handling call
0709 13:01:51.583494 (+  4119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.583831 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:51.729034 (+145203us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.936030 (+206996us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.936104 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:51.936162 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.936250 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.936412 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":361619,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":3131,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5923,"thread_start_us":341024,"threads_started":2}
W20260709 13:01:52.596124  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.593113  8289 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:52.599860  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:01:52.598977  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.601696  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:52.603215  9598 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.165215  9682 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.689054  9682 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.187148  9662 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.691846  9662 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:52.251963  9666 consensus_meta.cc:287] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.000s
I20260709 13:01:52.263231  9708 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.194193  9749 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:52.693077  9860 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.693826  9860 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:52.273653  9748 consensus_meta.cc:287] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.545s	user 0.005s	sys 0.003s
I20260709 13:01:52.193516  9762 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.707067  9708 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.707499  9762 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.707839  9708 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.399281  9775 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.176157  9793 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:52.694644  9749 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.711364  9749 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.713541  9793 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:52.268733  9778 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.177824  9787 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:52.266901  9789 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.334333  9804 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:52.400823  9846 consensus_meta.cc:287] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.004s
W20260709 13:01:52.721915  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.409619  9855 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.266260  9872 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.726271  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:52.727119  9067 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:52.217352  9878 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:52.214839  9879 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:01:52.214839  9882 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:01:52.346192  9885 log.cc:927] Time spent T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:01:52.399968  9886 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 13:01:52.730988  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:52.341267  9887 log.cc:927] Time spent T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.192s	user 0.003s	sys 0.000s
I20260709 13:01:52.740401  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 943) took 2139 ms. Trace:
I20260709 13:01:52.740840  8466 rpcz_store.cc:276] 0709 13:01:50.597263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.583003 (+985740us) service_pool.cc:224] Handling call
0709 13:01:51.585117 (+  2114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.671184 (+ 86067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.671229 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.692923 (+ 21694us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.921967 (+229044us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:52.039432 (+117465us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.039742 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.345558 (+305816us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:52.395149 (+ 49591us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800340360. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:01:52.568242 (+173093us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b54000c9c54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:52.568324 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.732203 (+163879us) raft_consensus.cc:1685] finished
0709 13:01:52.732220 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.736736 (+  4516us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":136702,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":8958,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":8323,"spinlock_wait_cycles":212471296,"thread_start_us":314088,"threads_started":2,"wal-append.queue_time_us":359229}
I20260709 13:01:52.743700  8466 raft_consensus.cc:1240] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:52.744397  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 946) took 2138 ms. Trace:
I20260709 13:01:52.744727  8466 rpcz_store.cc:276] 0709 13:01:50.605923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.742950 (+2137027us) service_pool.cc:224] Handling call
0709 13:01:52.743384 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.744137 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.744330 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:52.343262  9888 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 13:01:52.344687  9889 log.cc:927] Time spent T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
W20260709 13:01:52.314919  9894 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:01:52.316846  9897 log.cc:927] Time spent T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:01:52.315891  9898 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:52.752626  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 938) took 2157 ms. Trace:
I20260709 13:01:52.618321  9798 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:52.752692  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 933) took 2186 ms. Trace:
I20260709 13:01:52.465297  9850 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.627815  9637 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.628873  9877 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:52.629707  9880 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.630439  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:01:52.543888  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 407571us
I20260709 13:01:52.638700  8468 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:52.648790  8470 raft_consensus.cc:2410] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:52.651240  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:52.655463  8508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.006s	sys 0.004s
I20260709 13:01:52.649960  8461 rpcz_store.cc:276] 0709 13:01:50.595800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.613557 (+ 17757us) service_pool.cc:224] Handling call
0709 13:01:52.531165 (+1917608us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000cba54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:52.531601 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3006667648}
I20260709 13:01:52.663542  9572 consensus_queue.cc:1059] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:52.665967  9813 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:52.666709  9807 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.678364  8358 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:52.649297  8394 rpcz_store.cc:276] 0709 13:01:50.463027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.848102 (+1385075us) service_pool.cc:224] Handling call
0709 13:01:51.848499 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.866152 (+ 17653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.866187 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.866793 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.044477 (+177684us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:52.044725 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.045338 (+   613us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.397473 (+352135us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b48000030d8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe18410aa1 00007fbe18407b37 00007fbe184079ca 00007fbe184ff26f 00007fbe184fef37 00007fbe1851355c 00007fbe18513508 00007fbe18513488 00007fbe18513443 00007fbe185126ec 00007fbe1743ca96
0709 13:01:52.522819 (+125346us) raft_consensus.cc:1685] finished
0709 13:01:52.522923 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.523592 (+   669us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17350,"raft.run_cpu_time_us":2437,"raft.run_wall_time_us":525511,"spinlock_wait_cycles":74137472,"thread_start_us":176567,"threads_started":1,"wal-append.queue_time_us":286254}
W20260709 13:01:52.699143  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.700749  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:52.684188  8359 leader_election.cc:336] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.914s (SENT)
I20260709 13:01:52.665122  9816 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.687502  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.702519  8388 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:52.688028  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:52.704763  9577 consensus_meta.cc:287] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.575s	user 0.002s	sys 0.013s
I20260709 13:01:52.704403  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.682842  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.719666  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:52.193742  9874 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:52.783507  8395 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 2.
I20260709 13:01:52.784348  8535 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:52.784698  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.785619  8395 raft_consensus.cc:2410] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:52.723961  8387 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:52.727149  9855 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.622954  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.755618  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:52.762092  9798 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:52.735580  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 84497us
I20260709 13:01:52.753364  8289 catalog_manager.cc:5697] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:01:52.775086  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 753) took 1054 ms. Trace:
I20260709 13:01:52.789292  9748 consensus_queue.cc:1059] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.755597  8393 rpcz_store.cc:276] 0709 13:01:50.565864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.851425 (+1285561us) service_pool.cc:224] Handling call
0709 13:01:51.852725 (+  1300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.868699 (+ 15974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.868746 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.888664 (+ 19918us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.097876 (+209212us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:52.097931 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.098019 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.752294 (+654275us) raft_consensus.cc:1685] finished
0709 13:01:52.752339 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.752508 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15804,"raft.queue_time_us":17834,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":29268,"thread_start_us":150166,"threads_started":1,"wal-append.queue_time_us":250168}
I20260709 13:01:52.774884  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 740) took 1116 ms. Trace:
W20260709 13:01:52.781109  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 117627us
I20260709 13:01:52.782524  9880 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.782289  9577 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.727638  9708 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.786531  9068 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:52.810480  9768 raft_consensus.cc:3055] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:52.811054  9768 raft_consensus.cc:740] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:52.812016  8387 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:52.814126  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.786810  9778 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:52.788121  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.794104  8538 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:52.790782  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 876827us
I20260709 13:01:52.792124  8461 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:52.792730  9813 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.827250  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:52.794260  9844 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.794113  9807 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.835876  9807 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.795617  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 936) took 2201 ms. Trace:
I20260709 13:01:52.796790  9787 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.767941  9828 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:52.794718  9776 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.797264  9064 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:52.837754  8392 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.799168  8540 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.769009  9860 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.753213  8469 rpcz_store.cc:276] 0709 13:01:50.594586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.709694 (+115108us) service_pool.cc:224] Handling call
0709 13:01:50.711778 (+  2084us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:51.550219 (+838441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.550258 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:51.582508 (+ 32250us) log.cc:844] Serialized 52 byte log entry
0709 13:01:51.926011 (+343503us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:52.097625 (+171614us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.098670 (+  1045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.098800 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.735909 (+637109us) raft_consensus.cc:1685] finished
0709 13:01:52.737651 (+  1742us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.752438 (+ 14787us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177294,"prepare.queue_time_us":181191,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":794026,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":11756,"thread_start_us":462262,"threads_started":2,"wal-append.queue_time_us":441237}
I20260709 13:01:52.782306  8462 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 2.
I20260709 13:01:52.798171  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.842476  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 950) took 2120 ms. Trace:
I20260709 13:01:52.836681  8464 rpcz_store.cc:276] 0709 13:01:50.594019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.595277 (+  1258us) service_pool.cc:224] Handling call
0709 13:01:50.602953 (+  7676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.537311 (+934358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.551322 (+ 14011us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.657282 (+105960us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b2c00040298. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:01:51.672066 (+ 14784us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.013007 (+340941us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:52.015999 (+  2992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.032901 (+ 16902us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.393105 (+360204us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:52.795160 (+402055us) raft_consensus.cc:1685] finished
0709 13:01:52.795193 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.795419 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":763739,"raft.queue_time_us":215206,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":34210,"spinlock_wait_cycles":11384320,"thread_start_us":295847,"threads_started":1,"wal-append.queue_time_us":426162}
I20260709 13:01:52.843659  8394 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:52.794041  8466 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.844404  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 948) took 2144 ms. Trace:
I20260709 13:01:52.844621  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 951) took 2113 ms. Trace:
I20260709 13:01:52.845273  8394 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:52.808576  8470 rpcz_store.cc:276] 0709 13:01:51.655274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.640205 (+984931us) service_pool.cc:224] Handling call
0709 13:01:52.771963 (+131758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.809360  8465 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:52.807698  8468 rpcz_store.cc:276] 0709 13:01:51.716991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.151866 (+434875us) service_pool.cc:224] Handling call
0709 13:01:52.767756 (+615890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.846863  9752 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.845114  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 947) took 2159 ms. Trace:
I20260709 13:01:52.843001  8462 rpcz_store.cc:276] 0709 13:01:50.722352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.841059 (+2118707us) service_pool.cc:224] Handling call
0709 13:01:52.841562 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.842013 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.842055 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.842120 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:52.842161 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.842258 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.842392 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.848376  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 953) took 2040 ms. Trace:
I20260709 13:01:52.848083  9578 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.849123  9752 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:52.802029  8389 consensus_meta.cc:287] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.986s	user 0.014s	sys 0.006s
I20260709 13:01:52.789556  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:52.815961  9778 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.799165  9850 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:52.821120  8463 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:52.821700  8358 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:52.849721  9752 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:52.846877  9682 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.865108  8289 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:52.866268  8395 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:52.868079  9682 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:52.823599  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.848140  8466 rpcz_store.cc:276] 0709 13:01:50.686162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.745437 (+2059275us) service_pool.cc:224] Handling call
0709 13:01:52.756910 (+ 11473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.844835 (+ 87925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.845042 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:52.868999  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.869575  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.870043  8387 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:52.814914  9768 consensus_queue.cc:260] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.816090  9798 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.870481  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 52) took 2004 ms. Trace:
I20260709 13:01:52.835944  8386 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:01:52.839365  9880 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.870908  8466 rpcz_store.cc:276] 0709 13:01:50.866056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.869327 (+2003271us) service_pool.cc:224] Handling call
0709 13:01:52.869778 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.870096 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.870131 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.870172 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:52.870240 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.870303 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.870422 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.846483  9751 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.862022  9778 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.873391  9752 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.874747  9768 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.875167  9752 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.862659  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 744) took 1194 ms. Trace:
I20260709 13:01:52.876724  8465 rpcz_store.cc:276] 0709 13:01:51.668115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.717766 (+1049651us) service_pool.cc:224] Handling call
0709 13:01:52.862599 (+144833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.844832  8461 rpcz_store.cc:276] 0709 13:01:50.700046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.791232 (+2091186us) service_pool.cc:224] Handling call
0709 13:01:52.791695 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.844072 (+ 52377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.844331 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.864295  9878 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:52.880748  9878 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.881259  9878 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.846483  9853 consensus_queue.cc:1059] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:01:52.822824  9577 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:52.780942  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:52.829595  9813 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:52.848771  8468 rpcz_store.cc:276] 0709 13:01:50.807700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.847297 (+2039597us) service_pool.cc:224] Handling call
0709 13:01:52.847737 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.848054 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.848076 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.848133 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:52.848160 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.848217 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.848319 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.850143  8462 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:52.876206  8389 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:52.845090  8464 rpcz_store.cc:276] 0709 13:01:50.731666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.843572 (+2111906us) service_pool.cc:224] Handling call
0709 13:01:52.843992 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.844265 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.844292 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.844350 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:52.844400 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.844459 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.844567 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.886730  9860 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.886883  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:52.781525  8467 consensus_meta.cc:287] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.007s
I20260709 13:01:52.887758  9860 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.889118  8467 raft_consensus.cc:2410] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:52.890760  9860 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:52.894621  8389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 900) took 2910 ms (client timeout 1940 ms). Trace:
W20260709 13:01:52.895253  8389 rpcz_store.cc:269] 0709 13:01:49.984452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.992532 (+  8080us) service_pool.cc:224] Handling call
0709 13:01:51.668452 (+1675920us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:52.894479 (+1226027us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9466240}
W20260709 13:01:52.896893  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 231777us
W20260709 13:01:52.897852  8359 leader_election.cc:336] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.201s (SENT)
I20260709 13:01:52.898315  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:52.899673  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.202s (SENT) [suppressed 19 similar messages]
I20260709 13:01:52.899812  9828 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.855090  9846 raft_consensus.cc:3055] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:52.900619  9846 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:52.900503  9828 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.901780  9846 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.903633  9828 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:52.900938  9860 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:52.827167  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:52.907173  9798 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:52.907426  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 80740.9us
I20260709 13:01:52.907821  9846 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.908617  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:52.909533  9798 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.910557  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:01:52.911791  9816 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.912433  9816 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.912907  9816 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.914672  9850 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.916278  9850 raft_consensus.cc:3055] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.916625  9850 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:52.916739  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.917140  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.911834  9748 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.921975  9637 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:52.922416  9637 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:52.923200  9637 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.923223  9748 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:52.924435  9637 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.924640  9748 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:52.925806  9748 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.927865  9748 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:52.931010  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.900676  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 736) took 1278 ms. Trace:
I20260709 13:01:52.884346  9880 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.929297  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:52.935281  9751 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:52.935825  9751 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.936239  9751 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.936837  8507 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:52.937953  9550 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.938033  9853 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.940001  8468 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.945861  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 743) took 1278 ms. Trace:
I20260709 13:01:52.946453  8468 rpcz_store.cc:276] 0709 13:01:51.667861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.894298 (+1226437us) service_pool.cc:224] Handling call
0709 13:01:52.917961 (+ 23663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.940497 (+ 22536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.945781 (+  5284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.946815  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 53) took 2080 ms. Trace:
I20260709 13:01:52.947391  8466 rpcz_store.cc:276] 0709 13:01:50.866393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.872290 (+2005897us) service_pool.cc:224] Handling call
0709 13:01:52.872759 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.918355 (+ 45596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.918399 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.946375 (+ 27976us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:52.946457 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.946575 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.946764 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.883061  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 957) took 1041 ms. Trace:
W20260709 13:01:52.953370  9592 consensus_meta.cc:287] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.000s
I20260709 13:01:52.953779  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.945801  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 954) took 2089 ms. Trace:
I20260709 13:01:52.960114  8462 rpcz_store.cc:276] 0709 13:01:50.853583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.849164 (+1995581us) service_pool.cc:224] Handling call
0709 13:01:52.849663 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.892056 (+ 42393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.942306 (+ 50250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.960361  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.961201  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:52.961828  8543 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.963140  8462 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.963963  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 956) took 1122 ms. Trace:
I20260709 13:01:52.964390  8462 rpcz_store.cc:276] 0709 13:01:51.841235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.962486 (+1121251us) service_pool.cc:224] Handling call
0709 13:01:52.962879 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.963666 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.963898 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.966022  9592 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:52.958969  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:52.967623  9550 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.975863  9550 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.979192  9550 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.982131  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.983690  9906 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:52.984139  9906 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:52.984561  9906 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.986193  9032 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:52.987352  9872 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.987757  9578 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.989503  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 54) took 1330 ms. Trace:
I20260709 13:01:52.991415  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:52.989934  8467 rpcz_store.cc:276] 0709 13:01:51.658942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.890850 (+1231908us) service_pool.cc:224] Handling call
0709 13:01:52.952383 (+ 61533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.989128 (+ 36745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.989171 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.989219 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:52.989263 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.989324 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.989450 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.998560  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:52.999434  8540 raft_consensus.cc:2410] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:52.955189  9778 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:52.917629  9850 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.003629  9789 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.008484  9880 consensus_queue.cc:1059] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:53.009775  8468 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:53.010421  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 749) took 1341 ms. Trace:
I20260709 13:01:53.010681  8468 rpcz_store.cc:276] 0709 13:01:51.669420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.948710 (+1279290us) service_pool.cc:224] Handling call
0709 13:01:52.994443 (+ 45733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.010223 (+ 15780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.010381 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:53.014655  9860 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:53.015127  9860 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:53.018772  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.019784  8393 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 3.
I20260709 13:01:53.016278  9860 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.022198  8390 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:53.022997  9860 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.024889  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 949) took 2310 ms. Trace:
W20260709 13:01:53.026185  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 71193.9us
I20260709 13:01:53.025301  8469 rpcz_store.cc:276] 0709 13:01:50.714156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.840703 (+2126547us) service_pool.cc:224] Handling call
0709 13:01:52.841102 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.880387 (+ 39285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.880416 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.880838 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.942334 (+ 61496us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:52.942388 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.943331 (+   943us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.024626 (+ 81295us) raft_consensus.cc:1685] finished
0709 13:01:53.024645 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.024792 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38711,"raft.queue_time_us":39805,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":61073,"threads_started":1,"wal-append.queue_time_us":114734}
I20260709 13:01:53.027072  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.027997  9789 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.030403  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.030494  9850 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.040261  9778 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.042285  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:52.955039  8463 rpcz_store.cc:276] 0709 13:01:51.841649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.170843 (+329194us) service_pool.cc:224] Handling call
0709 13:01:52.882824 (+711981us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400237b54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:52.882989 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371102976}
I20260709 13:01:53.013628  8543 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:53.053640  8358 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:53.056752  8462 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:53.057765  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 960) took 1215 ms. Trace:
I20260709 13:01:53.058238  8462 rpcz_store.cc:276] 0709 13:01:51.842672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.990960 (+1148288us) service_pool.cc:224] Handling call
0709 13:01:53.007714 (+ 16754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.057354 (+ 49640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.057674 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:53.059449  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 52283.9us
I20260709 13:01:53.067850  9751 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.075489  9550 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.078732  9592 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:52.931725  8461 rpcz_store.cc:276] 0709 13:01:51.622243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.878276 (+1256033us) service_pool.cc:224] Handling call
0709 13:01:52.878783 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.879401 (+   618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.879449 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.880055 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.890064 (+ 10009us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:52.890897 (+   833us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.900170 (+  9273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.900355 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.900417 (+    62us) raft_consensus.cc:1685] finished
0709 13:01:52.900442 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.900588 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8957,"prepare.queue_time_us":236,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":11090,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"thread_start_us":9522,"threads_started":1,"wal-append.queue_time_us":7613}
I20260709 13:01:53.006682  9762 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:53.067878  9789 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.070250  9776 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.095659  9592 consensus_queue.cc:1059] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:53.096841  9592 raft_consensus.cc:3055] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:53.097265  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 66997.1us
I20260709 13:01:53.098251  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:53.098904  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 97221.7us
I20260709 13:01:53.067498  9538 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.108240  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:53.103121  9798 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:53.109913  9538 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.103420  8540 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:53.110095  9798 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.112843  9798 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.109468  8542 raft_consensus.cc:2368] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:01:53.097308  9592 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:53.114378  9776 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:53.114784  9592 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.115511  9776 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.116356  9592 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.086149  9550 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:53.123544  9538 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:53.124061  9778 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.124752  9778 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.131522  9751 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:53.132897  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 735) took 1533 ms. Trace:
I20260709 13:01:53.133342  8465 rpcz_store.cc:276] 0709 13:01:51.599631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.877440 (+1277809us) service_pool.cc:224] Handling call
0709 13:01:52.877954 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.878466 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.878492 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.879037 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.974035 (+ 94998us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:52.993898 (+ 19863us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.996020 (+  2122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.996092 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.132674 (+136582us) raft_consensus.cc:1685] finished
0709 13:01:53.132694 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.132838 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420,"prepare.queue_time_us":20090,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":3157,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":283,"thread_start_us":94542,"threads_started":1,"wal-append.queue_time_us":174073}
I20260709 13:01:53.136401  9872 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:53.142032  9550 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:53.142623  9550 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.143992  9550 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.146163  8360 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:53.146818  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 65046.8us
I20260709 13:01:53.147702  9860 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:53.087774  9853 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:53.147460  8360 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
W20260709 13:01:53.150126  9915 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:01:53.150741  9797 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.151193  9797 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:53.151564  9797 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.151754  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 952) took 2369 ms. Trace:
I20260709 13:01:53.153498  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 750) took 1483 ms. Trace:
I20260709 13:01:53.153949  8466 rpcz_store.cc:276] 0709 13:01:51.669758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.954396 (+1284638us) service_pool.cc:224] Handling call
0709 13:01:52.954761 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.968110 (+ 13349us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:52.968501 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.153191 (+184690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:53.153239 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:53.153276 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.153343 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.153449 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31273,"prepare.queue_time_us":227,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":152946,"threads_started":1}
I20260709 13:01:53.152176  8470 rpcz_store.cc:276] 0709 13:01:50.781946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.846149 (+2064203us) service_pool.cc:224] Handling call
0709 13:01:52.846581 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.881717 (+ 35136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.881745 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.882601 (+   856us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.891592 (+  8991us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:52.891647 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.891741 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.151488 (+259747us) raft_consensus.cc:1685] finished
0709 13:01:53.151508 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.151671 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34598,"raft.queue_time_us":34897,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":128,"thread_start_us":8552,"threads_started":1,"wal-append.queue_time_us":75906}
I20260709 13:01:53.156690  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 732) took 1033 ms. Trace:
I20260709 13:01:53.157919  8542 rpcz_store.cc:276] 0709 13:01:52.123220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.125538 (+  2318us) service_pool.cc:224] Handling call
0709 13:01:53.156447 (+1030909us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54000415d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:53.156626 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203301120}
W20260709 13:01:53.162546  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.158015  9637 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.161933  8538 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:53.167135  9637 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.169693  9637 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:53.174525  8358 leader_election.cc:400] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:01:53.176229  9860 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.176836  9860 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.179836  8358 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:53.180434  9762 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:01:53.180651  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.181105  9775 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.181505  9775 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:53.181881  9775 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.184517  9816 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:01:53.186072  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 87974.1us
I20260709 13:01:53.187083  9860 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.187743  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 157) took 5537 ms. Trace:
I20260709 13:01:53.187116  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.188664  9789 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.190372  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.196879  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:53.201673  8359 leader_election.cc:336] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.048s (SENT)
I20260709 13:01:53.203910  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:53.205729  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:53.206710  9064 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:01:53.208066  9878 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.209110  9550 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.209484  9789 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.210417  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:53.215057  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.222112  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.226951  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.188189  8290 rpcz_store.cc:276] 0709 13:01:47.650044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.650222 (+   178us) service_pool.cc:224] Handling call
0709 13:01:53.187482 (+5537260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:50.177139 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:50.222149 (+ 45010us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:50.222183 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:01:50.222204 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:50.305751 (+ 83547us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:50.307656 (+  1905us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:50.309091 (+  1435us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:01:50.523285 (+214194us) tablet.cc:701] Row locks acquired
0709 13:01:50.525126 (+  1841us) write_op.cc:260] PREPARE: finished
0709 13:01:50.549149 (+ 24023us) write_op.cc:270] Start()
0709 13:01:50.555277 (+  6128us) write_op.cc:276] Timestamp: P: 1783602110549054 usec, L: 0
0709 13:01:50.556349 (+  1072us) op_driver.cc:348] REPLICATION: starting
0709 13:01:50.614689 (+ 58340us) log.cc:844] Serialized 5928 byte log entry
0709 13:01:52.191189 (+1576500us) op_driver.cc:464] REPLICATION: finished
0709 13:01:52.253966 (+ 62777us) write_op.cc:301] APPLY: starting
0709 13:01:52.254076 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:52.254508 (+   432us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:52.254646 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:52.470422 (+215776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:52.470806 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:01:52.470872 (+    66us) write_op.cc:312] APPLY: finished
0709 13:01:52.471335 (+   463us) log.cc:844] Serialized 106 byte log entry
0709 13:01:52.472354 (+  1019us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:52.472556 (+   202us) write_op.cc:454] Released schema lock
0709 13:01:52.472623 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:52.473053 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:52.473091 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":249512,"reported_tablets":30,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":59466,"apply.run_cpu_time_us":4686,"apply.run_wall_time_us":219062,"num_ops":15,"prepare.queue_time_us":215816,"prepare.run_cpu_time_us":47158,"prepare.run_wall_time_us":562437,"raft.queue_time_us":500662,"raft.run_cpu_time_us":10266,"raft.run_wall_time_us":156728,"replication_time_us":1607627,"thread_start_us":600200,"threads_started":4,"wal-append.queue_time_us":333976}]]}
I20260709 13:01:53.213955  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.230397  8508 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:53.231549  9538 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.232331  9538 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.236208  9778 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.236896  9637 consensus_queue.cc:1059] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:53.237720  9550 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:53.239653  9923 raft_consensus.cc:3055] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:53.239856  9558 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.241080  9923 raft_consensus.cc:740] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:53.244251  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:53.245146  9789 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.245509  9789 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.243079  9923 consensus_queue.cc:260] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:53.242100  9558 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:53.245857  9789 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.250825  9923 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:53.245720  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.189429  9775 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.258841  9558 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.261588  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.261850  9846 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.162869  9906 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:53.274425  8540 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:53.274338  9778 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:53.249363  9816 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:53.278549  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.283752  8358 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:53.289198  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:53.311060  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 111468us
I20260709 13:01:53.323812  9538 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.318853  9592 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.286206  9846 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.348531  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:53.348852  9874 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.349339  9874 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.349689  9874 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.346728  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.351702  9846 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:53.352231  8386 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
W20260709 13:01:53.353088  8359 leader_election.cc:336] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.225s (SENT)
I20260709 13:01:53.353693  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:53.354102  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 65005.5us
I20260709 13:01:53.355065  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.355559  9813 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:53.355949  8387 raft_consensus.cc:2393] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:53.348526  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.349339  8542 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.357837  8395 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:53.361969  9778 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.362768  8389 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:53.364198  9775 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.367123  9775 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:53.285837  9797 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:53.371670  8393 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.359449  9592 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.377537  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 763) took 1449 ms. Trace:
I20260709 13:01:53.378021  8467 rpcz_store.cc:276] 0709 13:01:51.927839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.007094 (+1079255us) service_pool.cc:224] Handling call
0709 13:01:53.069025 (+ 61931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.072036 (+  3011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.072057 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.092915 (+ 20858us) log.cc:844] Serialized 26 byte log entry
0709 13:01:53.256108 (+163193us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:53.256189 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.256258 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.377328 (+121070us) raft_consensus.cc:1685] finished
0709 13:01:53.377349 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.377470 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":99558,"threads_started":1,"wal-append.queue_time_us":132302}
I20260709 13:01:53.369059  9775 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.386451  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.386268  9789 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:53.357137  9813 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:01:53.391176  9789 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:53.346005  9878 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.393963  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:53.394682  9064 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.394836  9906 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.395944  9907 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:53.396634  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.397555  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.397995  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.397846  9748 consensus_queue.cc:1059] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:53.398859  8470 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:53.399168  9748 raft_consensus.cc:3055] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:53.399600  9748 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:53.400622  9748 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:53.401232  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.401965  8389 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.402086  9748 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.398324  8466 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.403836  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.404394  8470 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.406286  9592 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:53.406744  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.407472  8462 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:53.407608  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.408165  8467 raft_consensus.cc:2376] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3. Re-sending same reply.
I20260709 13:01:53.409628  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.410072  8466 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:53.410255  8465 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.411959  8393 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:01:53.412921  8392 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:53.415073  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.415834  8466 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:53.419117  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.426752  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.427070  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.427842  8462 raft_consensus.cc:2368] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:01:53.428048  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.428197  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:01:53.428632  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.428680  8461 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:53.429422  8469 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:53.429347  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.429718  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.430333  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.430461  8461 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:53.430598  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.431330  9927 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:53.431519  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.431931  9927 raft_consensus.cc:697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:53.433104  8392 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.437224  9927 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:53.445693  8389 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 3.
I20260709 13:01:53.432909  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.454265  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.456189  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.455310  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:53.458153  9558 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:53.458228  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.464174  9923 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:01:53.456599  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.473575  9850 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:01:53.504339  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.490497  8463 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:53.473726  9874 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.505010  8394 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:53.492646  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:53.492739  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.494246  8540 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:53.507493  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.503870  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.508277  8541 raft_consensus.cc:2393] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:53.491655  8464 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:53.492291  8465 raft_consensus.cc:2410] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:53.510851  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.511674  8463 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:53.500690  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.497504  8542 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:53.500988  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.498769  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.501094  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.517275  8393 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:53.501309  8467 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:01:53.518472  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.518549  8395 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:53.519060  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.503211  8470 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 3.
I20260709 13:01:53.524827  8392 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:53.491081  8462 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:53.526764  8466 raft_consensus.cc:2393] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:53.531924  8465 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:53.531968  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.533391  8392 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:53.538362  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.437682  9592 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.439908  9797 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:53.539112  8542 raft_consensus.cc:2368] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:53.532685  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.540652  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.541592  8470 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:53.500301  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.542060  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.544278  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.495630  9558 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:53.549543  8467 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.502765  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.502071  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.551427  8464 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.551723  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.501883  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.549118  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.503247  8386 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:53.501720  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.558323  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.498200  9064 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:53.557982  8540 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:53.545950  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.520108  9775 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.559476  8393 raft_consensus.cc:2410] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:53.565076  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:01:53.576146  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.582722  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.603240  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:53.606542  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.607129  8393 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.610564  8543 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:53.610926  8541 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:53.612569  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.613421  8466 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:53.550117  9592 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.610937  8543 pending_rounds.cc:85] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 1
W20260709 13:01:53.623072  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 106986us
I20260709 13:01:53.605062  9776 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.610249  8536 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:53.610061  8387 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:53.549501  9033 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:53.631493  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:53.623741  8543 pending_rounds.cc:107] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:53.635789  8543 raft_consensus.cc:2889] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.628175  8389 raft_consensus.cc:2410] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:53.637972  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.638209  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.638829  8544 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:53.639645  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:53.640065  8544 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:53.641458  8538 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:53.641813  9592 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:53.630201  9776 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:53.642706  9776 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.645939  8461 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:53.627869  8539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:01:53.646696  8539 raft_consensus.cc:606] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:53.648241  8539 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:53.583042  8535 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:53.658277  8393 raft_consensus.cc:2410] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:53.665131  8395 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:53.666262  8467 raft_consensus.cc:2410] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:01:53.667867  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.671794  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.672595  8537 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:53.677029  9798 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.677428  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.677667  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.678056  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.678767  8389 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.664098  9789 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:53.678982  9797 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:53.679404  9789 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.679733  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.679421  9797 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:53.681414  9797 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.682255  9874 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.677686  9798 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.678889  8359 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:53.655337  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 116239us
I20260709 13:01:53.670763  9927 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.698655  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.669266  9813 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.681442  9789 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.706519  8466 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:53.711306  9798 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.721422  8462 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:53.722234  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.722534  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.722900  8467 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:53.723081  8462 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:53.724924  8470 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:53.742542  8464 raft_consensus.cc:2410] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:53.746978  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 52610us
I20260709 13:01:53.716853  9776 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.749392  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:53.750254  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.753942  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.755864  8465 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.735968  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.736441  9927 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:53.729190  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:53.756652  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.742956  9789 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:53.758517  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.764031  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 85229.4us
W20260709 13:01:53.767645  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.776118  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.780369  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:53.780876  8394 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:53.781935  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.785076  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:53.787856  8465 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:53.736268  9813 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.789856  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:53.792415  8394 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:53.796192  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:53.797008  8465 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:53.793694  9538 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.800001  9850 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.800483  9850 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.800858  9850 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.801318  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.802178  8393 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:01:53.802816  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:53.794874  8507 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:53.794045  9846 consensus_queue.cc:1059] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:01:53.803006  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.813171  8508 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:53.813249  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.766995  9789 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:53.776937  8387 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.817476  9789 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:53.818789  9933 log.cc:927] Time spent T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:01:53.801143  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:53.819913  8535 raft_consensus.cc:2368] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:01:53.820665  9577 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:53.821511  9762 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:53.824083  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 28) took 4811 ms. Trace:
I20260709 13:01:53.827180  9846 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:53.827733  9846 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:53.828799  9846 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.770298  8536 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:01:53.830402  8508 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:53.832275  9550 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:53.832722  9550 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.833108  9550 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.835471  9844 consensus_queue.cc:1059] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:53.836795  8393 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:53.803920  9749 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:53.837975  9637 raft_consensus.cc:3055] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:53.830600  9923 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.839047  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.839136  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:53.839835  8394 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:53.843932  8540 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:01:53.848004  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.847996  8537 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:53.849891  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.850476  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.849710  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:53.852820  8390 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:53.838511  9637 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:53.854317  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:53.854760  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.854997  8536 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.854614  9637 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:53.856011  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:53.856096  9798 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.856976  9907 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.858233  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:53.858767  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 86114.9us
I20260709 13:01:53.858945  8394 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.859615  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:53.860797  8507 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:53.858284  9592 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:53.862488  9749 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.863253  9749 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.861974  9762 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:53.863619  9749 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.863853  9762 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:53.864017  9749 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.864360  9762 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:53.858796  9935 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:53.868652  9577 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:53.870085  9860 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:53.870324  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 56519.4us
I20260709 13:01:53.871212  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:53.871505  8507 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:53.872097  9860 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.872509  8359 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:53.883594  9762 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.884775  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:53.885582  9878 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.886088  9860 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:53.886523  9860 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:53.887061  9860 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.887709  9813 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:53.887794  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:53.846768  9923 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.888478  8388 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.888582  9923 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.873443  9797 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.873242  9927 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:53.862401  9592 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:53.890018  9846 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.890516  8463 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:53.824491  8289 rpcz_store.cc:276] 0709 13:01:49.012793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.013086 (+   293us) service_pool.cc:224] Handling call
0709 13:01:53.824016 (+4810930us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:53.001461 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:53.216050 (+214589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:53.224451 (+  8401us) write_op.cc:435] Acquired schema lock
0709 13:01:53.224472 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:53.225237 (+   765us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:53.225328 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:53.225364 (+    36us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:53.226045 (+   681us) tablet.cc:701] Row locks acquired
0709 13:01:53.226102 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:01:53.226289 (+   187us) write_op.cc:270] Start()
0709 13:01:53.226467 (+   178us) write_op.cc:276] Timestamp: P: 1783602113226216 usec, L: 0
0709 13:01:53.226520 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:01:53.227522 (+  1002us) log.cc:844] Serialized 1478 byte log entry
0709 13:01:53.434869 (+207347us) op_driver.cc:464] REPLICATION: finished
0709 13:01:53.650221 (+215352us) write_op.cc:301] APPLY: starting
0709 13:01:53.650335 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:53.650494 (+   159us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:53.650638 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:53.651238 (+   600us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:53.651530 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:53.651586 (+    56us) write_op.cc:312] APPLY: finished
0709 13:01:53.651870 (+   284us) log.cc:844] Serialized 34 byte log entry
0709 13:01:53.652064 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:53.652151 (+    87us) write_op.cc:454] Released schema lock
0709 13:01:53.652214 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:53.652598 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:53.652630 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":159454,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":194399,"apply.run_cpu_time_us":2350,"apply.run_wall_time_us":2350,"num_ops":3,"prepare.queue_time_us":131578,"prepare.run_cpu_time_us":5323,"prepare.run_wall_time_us":226459,"replication_time_us":186252,"thread_start_us":214611,"threads_started":2}]]}
W20260709 13:01:53.900396  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 125054us
I20260709 13:01:53.901669  8358 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:53.904156  8358 leader_election.cc:400] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:01:53.904826  8358 leader_election.cc:403] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:01:53.910686  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.916424  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 44998.4us
I20260709 13:01:53.922304  9399 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.926608  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:53.869340  9550 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:53.879271  8394 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:53.802944  8389 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:53.885506  9850 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:53.959115  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 127188us
I20260709 13:01:53.918771  9878 consensus_queue.cc:1059] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:01:53.930563  8536 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:53.958532  9762 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:54.009140  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.044230  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 140972us
I20260709 13:01:53.975229  9789 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:54.048997  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 193053us
I20260709 13:01:54.034854  9776 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:54.067449  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.064860  8358 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:54.039500  9399 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:54.078563  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 118629us
W20260709 13:01:54.081421  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.080658  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:54.060506  9860 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:54.124564  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.110576  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:54.067009  9798 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.079730  9064 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:54.074421  8389 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:54.081254  9538 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:54.137374  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 221296us
I20260709 13:01:54.078843  9776 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:01:54.140183  8394 raft_consensus.cc:1240] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:54.123454  9775 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.138361  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:54.141533  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.126631  9907 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.127166  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:54.154240  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.135269  9550 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:54.164331  8390 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
W20260709 13:01:54.156704  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 91966.2us
I20260709 13:01:54.140225  9874 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.152642  9775 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:54.142390  9945 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:54.167668  9937 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.221s	user 0.001s	sys 0.003s
I20260709 13:01:54.156134  9850 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:54.167553  9762 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:54.197212  8390 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:54.195739  8358 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:54.199076  9949 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:01:54.187386  9776 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.191012  9775 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.210552  8390 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:54.253693  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 56579.8us
I20260709 13:01:54.257561  9789 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:54.258785  9789 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:54.262333  9749 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:54.254045  9762 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:54.267233  9762 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.204372  9399 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.273306  9878 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:54.273875  9878 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:54.274273  9878 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.276149  9860 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:54.276832  9860 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:54.278051  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.278682  9945 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:54.279811  9945 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:54.280391  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 84732.7us
I20260709 13:01:54.281869  9952 raft_consensus.cc:3055] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.282374  9952 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:54.283286  9952 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.284731  9952 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.285943  9963 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.286530  9963 raft_consensus.cc:697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:54.287506  9963 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.291067  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:54.292135  8538 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:01:54.294880  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 153460us
I20260709 13:01:54.296006  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:54.297109  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.253412  9938 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:01:54.300782  9953 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:54.294833  9776 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:54.295310  9957 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.298195  9789 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.310137  9778 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:54.316020  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 398776us
I20260709 13:01:54.306696  9953 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.298121  8388 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:54.320180  8507 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.318711  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:54.325414  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.306095  8387 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:54.331187  9874 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:54.346673  9874 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.311942  9923 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.351845  9923 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:54.354517  9776 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.359170  9797 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:54.316205  9957 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.323423  9953 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.364964  9813 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:54.366077  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 255563us
W20260709 13:01:54.366384  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 46328.2us
I20260709 13:01:54.367223  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.365734  9813 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:01:54.370998  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.322962  9778 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:54.378285  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 53008.8us
I20260709 13:01:54.380821  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.331251  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:54.369623  9558 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.385645  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:54.370754  9789 consensus_queue.cc:1059] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:01:54.388092  9860 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:54.390780  9860 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.391184  9860 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:54.393904  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.394074  9068 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:54.370527  9952 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:54.373574  9907 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:54.415004  9860 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.368501  9874 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.419775  8359 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.399737  9952 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:54.420797  9952 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.399073  9957 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:54.424145  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 57010.2us
I20260709 13:01:54.429467  9797 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.430058  9860 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:54.425361  9813 raft_consensus.cc:3055] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:54.435856  9813 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:54.435878  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 78841.9us
I20260709 13:01:54.436838  9813 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.439203  9927 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:54.440766  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:54.442044  9906 consensus_queue.cc:1059] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:54.443277  9872 raft_consensus.cc:3055] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:54.443636  9872 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:54.444540  9872 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:54.447221  9778 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:54.413336  9907 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.451011  9749 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:54.452409  9907 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:54.457834  9872 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.418776  9399 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.462339  9399 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.462713  9637 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.464572  9399 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:54.428575  9550 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:54.467193  9592 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.468299  9592 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.470906  9874 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:54.466032  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.473513  8395 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:54.475394  9558 raft_consensus.cc:697] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:54.476045  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 50738.9us
I20260709 13:01:54.476500  9558 consensus_queue.cc:237] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.478072  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:54.475538  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 55860.4us
I20260709 13:01:54.480026  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:54.449401  8290 catalog_manager.cc:5697] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.492627  8290 catalog_manager.cc:5697] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:54.498430  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 61547.8us
I20260709 13:01:54.499205  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:54.505349  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.502810  8290 catalog_manager.cc:5697] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.511350  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.511989  9950 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:01:54.512403  9775 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:54.513350  9958 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.513969  8391 raft_consensus.cc:1240] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:54.513842  9958 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:54.514710  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.515798  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 89154.1us
I20260709 13:01:54.516206  8470 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:54.517426  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:54.518378  9637 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.519650  9953 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.519982  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.521349  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.522167  9923 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.498114  9906 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:01:54.530628  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:54.531498  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:54.532253  9789 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:54.532943  9789 raft_consensus.cc:2764] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:54.533483  9789 raft_consensus.cc:2764] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:54.533973  9906 consensus_queue.cc:1059] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:54.534505  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:54.535012  9906 raft_consensus.cc:3055] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.535235  9976 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.535442  9906 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:54.535691  9976 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:54.536139  9976 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.536433  9906 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:54.508129  9538 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:54.539032  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:54.541356  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.543102  8290 catalog_manager.cc:5697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:54.546758  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.515916  9958 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:54.555660  9032 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.564133  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:54.537619  9906 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:54.578802  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 57517us
I20260709 13:01:54.581427  8507 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.508528  9813 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.574467  9952 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.559834  9950 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:01:54.598587  9952 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:54.599973  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 95224.4us
I20260709 13:01:54.600875  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.602845  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:54.603425  8469 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.586916  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:54.591379  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:54.591437  8290 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.607786  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:54.591135  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:54.608606  8466 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.554029  9953 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:54.578960  9872 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.623606  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:54.623621  8290 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.629328  8542 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:54.624625  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.593461  9538 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:54.719010  8433 leader_election.cc:400] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:54.626273  9797 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:54.602475  9778 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.725050  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:54.591099  9550 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:54.578377  9878 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.694834  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:54.624805  9963 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.613083  9950 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.703264  8466 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:01:54.659852  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.601045  9789 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:01:54.625888  9923 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.630667  9872 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:54.716645  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 92150.2us
W20260709 13:01:54.694917  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 64823.3us
I20260709 13:01:54.719914  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.721624  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:54.744345  8540 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:54.692740  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:54.724951  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:54.694170  9907 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.721549  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:54.766731  8542 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:54.711898  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:54.742286  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:54.767334  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:54.767854  8467 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.719763  8463 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:54.743170  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:54.723722  9958 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.717484  9538 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:54.753401  8507 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.729967  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:54.774820  8470 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:54.710031  8290 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.759567  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:54.775810  8393 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:54.768024  8466 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.772418  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:54.731212  9963 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:54.740653  9872 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.740312  9778 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:54.778911  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 154366us
I20260709 13:01:54.784276  8290 catalog_manager.cc:5697] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.751571  9969 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.786222  8392 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:54.752615  9775 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:54.766922  9950 raft_consensus.cc:697] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:01:54.808542  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.811791  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.778306  9538 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:54.778570  9963 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.817538  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:54.820983  8468 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:54.822351  8468 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:54.817572  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 97737.6us
I20260709 13:01:54.824647  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.793342  8290 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.794586  9798 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.773411  9907 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.815718  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:01:54.827961  8387 raft_consensus.cc:2410] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:54.825240  9923 raft_consensus.cc:697] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:54.834132  8290 catalog_manager.cc:5697] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.788662  9927 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:01:54.837999  9969 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.842667  9950 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:54.780181  9958 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:54.830050  9789 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.856243  8466 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:54.836794  9748 raft_consensus.cc:993] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:01:54.856132  8467 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:54.856879  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:54.838481  8290 catalog_manager.cc:5697] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:54.858326  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 104985us
I20260709 13:01:54.835289  9957 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.845520  8389 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:54.886615  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:54.888114  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:54.888769  8393 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.890519  8394 raft_consensus.cc:1240] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:54.891669  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:54.894521  8390 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.844035  9775 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.897754  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:54.898584  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:54.898197  8290 catalog_manager.cc:5697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.900549  8392 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:54.903203  8394 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:54.907205  8290 catalog_manager.cc:5697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 4, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 4 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.901453  9798 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.892084  9748 raft_consensus.cc:1081] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:01:54.910651  8395 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:54.912349  8290 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:54.916337  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.917551  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 60752.8us
W20260709 13:01:54.924834  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.948427  8290 catalog_manager.cc:5697] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.950295  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:54.951561  8392 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:54.944398  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 59478.6us
I20260709 13:01:54.952319  9987 consensus_queue.cc:1059] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:01:54.958693  8290 catalog_manager.cc:5697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.940085  9878 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:54.973124  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.976052  8290 catalog_manager.cc:5697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:54.970057  9983 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:01:54.983470  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:54.984086  8395 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.984292  8290 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.971324  8387 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:54.946904  8393 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:01:54.980170  9984 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:01:54.987989  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:54.990180  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:54.992654  8390 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:54.978626  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.004343  8469 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:54.987388  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.020339  8390 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:54.987716  9961 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.022583  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.004856  9957 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:54.994764  9550 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.014281  9953 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.026073  8392 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:55.018738  9878 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:55.030138  8392 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.030718  8359 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.016886  8290 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.024037  9961 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.031920  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:55.025667  9980 log.cc:927] Time spent T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:01:55.018807  9966 consensus_queue.cc:1059] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:01:55.027568  9776 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.024386  9958 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:55.036886  8290 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.031774  9953 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:54.999804  9923 consensus_queue.cc:237] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:55.034446  9952 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:55.050426  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 111071us
I20260709 13:01:55.034934  9969 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.062143  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.055866  8389 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:55.062626  9957 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.063562  9953 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:55.064194  9961 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.070102  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.050230  8290 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 4, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 4 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.071272  8395 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:55.055616  9878 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:55.036485  9976 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:55.107041  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 44974.4us
I20260709 13:01:55.086607  9961 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.130149  9961 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:55.131398  9961 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:55.113418  9993 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:55.113410  8542 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:55.106487 10006 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.114663 10011 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:55.123752  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.127521  9976 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.129060  9987 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:55.138540  8544 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:55.133635  9813 consensus_meta.cc:287] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.529s	user 0.004s	sys 0.003s
I20260709 13:01:55.105108  9878 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:55.153827  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:01:55.154673  8542 raft_consensus.cc:606] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:55.155073  8542 raft_consensus.cc:614] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:55.155594 10001 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:01:55.167819  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 58151.4us
I20260709 13:01:55.168594  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.169950  8359 leader_election.cc:400] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:01:55.170009  9945 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.171132  8359 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.172278  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.172878  9945 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.173293  9945 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.173667  9945 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.164093  9953 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.174345  9953 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.175444  9797 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:55.176378  9953 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:55.173502  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.104475  9550 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.160475  9789 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.159627  9988 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.151714  9775 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.189599  9797 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:55.199458  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.177739  9538 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.205081  9538 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.205214  9878 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.210408  9778 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.212844  9963 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.218662  8393 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:55.217353  9872 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:55.222182  8508 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.225317  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:55.227564  9872 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.229301  9989 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.229346  8508 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.230165  9963 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.198051  9988 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.231117  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.231907  9995 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:55.232193  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 58754.5us
I20260709 13:01:55.232347  9988 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:55.232525  9953 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.232952  9953 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.233304  9953 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.235169  8359 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.236366  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.232369  9995 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.240614  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.240736  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:55.242511  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.242056  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.229426  9969 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.247367  9399 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.247411  9969 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:55.247931  9399 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.248329  9399 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.248557  9969 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.238883  9995 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.245164  9958 raft_consensus.cc:3055] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:55.250334  9958 raft_consensus.cc:740] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.251461  9776 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.251194  9958 consensus_queue.cc:260] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.252349  9958 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.245865  8544 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:55.246416  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:55.192408  9775 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.246914  9064 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:01:55.259918  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 175909us
I20260709 13:01:55.253520  8507 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:55.261197  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.263911  8462 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:55.258822  8508 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.265514  8359 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.266779  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:55.268257  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.244238  9778 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:55.253198  9952 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.263332  8507 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:55.253966  9797 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.255673  9969 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.270655  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.253997  9963 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.271270  9813 raft_consensus.cc:2764] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:55.260151  9775 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.255172  9789 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.260545  9776 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.273943  9976 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.269645  9989 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.272040  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.287565  9872 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:55.259860  9558 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:55.276105  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.276235  9963 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.285756  9797 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.318849  9797 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.319268  9797 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.322288  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.283108  9762 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:55.299767  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.261714  9961 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:01:55.261511  9970 consensus_queue.cc:1059] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:55.270004  9538 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:55.278405  9971 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.271478 10011 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:55.305972  9878 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:55.311059  8391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:01:55.311864  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.293645  9950 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.290509  9789 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.316262  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.318307  9963 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.288980  9776 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.279837  9577 consensus_queue.cc:1059] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:55.322959  8461 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:55.279460  9988 consensus_queue.cc:1059] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:01:55.289860  9816 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:55.330466  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.346503  8466 raft_consensus.cc:2410] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:55.336055  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:55.338263  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 44958.2us
I20260709 13:01:55.347216  8468 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:55.324491  8535 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:55.351056  8544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:01:55.351735  8544 raft_consensus.cc:606] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:55.346712  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 81305.1us
I20260709 13:01:55.354281  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:55.357110  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.357745  8542 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:55.336162  9762 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.337718  9971 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.342971  9976 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.362198  8468 raft_consensus.cc:1240] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:55.344394  9950 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.337103  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:55.344983  9776 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.366457  9968 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.366935  8468 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:55.367189  9968 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.367470  9538 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.368054  9538 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:55.368232  9968 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.370265  9762 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.374606  8466 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:55.375037  8466 pending_rounds.cc:85] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 1
I20260709 13:01:55.375304  8466 pending_rounds.cc:107] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:55.375559  8466 raft_consensus.cc:2889] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.398779  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.359968  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.407671  9969 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:55.364701  9748 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.426942 10021 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.361583 10011 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.380162  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.427558 10021 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.431097  8538 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:55.432094  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 74941.7us
I20260709 13:01:55.432478 10021 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.432816  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.432899  9789 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.434423  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.408811 10028 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:55.376964  9950 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.407752 10006 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.423380 10020 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:55.456293  8536 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:01:55.423523  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:55.423895  9945 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.425948  9961 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.426182  9797 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.458834  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:55.428614  8388 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:55.459692  8392 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.364897  9976 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.460279  9976 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.461406  9945 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.362540 10018 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.408078  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:01:55.467069  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 59069us
I20260709 13:01:55.468842  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.427035  9748 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.365724  9970 raft_consensus.cc:3055] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:55.452973 10021 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.453361 10022 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.453502 10006 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.452064  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.472412  9538 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.430197  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.451061  9778 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.481889  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.485239  8358 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:55.486353 10030 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.430449  9969 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.486395  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.498982  8390 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.474722  9970 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.502665  9953 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.503223  9846 consensus_queue.cc:1059] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:55.503376  9970 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.504240  9846 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.504534  9970 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:55.505431  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.505475  8390 raft_consensus.cc:1240] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.438719 10011 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.493314  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.484543 10021 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.473344 10018 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.494011  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.495132  8462 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:55.496085  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:55.509739  8541 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:55.500365  9961 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.522802  9961 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.523509  9813 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:55.523938  9813 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:55.477593  9797 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.502435  8386 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:01:55.487387  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:55.526789  8360 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:01:55.520922  8390 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:55.521204  8462 pending_rounds.cc:85] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 2
I20260709 13:01:55.530117  8462 pending_rounds.cc:107] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:55.530355  8462 raft_consensus.cc:2889] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.479377 10022 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:55.536391  8390 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.537866  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.539204  8542 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:55.537266  9878 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.540606  9878 raft_consensus.cc:697] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:55.521064  8388 raft_consensus.cc:2410] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:55.496842  9558 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.496023  9945 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.549484  8390 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:55.520138  9907 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:55.558415  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 61252.2us
I20260709 13:01:55.423398  9971 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.513990  8387 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:55.513065  9923 raft_consensus.cc:3055] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.566373  9923 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.566843  8394 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:55.567216  9923 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.567656  9844 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.567356  9775 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.518216 10021 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.568584  9923 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.511967  9953 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:55.557309  9558 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.570534  9748 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:55.520036 10018 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.464152 10028 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.521056  9399 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.564816  9778 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:55.564385  9878 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:55.514882 10006 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.516199  9969 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.542503 10022 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.586341  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.570529  9558 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.556766  9945 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:55.591073  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 122332us
I20260709 13:01:55.534397  9963 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.547861  9813 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.607028  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:55.614640  8542 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.614885  8395 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.615511  8391 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.615888  8391 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.601198  9945 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.619532  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.620569  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.620806  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.621079  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.622000  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.622303  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.629257  8461 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:55.629865  8470 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:55.630067  8466 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:55.630846  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.618010  9813 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.632949  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.633260  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.633855  8544 raft_consensus.cc:2410] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:01:55.633265  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 360166us
I20260709 13:01:55.619058  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.631798  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.635576  8467 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:55.636703  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.637385  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.639379  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.613246 10006 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.594707  9776 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.624768 10027 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:55.645581  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.646971  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.647710  8466 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.652376  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.658946  9399 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:55.659194 10004 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.660006  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.660674  9399 consensus_queue.cc:1059] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:55.661732  9953 raft_consensus.cc:3055] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.661840  9997 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.662187  9953 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.663082  9953 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.662259  9997 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.664512  9997 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.663278  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.666052  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.667119  8464 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.668951  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.672747  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.666085  8462 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:55.702965  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.703614  8468 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.708112  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.708243  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.709131  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.710858  8461 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:55.712507  8461 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.714564  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.707034 10022 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.714752  8541 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:55.715938  8393 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.659581 10004 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.718016  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.718894  8544 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:55.727305 10028 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:55.730149 10029 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:01:55.730468 10036 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:01:55.733184  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.703329 10027 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.624814  9948 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 13:01:55.753001  8394 raft_consensus.cc:1240] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.643580  9748 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:01:55.781818  8358 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:55.714293  9797 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.731411  9775 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.825402  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.809546  8466 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:55.838109  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:55.839632  8464 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:55.840692  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:55.843349  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.798223  9748 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.845111  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.828931  9952 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.857318  9976 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.859105  8464 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:55.859355  9976 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:55.850026  9984 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:55.798843  9958 consensus_queue.cc:1059] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:01:55.847560  9748 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.863157  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:55.875254  8465 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:01:55.829530  9797 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.751683  9957 consensus_queue.cc:1059] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:01:55.829702  9874 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:01:55.850016  9775 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.862583  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.867554  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:55.855000  9952 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.914215  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.915320  8394 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:55.913345  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:55.915917  8465 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:55.900230  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:55.919579  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.920766  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.899600 10021 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.922219  9953 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.922842  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:55.922554 10021 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.921866  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.925329  8394 raft_consensus.cc:2368] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:55.925926  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:55.928112  9961 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.929216  9995 raft_consensus.cc:3055] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:55.929657  9995 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:55.930640  9995 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.932168  9995 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.863864 10011 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.939438  8468 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:01:55.943120  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 205457us
I20260709 13:01:55.830569 10027 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:55.948817  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 86306.1us
I20260709 13:01:55.944254  8391 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:55.939952  9984 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:01:55.935173  9952 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.936441  8389 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:55.941646 10039 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.957998  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 113535us
I20260709 13:01:55.943010  9963 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.959750 10000 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.933386  9775 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:55.966045  8467 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:55.966610  8467 pending_rounds.cc:85] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 1
I20260709 13:01:55.966951  8467 pending_rounds.cc:107] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:55.967283  8467 raft_consensus.cc:2889] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.975605  8392 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:55.979228  8395 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:55.968649  9958 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.983829 10000 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.000522 10000 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:55.977406  9776 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:56.020447  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 72592.4us
I20260709 13:01:55.985046  9958 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:56.005539 10022 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:55.968990  9748 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.028206  9958 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.062883  8461 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:56.064064  8507 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:55.975067 10039 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:56.048465  9637 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:56.073570 10042 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.060606 10048 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.066072  9950 consensus_meta.cc:287] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.000s
I20260709 13:01:56.053098  9988 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:01:56.077112  8507 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:56.074167 10042 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:01:56.081873 10038 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:01:56.067399  9957 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.086259  8469 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:56.086606 10034 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:01:56.087006  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.087268  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 219794us
I20260709 13:01:56.088446 10005 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:56.089102  9923 consensus_meta.cc:287] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.005s
W20260709 13:01:56.089826 10041 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:01:56.093932  8537 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:56.069394  9550 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:56.075819  9797 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:56.164461  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 213192us
I20260709 13:01:56.168125  8461 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:56.093214  9945 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.065279 10027 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.146292  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:56.141577  8359 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:56.170017  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 93017.4us
I20260709 13:01:56.169847  8468 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:56.171566  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:56.168905  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:56.148434 10005 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.172586  8395 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:56.174048  8461 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:56.151633  9778 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:56.177728  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:56.182827  8359 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:56.184290  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:56.097920  9558 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:56.188406  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:56.102174  9950 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.185743  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:56.153576 10028 consensus_queue.cc:1059] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:56.153836  9969 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:01:56.188241  9778 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:56.172883  9399 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:56.178472 10005 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.193147 10052 consensus_queue.cc:1059] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:01:56.164734 10034 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:56.195124  9558 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:56.181644 10022 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:56.196456 10039 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.186794  9813 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:56.202591  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:56.203890 10021 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.205849  8507 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:56.330843  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 125086us
I20260709 13:01:56.332688  9971 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:56.333226  9971 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:56.097620 10048 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.207815  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:56.335208  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:56.335556 10048 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.336184 10059 consensus_queue.cc:1059] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.337025  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:56.337231 10059 consensus_queue.cc:1059] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:56.207845  9961 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:56.210386  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:56.215612  9958 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.338217 10059 raft_consensus.cc:3055] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.338287  9064 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 2 LEARNER]: Advancing to term 4
I20260709 13:01:56.338667 10059 raft_consensus.cc:740] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:56.339633  9958 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:56.340857  8395 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:56.340777  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 130474us
I20260709 13:01:56.220638  9952 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.233045  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:56.342365  8543 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:56.342621  8540 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:56.237848 10000 raft_consensus.cc:993] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:01:56.176853  9797 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:56.341552  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:56.248679  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:56.283561  8462 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:56.284287 10043 raft_consensus.cc:3055] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.305079  9399 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:56.288389  8391 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:56.241474 10055 log.cc:927] Time spent T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:01:56.301384  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 113073us
I20260709 13:01:56.180917  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:56.312115  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:56.197306  9775 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.321755  9970 raft_consensus.cc:3055] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.316803  8390 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:56.302379  9776 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:56.171762  9953 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.154331  9997 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.308810 10006 raft_consensus.cc:3055] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:56.349651  8462 pending_rounds.cc:85] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 2
I20260709 13:01:56.480585  8462 pending_rounds.cc:107] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:56.480865  8462 raft_consensus.cc:2889] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.401872  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:56.442619  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 130608us
I20260709 13:01:56.350054  9971 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.440587 10027 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:56.350126  8535 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:56.317859  9976 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:56.314095  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 141844us
W20260709 13:01:56.475611  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 134137us
I20260709 13:01:56.347767  9958 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:56.347457 10033 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.205s	user 0.003s	sys 0.007s
I20260709 13:01:56.452159  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:56.484119  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:56.357800  9558 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:56.486085  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 84355.1us
I20260709 13:01:56.503187  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:56.504191  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.504335  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:56.482901  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:56.505692  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:56.359367  9399 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.351853 10043 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:56.286780 10004 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:56.482940  9995 consensus_meta.cc:287] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.003s
I20260709 13:01:56.441247 10028 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:56.473233  9789 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.472373  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44078 (request call id 1012) took 1042 ms. Trace:
I20260709 13:01:56.341778  9813 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:56.480043  9953 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:56.313076  8544 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:56.474642  9970 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:56.469188  8388 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:01:56.507757  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:56.508872  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:56.480378 10006 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:56.490737  9846 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:56.480243  9969 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:56.508352  9749 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.491061  9797 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.339547 10059 consensus_queue.cc:260] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.517330  8391 rpcz_store.cc:276] 0709 13:01:55.310786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.310908 (+   122us) service_pool.cc:224] Handling call
0709 13:01:56.274262 (+963354us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400267fd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134dea3d 00007fbe184aecd0 00007fbe11a33254 00007fbe11a331e2 00007fbe11a33111 00007fbe11a3308c 00007fbe11a32342 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:56.353396 (+ 79134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643068800}
I20260709 13:01:56.497520  9958 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:56.511631  9775 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:56.576113  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:56.541345  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:56.511938 10048 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:56.708907  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:56.541921  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:56.709846  8394 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.510663  9989 raft_consensus.cc:1081] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:01:56.651196  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:56.512928  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1009) took 1197 ms. Trace:
I20260709 13:01:56.506954 10011 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.507090  9538 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:56.497706 10027 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:56.658371  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 150655us
I20260709 13:01:56.499397  9976 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.536686  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:56.794111  9538 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:56.662197  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:56.811551  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:56.519167  9558 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:56.666234  9789 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.696041  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.721220  9846 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:56.512099  9957 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.711191  8544 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:56.716300  8542 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:56.653527  9874 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.721347  8393 rpcz_store.cc:276] 0709 13:01:55.305620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.306931 (+  1311us) service_pool.cc:224] Handling call
0709 13:01:55.307289 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.716491 (+409202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.502621 (+786130us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54003c8f54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:56.502861 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939182976}
W20260709 13:01:56.862198  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 353345us
I20260709 13:01:56.863221  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:56.863865  8393 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 3.
I20260709 13:01:56.864351  8433 leader_election.cc:400] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:56.864785  8433 leader_election.cc:403] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:56.865288  8393 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:56.729664  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:56.865939  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:56.883893  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:56.818905 10011 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.668493  9776 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:56.775950  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 245129us
I20260709 13:01:56.849269  9952 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.575744 10028 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.800153  8394 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:56.914800  8394 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:56.708621 10043 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.575028 10004 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.664290  9969 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.726202  9950 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.669858  9749 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.786960  8388 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.860491  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:56.737562 10042 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:56.822085  9945 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.899490  8393 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:56.858399  9789 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.796115  8358 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:56.667058  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:56.797895  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 776) took 1247 ms. Trace:
I20260709 13:01:56.916460  8391 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:57.042629  9749 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:56.901378  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:57.041932  8536 rpcz_store.cc:276] 0709 13:01:55.483480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.492088 (+  8608us) service_pool.cc:224] Handling call
0709 13:01:55.492394 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.510023 (+ 17629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.510058 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.510548 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.628641 (+118093us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:55.632213 (+  3572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.643034 (+ 10821us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.695845 (+1052811us) raft_consensus.cc:1685] finished
0709 13:01:56.709720 (+ 13875us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.727930 (+ 18210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12674,"raft.queue_time_us":20513,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":59,"thread_start_us":104754,"threads_started":1,"wal-append.queue_time_us":209055}
W20260709 13:01:57.043481  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 142167us
I20260709 13:01:56.906977  9637 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.918681  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:56.924252 10028 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:56.930323  9068 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:56.931488  9846 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.933408  9558 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.940506  9813 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:56.738983  9953 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.885195 10075 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:56.795440 10006 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.038959  9969 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.039495 10074 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:57.045171  8469 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 2.
I20260709 13:01:57.049588  8388 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:56.896914  9958 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.870476  9957 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:57.054911  9637 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:57.055896 10076 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:57.056051 10072 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.078104  8388 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:56.887759  9874 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:56.909042 10011 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:57.053893 10043 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.060829 10028 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:57.063352  9950 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:57.057289  8389 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:57.082499 10071 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:57.072090  9813 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.093504 10080 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.099391  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 233564us
I20260709 13:01:57.072693 10063 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.057621  9778 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:57.085748  9953 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.083439  9969 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:01:57.092592  9064 consensus_meta.cc:287] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.003s
I20260709 13:01:57.219363  9064 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:57.044317 10073 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
W20260709 13:01:57.219708  9399 consensus_meta.cc:287] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.000s
I20260709 13:01:57.220296  9957 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:57.173563  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:57.223376  8461 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.077520 10075 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.101194 10034 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:57.165958 10071 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.172533  9813 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:57.217880  8386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60598 (request call id 82) took 1978 ms (client timeout 2134 ms). Trace:
I20260709 13:01:57.218369 10078 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:57.109483  9950 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:57.244338  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:57.332509  8469 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:57.335824  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.172130  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:57.215013  9874 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.219743  9064 pending_rounds.cc:85] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Aborting all ops after (but not including) 2
I20260709 13:01:57.170576  9033 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:57.140256 10028 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.244294 10039 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.343628  9950 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.221205 10070 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.161s
I20260709 13:01:57.279398 10071 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.376689  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:57.345774 10034 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.365242  9064 pending_rounds.cc:107] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:01:57.220144  9399 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.203914 10063 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.244254  9969 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.364270  9850 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:57.467509 10011 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.480898  8469 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:57.417403  9064 raft_consensus.cc:2889] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:57.285749  8386 rpcz_store.cc:269] 0709 13:01:55.224752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.224951 (+   199us) service_pool.cc:224] Handling call
0709 13:01:57.170875 (+1945924us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b5400248954. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:57.174676 (+  3801us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143017856}
I20260709 13:01:57.513928 10028 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.514482  9399 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.492901  9850 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:57.516376  9969 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.513329  9637 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.374418 10039 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:57.523061 10063 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.527417  9850 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:01:57.530736 10065 log.cc:927] Time spent T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.634s	user 0.010s	sys 0.024s
I20260709 13:01:57.534271  8461 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:57.348170 10078 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.543855 10039 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.205596 10080 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.457559 10034 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:57.553649  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 193620us
I20260709 13:01:57.555958 10075 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.556535  9065 raft_consensus.cc:2393] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:57.566694  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.601534  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.552765 10039 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:57.586117  9813 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:57.590046 10051 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 1.537s	user 0.012s	sys 0.016s
I20260709 13:01:57.590126  9064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58874 (request call id 74) took 1398 ms. Trace:
W20260709 13:01:57.593046  8537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 686) took 1817 ms (client timeout 1615 ms). Trace:
I20260709 13:01:57.596107  9950 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:57.608161  8537 rpcz_store.cc:269] 0709 13:01:55.776003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.777214 (+  1211us) service_pool.cc:224] Handling call
0709 13:01:57.592830 (+1815616us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400044054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:57.592950 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585866112}
I20260709 13:01:57.607534  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:57.603945  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:57.606477 10058 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:57.606726 10039 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.612493  9850 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.616448  9968 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.615121  9850 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.616931  9968 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.618357  9850 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.618681  9950 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.613688  8539 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:57.618957  9968 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.609014  9064 rpcz_store.cc:276] 0709 13:01:56.308119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.321540 (+ 13421us) service_pool.cc:224] Handling call
0709 13:01:56.338142 (+ 16602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.570403 (+1232261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.590035 (+ 19632us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:57.620090  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.620507  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.623740 10078 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.624557 10078 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.624691  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56998 (request call id 37) took 1439 ms. Trace:
I20260709 13:01:57.625231  8536 rpcz_store.cc:276] 0709 13:01:56.185213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.105300 (+920087us) service_pool.cc:224] Handling call
0709 13:01:57.221345 (+116045us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.268368 (+ 47023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.278142 (+  9774us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.406461 (+128319us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.555046 (+148585us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:57.555096 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.555190 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.624334 (+ 69144us) raft_consensus.cc:1685] finished
0709 13:01:57.624396 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.624613 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12238,"raft.queue_time_us":24938,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":32147,"thread_start_us":37439,"threads_started":1,"wal-append.queue_time_us":106128}
I20260709 13:01:57.627700  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:57.582420  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 411907us
I20260709 13:01:57.625111 10078 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.631837  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:57.615687 10039 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.628396  8536 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:57.606482 10034 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.634681  8537 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:57.635308  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.635730  9558 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.652849  8537 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:01:57.655655  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:57.657995  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:57.628803 10058 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:57.658248 10072 consensus_meta.cc:287] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:01:57.663233  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:01:57.653549 10005 consensus_meta.cc:287] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 1.346s	user 0.003s	sys 0.011s
I20260709 13:01:57.666040 10034 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:01:57.666102 10062 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.941s	user 0.005s	sys 0.010s
I20260709 13:01:57.664608 10072 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:57.673712 10034 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:57.677367  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1045) took 2038 ms. Trace:
I20260709 13:01:57.653708  9558 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:57.677760  8464 rpcz_store.cc:276] 0709 13:01:55.639391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.867652 (+228261us) service_pool.cc:224] Handling call
0709 13:01:55.871978 (+  4326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.089370 (+217392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.089417 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.090048 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.316415 (+226367us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:56.316457 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.316543 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.658683 (+1342140us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:57.677074 (+ 18391us) raft_consensus.cc:1685] finished
0709 13:01:57.677099 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.677313 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216919,"raft.queue_time_us":218440,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":525547776,"thread_start_us":225870,"threads_started":1,"wal-append.queue_time_us":447541}
I20260709 13:01:57.672418 10080 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.679483  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:57.683458  9971 consensus_meta.cc:287] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 1.177s	user 0.010s	sys 0.003s
I20260709 13:01:57.683868  9971 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.684573  9970 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.685544  9970 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:57.678681 10004 consensus_meta.cc:287] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.691s	user 0.004s	sys 0.008s
I20260709 13:01:57.690012  8537 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:01:57.690594  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:57.691419  8468 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 3.
I20260709 13:01:57.667065 10005 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.698530 10078 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.686344  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 792) took 1377 ms. Trace:
I20260709 13:01:57.690274 10071 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.680701 10034 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.720891  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 695) took 1977 ms. Trace:
I20260709 13:01:57.721372  8390 rpcz_store.cc:276] 0709 13:01:55.743472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.774780 (+ 31308us) service_pool.cc:224] Handling call
0709 13:01:55.775124 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.474776 (+699652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.720628 (+1245852us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54003f9dd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:57.720828 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244858752}
I20260709 13:01:57.723114 10060 raft_consensus.cc:3055] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:57.723527 10060 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:57.720923  9558 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:57.724387 10060 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.737342  8541 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:57.738190  9995 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.739418 10058 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.739156  9995 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:57.738384 10071 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.703337  8536 rpcz_store.cc:276] 0709 13:01:56.304416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.659110 (+1354694us) service_pool.cc:224] Handling call
0709 13:01:57.665446 (+  6336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.672453 (+  7007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.673955 (+  1502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.675499 (+  1544us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:57.675955 (+   456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.678833 (+  2878us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.681637 (+  2804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.742046  9033 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:01:57.747366  8538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 690) took 1564 ms (client timeout 1503 ms). Trace:
W20260709 13:01:57.750095  8538 rpcz_store.cc:269] 0709 13:01:56.182956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.746192 (+1563236us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:57.747292 (+  1100us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:57.751518 10067 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.711s	user 0.012s	sys 0.004s
I20260709 13:01:57.753098  8538 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:57.743692  9971 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:57.746826 10043 consensus_meta.cc:287] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.006s
I20260709 13:01:57.755517  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1032) took 1398 ms. Trace:
I20260709 13:01:57.755555 10087 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:57.757571 10087 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.757992 10087 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.759873  9995 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.755918  8392 rpcz_store.cc:276] 0709 13:01:56.356996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.360365 (+  3369us) service_pool.cc:224] Handling call
0709 13:01:56.360660 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.469096 (+108436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.469127 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.469579 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.709064 (+239485us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:56.709108 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.709177 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.750982 (+1041805us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:57.753896 (+  2914us) raft_consensus.cc:1685] finished
0709 13:01:57.753916 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.755427 (+  1511us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161,"raft.queue_time_us":3876,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9106,"spinlock_wait_cycles":9652992,"thread_start_us":217409,"threads_started":1,"wal-append.queue_time_us":568501}
I20260709 13:01:57.748498 10034 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.763002  8536 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:57.765321 10027 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.767645  9997 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.768630  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 794) took 1457 ms. Trace:
I20260709 13:01:57.769922  8536 rpcz_store.cc:276] 0709 13:01:56.311445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.749286 (+1437841us) service_pool.cc:224] Handling call
0709 13:01:57.762796 (+ 13510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.768335 (+  5539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.768565 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.776283 10087 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:57.777586  9776 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:57.770251 10039 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:01:57.772745 10061 log.cc:927] Time spent T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 1.120s	user 0.010s	sys 0.026s
W20260709 13:01:57.773463  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.0438e+06us
I20260709 13:01:57.777711  9997 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.779300  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 983190us
I20260709 13:01:57.749222 10005 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.850485  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:57.851356  8468 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.780378  9945 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:57.852450  9945 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.852830  9945 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.782509  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1046) took 1422 ms. Trace:
I20260709 13:01:57.854753  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1043) took 2216 ms. Trace:
I20260709 13:01:57.855140  8470 rpcz_store.cc:276] 0709 13:01:55.638805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.774421 (+135616us) service_pool.cc:224] Handling call
0709 13:01:55.774815 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.083814 (+308999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.083860 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.084479 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.314503 (+230024us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:56.314566 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.314663 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.772077 (+1457414us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:57.854431 (+ 82354us) raft_consensus.cc:1685] finished
0709 13:01:57.854457 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.854690 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":308554,"raft.queue_time_us":309568,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":666474368,"thread_start_us":229423,"threads_started":1,"wal-append.queue_time_us":413870}
I20260709 13:01:57.799006  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:57.854018  8393 rpcz_store.cc:276] 0709 13:01:56.360882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.059322 (+698440us) service_pool.cc:224] Handling call
0709 13:01:57.059645 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.782003 (+722358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.782049 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.782118 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:57.782165 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.782271 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.782435 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":721982,"raft.queue_time_us":789787}
I20260709 13:01:57.851128  8507 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:57.771209  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 708) took 1624 ms. Trace:
W20260709 13:01:57.918215  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 67175.1us
W20260709 13:01:57.917557  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 118707us
I20260709 13:01:57.920469  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:57.938557  8468 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
I20260709 13:01:57.938776  9065 raft_consensus.cc:2368] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4.
I20260709 13:01:57.938861  9776 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:57.940120  9033 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:57.941128 10042 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:57.941727 10042 raft_consensus.cc:697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 5 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:57.944756  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:57.959024  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 809) took 2334 ms. Trace:
W20260709 13:01:57.959971  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.959723  8462 rpcz_store.cc:276] 0709 13:01:55.624220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.730967 (+106747us) service_pool.cc:224] Handling call
0709 13:01:56.283181 (+552214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.490751 (+207570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.958705 (+1467954us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54001cacd0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:57.958935 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269278464}
I20260709 13:01:57.981158 10053 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:57.990846 10058 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:57.818197 10087 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:57.854264 10082 consensus_queue.cc:1059] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:01:57.993523 10042 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:57.994812 10082 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:57.995194 10082 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:58.002450  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 57765.6us
I20260709 13:01:58.003563  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:58.005656  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 44267.6us
I20260709 13:01:58.006315  8392 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.006381  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.008811  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.009593  8388 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.011394  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.013533  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.014415  8388 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:58.016539  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.017462  8388 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.022287  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:57.944768  9995 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:58.030300  8359 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:01:58.027392  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.034848  8392 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:58.036160  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.036976  8359 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:57.942094 10069 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:57.917512  9971 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:01:57.855216  9997 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.019263  9775 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.026856  9952 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.996376  9963 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:01:58.030227 10043 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:58.039073  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:57.996121  9923 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:01:58.019526  9797 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.034168 10053 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.049161  8388 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:58.038199 10021 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.059648  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:58.045742  9961 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:58.099730  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.049923  9995 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:58.061141  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:58.105990 10094 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:01:58.106921  8467 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.127497  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.128330  8467 raft_consensus.cc:2393] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:58.128680  9958 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.129216  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.107786  8463 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.068742  8468 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:58.131007  8468 pending_rounds.cc:85] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 2
I20260709 13:01:58.071651  8461 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.110913 10075 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.132475  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.064177 10027 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:58.112238  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46194.3us
I20260709 13:01:58.113591  8464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:01:58.066001  9874 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:58.066151 10078 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.115181  8470 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:58.119545  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.085330  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.064062 10034 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.144199  8466 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.111374 10080 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:58.114180  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.150233 10080 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.066660 10082 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.151949 10082 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.153290 10080 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.154151  9994 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:58.154811  9994 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.154834  8467 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.132417  8389 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.158429  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.158954 10080 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.163352 10080 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.113468  9950 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.166944  9950 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.167843  9945 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.168561  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:58.169128  9950 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.170003 10060 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.131349  8468 pending_rounds.cc:107] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:01:58.143042 10027 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:58.066815  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.141976 10075 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.146441 10021 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:58.148931  8358 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.121590  9813 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.121635 10072 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.159125  8389 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.141484  9874 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.164588  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1042) took 1805 ms. Trace:
W20260709 13:01:58.171201  8395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 709) took 2023 ms (client timeout 2066 ms). Trace:
I20260709 13:01:58.171316  8468 raft_consensus.cc:2889] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.063916 10043 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.144932 10078 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.174139  8388 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:58.176447  8466 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:58.062657  9775 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:58.185563  8358 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.195:40791 timed out after 1.514s (SENT) [suppressed 2 similar messages]
I20260709 13:01:58.064558  9797 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.057512  9952 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.191774  8462 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:58.187652  8395 rpcz_store.cc:269] 0709 13:01:56.147454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.185525 (+ 38071us) service_pool.cc:224] Handling call
0709 13:01:58.170966 (+1985441us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b540010c054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:58.171131 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114445184}
I20260709 13:01:58.189527  8394 rpcz_store.cc:276] 0709 13:01:56.359374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.002913 (+643539us) service_pool.cc:224] Handling call
0709 13:01:57.055687 (+ 52774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.781426 (+725739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.781472 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.844270 (+ 62798us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.055830 (+211560us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:58.055886 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.055978 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.164154 (+108176us) raft_consensus.cc:1685] finished
0709 13:01:58.164175 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.164523 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":725320,"raft.queue_time_us":788588,"spinlock_wait_cycles":204976896,"thread_start_us":206253,"threads_started":1,"wal-append.queue_time_us":281978}
I20260709 13:01:58.186800  9813 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.188486 10072 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.197125  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.204996  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.187623 10022 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.209160  8395 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.144245 10053 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:01:58.209614  8388 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.190160  9874 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.208407  9963 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.213817  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.202982  9067 raft_consensus.cc:1240] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 5 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:58.222342  9963 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:58.223512 10053 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.224141 10053 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:58.225009  9963 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.227530 10078 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.230448  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.231222  8394 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.232194  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.213486 10022 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.233716  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.234238 10022 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.234627  8389 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:58.235532  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.236672  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.237213  8389 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.237778  9874 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.207230 10039 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.221163  9997 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.221329 10072 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.237972  8394 raft_consensus.cc:2376] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4. Re-sending same reply.
W20260709 13:01:58.239830 10098 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:01:58.242341  9874 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.206176  9776 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.250576  8395 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
W20260709 13:01:58.220551 10064 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 1.368s	user 0.013s	sys 0.029s
I20260709 13:01:58.206749 10059 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:58.251382  8541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 784) took 2464 ms (client timeout 1514 ms). Trace:
I20260709 13:01:58.244491  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:58.255926  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1043) took 1896 ms. Trace:
I20260709 13:01:58.258345  9032 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
W20260709 13:01:58.257431  8541 rpcz_store.cc:269] 0709 13:01:55.779678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.779841 (+   163us) service_pool.cc:224] Handling call
0709 13:01:58.243438 (+2463597us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b5400161054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:58.243540 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4247717120}
I20260709 13:01:58.258163  8391 rpcz_store.cc:276] 0709 13:01:56.359586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.042518 (+682932us) service_pool.cc:224] Handling call
0709 13:01:57.042906 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.780671 (+737765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.780702 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.781166 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.025142 (+243976us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:58.025180 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.025264 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.239295 (+214031us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:58.247869 (+  8574us) raft_consensus.cc:1685] finished
0709 13:01:58.247900 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.255841 (+  7941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":753590,"raft.queue_time_us":801293,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":68778,"spinlock_wait_cycles":7276288,"thread_start_us":34462,"threads_started":1,"wal-append.queue_time_us":133110}
I20260709 13:01:58.180413 10034 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.265875  8388 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.259341 10050 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.279453  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.209292  9995 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:58.284124  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:58.285883  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:58.286789  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 680) took 2653 ms. Trace:
I20260709 13:01:58.290200  8464 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.290750  8464 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.290302  8542 rpcz_store.cc:276] 0709 13:01:55.625715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.629219 (+  3504us) service_pool.cc:224] Handling call
0709 13:01:56.715936 (+1086717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.861161 (+145225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.279066 (+1417905us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000fb750. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:58.279191 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498342144}
I20260709 13:01:58.260111  9776 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.296342  9952 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.296787  9538 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.302016  9813 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.302616 10043 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.325278  9032 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:58.326422 10039 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.326972 10039 raft_consensus.cc:697] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:58.327911 10039 consensus_queue.cc:237] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:58.330873  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.331677  8394 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.303030  9797 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.293018 10078 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:58.342159  8464 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.286101 10050 raft_consensus.cc:697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:01:58.307793  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 691) took 1133 ms. Trace:
I20260709 13:01:58.311691  9994 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.312424 10034 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.313192  9945 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:57.922689  8387 rpcz_store.cc:276] 0709 13:01:56.147122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.257646 (+110524us) service_pool.cc:224] Handling call
0709 13:01:56.315711 (+ 58065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.349384 (+ 33673us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:56.666116 (+316732us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.770545 (+1104429us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b18002a6ee0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe10374c0a 00007fbe19ab4219 00007fbe103fca40 00007fbe103f74e4 00007fbe103f7455 00007fbe134df060 00007fbe134f1716 00007fbe13502287 00007fbe13502208
0709 13:01:57.770707 (+   162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.770765 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:57.770876 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.770985 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.771148 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1326,"prepare.queue_time_us":346619,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":990725,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"spinlock_wait_cycles":53964672,"thread_start_us":201721,"threads_started":2,"wal-append.queue_time_us":225663}
I20260709 13:01:58.284761 10027 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.314155  8393 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:58.361590  8394 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:01:58.363013  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.304811 10053 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:58.333181  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.334797  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.365571  8394 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:58.366355  8388 raft_consensus.cc:2393] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:58.295302  9950 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:58.305043  9789 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:58.343439  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 157904us
I20260709 13:01:58.345191 10081 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.347980  9032 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:58.293609  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.369119  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.400646  8393 raft_consensus.cc:2368] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4.
W20260709 13:01:58.400674  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 52783.9us
I20260709 13:01:58.326996 10006 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.380352  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:58.397930 10075 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.399670 10080 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.406690  9945 consensus_queue.cc:1059] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:58.381160  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:58.346789  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.408960  8395 raft_consensus.cc:2393] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:58.349296  9923 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.387663  9776 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.389848  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 786) took 2195 ms. Trace:
I20260709 13:01:58.390470  9797 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.393962 10053 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.346692  8538 rpcz_store.cc:276] 0709 13:01:57.174335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.764399 (+590064us) service_pool.cc:224] Handling call
0709 13:01:57.846671 (+ 82272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.940880 (+ 94209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.940919 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.941500 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.126611 (+185111us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:58.126924 (+   313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.126993 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.229717 (+102724us) raft_consensus.cc:1685] finished
0709 13:01:58.229765 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.307430 (+ 77665us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b5400058cd0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:58.307704 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5190,"raft.queue_time_us":2149,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":43266,"spinlock_wait_cycles":119140096,"thread_start_us":163389,"threads_started":1,"wal-append.queue_time_us":198831}
I20260709 13:01:58.415827 10053 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.396642 10050 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:58.342800 10078 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:58.417878 10078 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.418500 10053 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.414479  9950 raft_consensus.cc:697] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:58.413856  8539 rpcz_store.cc:276] 0709 13:01:56.183194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.793113 (+609919us) service_pool.cc:224] Handling call
0709 13:01:56.793462 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.619297 (+825835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.349471 (+730174us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54002ca1d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:01:58.378696 (+ 29225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874402688}
I20260709 13:01:58.419906  9950 consensus_queue.cc:237] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.370289  9976 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:58.414752  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 121218us
I20260709 13:01:58.428287  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.429256  8390 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:58.430415  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.407555  9945 consensus_queue.cc:1243] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer 92314b14f5554885a80c3dc87f4beed4 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:58.416174 10100 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.396498  9961 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:58.435901  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.440853  8390 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:01:58.438686  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.441440  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.443598  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.443885  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.444416  8465 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:01:58.439935  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.409811 10057 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.445541  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:58.446408  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.452289  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.408073  9874 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:58.454690  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.408568 10081 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.455578  8390 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:01:58.458149  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.459255  8390 raft_consensus.cc:2368] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:58.460337  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.441915  8462 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:58.470072  8543 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:58.471870  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.472770  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.473881  8390 raft_consensus.cc:2393] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:58.435376  9775 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:58.480050  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56998 (request call id 38) took 2294 ms. Trace:
I20260709 13:01:58.444685 10082 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.413600  9923 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.482730  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.482963  8544 rpcz_store.cc:276] 0709 13:01:56.185467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.478979 (+2293512us) service_pool.cc:224] Handling call
0709 13:01:58.479378 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.479597 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.479637 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.479695 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:58.479738 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.479812 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.479976 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.445358 10046 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.490566  8390 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:58.445889 10100 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:58.493582  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:58.508451  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.508862  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.452875 10057 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:01:58.437469  9797 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.482499 10103 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:58.443531  9945 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 13:01:58.519040  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.482914 10043 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.520644  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.487358  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:58.483974 10045 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:01:58.483610  9749 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.489107  8535 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.525696  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.530143  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.491637  8386 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:58.527740  8464 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.522009 10103 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:58.538384  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:58.538848 10103 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.540166 10103 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.542994  8395 raft_consensus.cc:3055] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:58.543371  8395 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:58.523550  9988 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:58.544062  8395 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:58.545302 10100 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.519476 10057 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.561538  8507 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.550627  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.491328 10082 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.513928  8390 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:58.556316  8395 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.486948 10022 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.566989  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.567049  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:58.571411  8542 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.568567  8508 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:58.571950  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.572552  8388 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:01:58.569370  8544 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:58.522644  9874 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.572633  8390 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:58.591748  8465 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:01:58.592634  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.574457  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.577114  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.594946  8467 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:58.596060  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.596632  8467 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.544427  9988 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.582551  8470 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:58.585350  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.602358  8461 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.515156 10046 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.627050  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.627403  8395 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:01:58.627737  8395 pending_rounds.cc:85] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 5
I20260709 13:01:58.627696  8461 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:58.628065  8395 pending_rounds.cc:107] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:58.628301  8395 raft_consensus.cc:2889] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.628650  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.629196  8461 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:58.629312  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.593255  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.578047  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.630535  8466 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:58.631031 10117 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.630851  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.631449  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.632102  8466 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 1.
I20260709 13:01:58.632411 10116 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.633100 10116 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.633384  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.599319  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.571290  8539 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:58.605329  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.635162  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.635944  8386 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:58.636037  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.636646  8394 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:01:58.636799  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.631458 10117 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.639168 10117 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.640033 10046 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.642414  9923 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.633077  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.644034  8466 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.566306  9775 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.632094  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.534524  9749 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.647140  8395 raft_consensus.cc:2410] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:58.648443  9749 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.650292  9988 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.591747 10075 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.651081 10075 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.651925  8466 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:58.534307 10045 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:58.653157 10075 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.653877 10045 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:58.605942  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.591020  9878 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.606940  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.608222  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.528079 10043 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:58.635183  8435 leader_election.cc:400] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4.
I20260709 13:01:58.657632  8542 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:58.674423  8435 leader_election.cc:403] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:58.659415  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.661751  8467 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:58.590318  8464 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:58.653878  8466 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:58.637470  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:58.677902  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 188539us
W20260709 13:01:58.634577  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 73153.5us
I20260709 13:01:58.679172  8507 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.683218  8391 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:58.683813  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.685276  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:58.654753 10005 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:58.677352 10060 consensus_meta.cc:287] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.002s
I20260709 13:01:58.688454  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:58.664927 10082 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.635183  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.601740  9874 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.689230  8537 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:01:58.692994  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 124506us
W20260709 13:01:58.688449  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 126905us
I20260709 13:01:58.664808  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.690337  8542 raft_consensus.cc:2376] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4. Re-sending same reply.
I20260709 13:01:58.689693  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.705040 10072 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:58.705363  8433 leader_election.cc:400] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4.
I20260709 13:01:58.705446 10072 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.706133 10072 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.706962  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.709201  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.710165 10075 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.710386  8433 leader_election.cc:400] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:58.710566 10075 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.710987  8433 leader_election.cc:403] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.711098 10075 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.712534  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.713933  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.714164 10027 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.714618 10027 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.714820 10101 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.714996 10027 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.715332 10101 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.715870 10101 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.716008  9538 consensus_queue.cc:1059] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:58.716522  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.713941 10006 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.731010 10027 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.735066 10072 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.686575  9749 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:58.663671 10008 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:01:58.739568  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:58.743606  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.692107 10069 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.759819  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:58.760926  9874 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.759859 10069 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.762789 10043 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:01:58.677611 10078 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.690145  9789 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:58.746745  8390 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:01:58.692512  9976 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.764432  8461 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:01:58.748128  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 43763.4us
I20260709 13:01:58.765089  8507 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.766263  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.767082  8507 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.676579  9878 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.770466 10078 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.770972  9878 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.771132 10078 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:58.770879 10117 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.690333  9813 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4.
I20260709 13:01:58.771600 10078 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:58.772240 10078 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:58.752307  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:58.773249 10117 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.703701 10081 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.755177  8509 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:01:58.688851  9950 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:01:58.763013  8393 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:58.767933  8394 raft_consensus.cc:3055] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:58.786921  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:58.787220  8394 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:58.787559  8538 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.787989  8394 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.788964  8394 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.690990 10005 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.792182  8465 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:58.786928  8393 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:58.783949  9778 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:01:58.785966  9950 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:01:58.794021 10034 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:58.795181 10106 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:01:58.797399  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 789) took 2613 ms (client timeout 2051 ms). Trace:
I20260709 13:01:58.764902 10060 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.798568 10060 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:58.797967  8543 rpcz_store.cc:269] 0709 13:01:56.183926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.513308 (+329382us) service_pool.cc:224] Handling call
0709 13:01:58.244338 (+1731030us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:01:58.796985 (+552647us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b5400189cd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:58.797192 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240863232}
W20260709 13:01:58.819841  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 52824.9us
I20260709 13:01:58.820622  8507 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.822821  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.756739  9749 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:58.833696  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 81467.7us
I20260709 13:01:58.832417  8394 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:58.834651  8394 pending_rounds.cc:85] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 2
I20260709 13:01:58.835347  8394 pending_rounds.cc:107] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:58.835750  8394 raft_consensus.cc:2889] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.770449 10072 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.756497 10063 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:01:58.753778 10068 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:01:58.815119  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.766966  9958 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
W20260709 13:01:58.842671  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 87572us
I20260709 13:01:58.818228  9789 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:58.847393  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:01:58.848575  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 117450us
I20260709 13:01:58.850435  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.850666  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:58.851055  8470 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:58.851329  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.852183  8358 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.852991  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.855085  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.835018  9749 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.834921 10059 raft_consensus.cc:2764] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:58.838467  9966 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:58.861696  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.838732 10045 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:58.859189  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.858467  8507 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.843156 10117 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.863111  8466 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.865314  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.865999  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.866091  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.866449  8464 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.867079  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.860741  8358 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:58.843885 10082 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:58.846230 10071 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.846166  8535 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:58.873298  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.872470  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.887182  8542 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:01:58.877084  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.879238  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.865422 10045 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.863927  9966 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.854427  9948 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:01:58.875089 10118 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:01:58.855495 10072 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:58.878230  9789 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.864482  9963 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.890002  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.868961  9878 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.891005  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.871063 10119 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:58.869051 10117 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.892858  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:58.870285  9994 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.917878  8542 raft_consensus.cc:2393] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:58.871515  8358 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:58.873090  9952 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:58.873311 10046 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.909209  8466 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:58.888720 10005 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:58.924427  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.875560 10060 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:58.911679  8464 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:58.928980  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.929930  8542 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:58.894142  9966 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.891804 10045 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.923786 10116 consensus_queue.cc:1059] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:01:58.932377  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.933004  8466 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:58.933828  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.934291  8466 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.922605 10117 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.935969  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:58.907145 10082 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:58.937354 10082 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.901600  9995 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:58.940930  8466 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:58.941854  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.942487  8466 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:01:58.942562  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 71135.9us
I20260709 13:01:58.943536  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.944476  8466 raft_consensus.cc:2368] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5.
I20260709 13:01:58.945153  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.945247  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.946293  8466 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:58.949676  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.950529  8466 raft_consensus.cc:2376] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4. Re-sending same reply.
I20260709 13:01:58.951686  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:58.953147  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.912808  8463 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:58.953208  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.909158  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:58.953922  8466 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:01:58.911059 10072 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:58.955001  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.960300  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:58.913383  9878 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.957762  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.962934  8393 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.963738  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.958456  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:58.959100  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.946684  9778 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.964915  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:58.965019  8392 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:01:58.956832  9789 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:58.945256  9995 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.971550  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.949513  9952 raft_consensus.cc:697] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:58.973208  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:58.977494  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:58.991081  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:58.995451  8392 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:58.996610  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:58.953722  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.997218  8392 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.000753  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:01:58.913590 10075 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:01:59.016676  8393 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:58.966396 10027 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.020560  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.962780 10119 raft_consensus.cc:697] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:01:59.021426  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 61218.1us
I20260709 13:01:59.084995  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:01:59.024183 10071 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:59.024974 10124 log.cc:927] Time spent T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:01:59.088498  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 174225us
W20260709 13:01:59.025774 10121 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:01:59.027923 10070 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:59.030642  8463 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.032687  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:59.034268  9952 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.036813 10101 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.043490 10057 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:01:59.045372  8538 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:59.047096 10005 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.107321 10005 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.107739 10005 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.107815  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.109113  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:59.109475  8464 raft_consensus.cc:1240] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:59.047264 10075 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.113090  8464 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:58.994665  9874 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.114120  9966 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.114770  9874 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.115195  9874 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.116503  9966 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.050207  8539 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:59.002733  9995 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.118777  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.120100  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.120901  8539 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:01:59.052000 10103 consensus_meta.cc:287] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.004s
I20260709 13:01:59.052433  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:59.021006  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:58.955559 10046 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:58.990754  9789 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:59.055891  8466 raft_consensus.cc:2393] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:01:58.967581  9878 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:59.057000  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 83874.5us
I20260709 13:01:59.146485  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:59.148274  8359 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:59.148962  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:58.965587  9994 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:59.082160  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 1055) took 1015 ms. Trace:
I20260709 13:01:59.150286  8462 rpcz_store.cc:276] 0709 13:01:58.066419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.066554 (+   135us) service_pool.cc:224] Handling call
0709 13:01:59.081953 (+1015399us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5400389fd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:59.082093 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46113536}
I20260709 13:01:59.036870 10006 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:59.086598  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.126556  8538 raft_consensus.cc:2368] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:59.089951  8508 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:59.095499  8392 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
W20260709 13:01:59.159097  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 181676us
I20260709 13:01:59.082994  9963 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.105916  9988 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:59.124771  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:59.163435  8467 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:01:59.163867  8393 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:59.146781  9789 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:59.194487  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 43947.1us
W20260709 13:01:59.194830  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 104948us
I20260709 13:01:58.993160  9778 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:59.126564  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:59.087369 10071 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:59.157773 10103 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:59.142380  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:59.154304  8359 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:59.204911  8394 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
W20260709 13:01:59.205224  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 50973.7us
I20260709 13:01:59.205881  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:59.156725  8544 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.959874  9637 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
W20260709 13:01:59.158425  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.122154 10119 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.105332 10101 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:59.168133  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.099220 10137 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.195647  8507 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:59.198874  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.155570  9945 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:59.135257  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:59.201963  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.205947  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:59.096268 10070 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:59.159642  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:59.225157  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:59.225684  8392 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.227335  8507 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:59.227602  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.212267  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.157567 10104 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.229521 10104 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:59.229979 10104 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:59.230180 10116 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.230783 10116 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.231204 10116 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.231073 10104 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.102074 10060 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:01:59.197907  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:59.235081  8387 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:59.199693  9966 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:59.223189  8395 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:59.234078  9971 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:59.238981  9971 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.239224  8507 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:59.240305  9923 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.240736  9923 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.241102  9923 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.242360 10116 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.247187  8507 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:59.239396  9971 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.251549  9966 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.252039  9966 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.252439  9966 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.252570 10116 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.265071  9966 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.269616  9923 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.281648 10103 raft_consensus.cc:697] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:59.224141 10070 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:59.221916 10133 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:01:59.219780 10137 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:01:59.303030  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:59.303649  8544 raft_consensus.cc:3055] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:59.304021  8544 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:59.216259 10078 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.311244  8392 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:01:59.313364  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:01:59.314075  8392 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:59.314178  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.314571  8507 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:59.305001  8544 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.319701  8544 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.302269  9945 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.328265 10057 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.330628  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.332283  8392 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:59.335518  8507 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:59.304850 10137 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.299607  9550 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 13:01:59.350950  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 145070us
I20260709 13:01:59.323767 10082 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:59.322013 10140 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.278483  9994 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.352875  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:01:59.343122  9963 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.360141  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:59.311082  9988 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:01:59.341097  9778 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.352757 10081 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:59.368202  9963 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:59.388186  9963 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.389863  9064 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:59.390527  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:01:59.355594 10142 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:01:59.393559  8389 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:59.306439 10071 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:59.386240 10134 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:01:59.424156  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:59.425042  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 72218.6us
I20260709 13:01:59.433991  8359 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
W20260709 13:01:59.419514  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 117518us
I20260709 13:01:59.343567  9945 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:01:59.383180 10078 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.377646  9952 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.397830 10082 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:59.436044  8508 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:59.444322  8544 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:01:59.375473  9923 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.377283  9966 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:59.375171  8535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 796) took 3051 ms (client timeout 1983 ms). Trace:
I20260709 13:01:59.463022  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:59.410910 10022 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.382282 10081 raft_consensus.cc:697] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:01:59.418292 10046 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.456688  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.375916 10147 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.459573  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.387609  9874 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.360486 10103 consensus_queue.cc:237] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.473402  8544 raft_consensus.cc:2368] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:01:59.397325 10140 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.470041 10063 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.476675  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:59.477716  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.477896  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:01:59.479422  9950 consensus_meta.cc:287] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
I20260709 13:01:59.383633 10072 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.497112  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:59.449654 10151 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:59.498456 10082 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.542486  8544 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:59.559581  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.565515  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.566515  8544 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:59.458648 10156 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.458241  9952 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.568883  8395 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:59.541682  9778 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:59.464999 10005 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.570330  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:01:59.568833  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 134974us
I20260709 13:01:59.579651  8544 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.580257  8359 leader_election.cc:400] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5.
I20260709 13:01:59.580651  8359 leader_election.cc:403] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:59.581743  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:01:59.582506  8392 raft_consensus.cc:1240] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.587137  8544 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
W20260709 13:01:59.596678  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.463425  8535 rpcz_store.cc:269] 0709 13:01:56.324090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.537030 (+212940us) service_pool.cc:224] Handling call
0709 13:01:59.374964 (+2837934us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54000889d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:59.375093 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3843533056}
I20260709 13:01:59.574007 10071 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.572407 10156 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.502328 10147 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:59.603361 10127 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.652s	user 0.005s	sys 0.000s
I20260709 13:01:59.589345  9971 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.578390 10151 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:59.590524 10072 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.609512  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1078) took 1100 ms. Trace:
I20260709 13:01:59.591889  9778 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.605115  9963 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:59.599763 10045 consensus_meta.cc:287] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.000s
W20260709 13:01:59.615583  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 67501.6us
I20260709 13:01:59.621860  8391 rpcz_store.cc:276] 0709 13:01:58.509531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.684017 (+174486us) service_pool.cc:224] Handling call
0709 13:01:58.684322 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:58.684645 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.684671 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:58.687751 (+  3080us) log.cc:844] Serialized 52 byte log entry
0709 13:01:58.971385 (+283634us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:59.021426 (+ 50041us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.021665 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.021733 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.609271 (+587538us) raft_consensus.cc:1685] finished
0709 13:01:59.609291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.609456 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27226,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":10269,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":4029,"thread_start_us":228457,"threads_started":1,"wal-append.queue_time_us":399014}
I20260709 13:01:59.600030 10059 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.624797  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:59.628465  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:59.613343 10156 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.635946 10164 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:59.625837 10117 consensus_meta.cc:287] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.691s	user 0.003s	sys 0.007s
I20260709 13:01:59.606966 10081 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.640079  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.641237  9778 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:59.641528  9749 consensus_meta.cc:287] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.773s	user 0.005s	sys 0.005s
I20260709 13:01:59.643018  9963 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.645349 10148 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:59.646425  8392 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:01:59.650257 10145 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:01:59.633108 10045 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.612820  9995 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.667505  9778 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:59.665496 10048 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.445s	user 0.016s	sys 0.011s
I20260709 13:01:59.679730 10045 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:59.680045 10048 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.462s	user 0.016s	sys 0.012s
I20260709 13:01:59.682519  9995 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:59.683370 10143 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:01:59.684051 10163 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:59.650781  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:59.677882 10140 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.665992  9749 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.652458  9945 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.679342  9963 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:59.654878 10164 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:59.633345 10059 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.685315 10151 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.694078  9797 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.654203 10117 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.705818 10117 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:59.699960  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.706105  8541 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:01:59.686347 10148 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:59.717437 10153 log.cc:927] Time spent T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:01:59.713408  9789 consensus_meta.cc:287] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.002s
I20260709 13:01:59.729947 10147 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.716521 10005 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.725021  9874 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.746583  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:59.747336  8469 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:59.748147  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:59.748567  8469 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.750839  9961 raft_consensus.cc:3055] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:59.746853  9971 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.746451 10059 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.745221  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:59.753378  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:59.753746 10034 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:01:59.754015  8463 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.757732  8540 raft_consensus.cc:2410] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:59.751314  9961 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:59.728767  9789 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.754238 10034 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.766247  8469 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:59.761955 10164 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.776005  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:59.781410  9748 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.785285  8463 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:59.787900  8469 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:01:59.788125 10069 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.790773  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:59.798959  8469 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:01:59.792526  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:59.814437  8463 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:01:59.815858  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.818133  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:59.827062  9878 consensus_meta.cc:287] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.670s	user 0.005s	sys 0.005s
I20260709 13:01:59.827608  9878 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.830318  8394 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:59.831029  9789 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:01:59.831434 10070 consensus_meta.cc:287] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.007s
I20260709 13:01:59.811966 10034 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.831866 10070 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.834074  8537 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
W20260709 13:01:59.835752  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.844810  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:59.863786  8543 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.840978 10046 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:59.864369 10104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.013s	sys 0.021s
I20260709 13:01:59.793452  9961 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.869451  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:01:59.871655 10104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.013s	sys 0.021s
I20260709 13:01:59.874119 10022 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Leader election lost for term 4. Reason: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5.
I20260709 13:01:59.864638  9878 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.880096  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:01:59.832608 10137 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:01:59.885751  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:59.887393  8469 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.886639  9961 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.868085 10046 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:01:59.899379  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 234312us
I20260709 13:01:59.918835  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 1097) took 1330 ms. Trace:
I20260709 13:01:59.920610  8470 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.919385  8461 rpcz_store.cc:276] 0709 13:01:58.588894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.632676 (+ 43782us) service_pool.cc:224] Handling call
0709 13:01:59.918534 (+1285858us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003cffd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:59.918750 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298799360}
I20260709 13:01:59.922626  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:01:59.923341  8461 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.917331  8469 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:59.919745  8358 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:01:59.895553 10034 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:01:59.939024  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:59.939849  8538 raft_consensus.cc:2376] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5. Re-sending same reply.
I20260709 13:01:59.931288  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:01:59.932862  8544 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.942827  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:01:59.945333  8461 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:01:59.937323  9878 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:59.948618  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 825) took 1097 ms. Trace:
I20260709 13:01:59.949965  8469 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:59.952723 10123 raft_consensus.cc:3055] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.958320  8467 rpcz_store.cc:276] 0709 13:01:58.850993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.851099 (+   106us) service_pool.cc:224] Handling call
0709 13:01:59.948453 (+1097354us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400096ad4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:59.948555 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716395392}
I20260709 13:01:59.896817 10156 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:01:59.960448  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 335722us
I20260709 13:01:59.963243  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 837) took 1030 ms. Trace:
I20260709 13:01:59.963966  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:01:59.944161  8463 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:01:59.963812  8466 rpcz_store.cc:276] 0709 13:01:58.932561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.963527 (+ 30966us) service_pool.cc:224] Handling call
0709 13:01:59.963025 (+999498us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b54000cba54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:01:59.963173 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210062592}
I20260709 13:01:59.946967  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:01:59.948750 10070 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:01:59.965519  8466 raft_consensus.cc:1240] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.970175  8393 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:01:59.959899  9878 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:01:59.973014  8466 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:59.974586  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.960543 10123 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:01:59.976624 10164 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:59.981564 10137 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:01:59.985466  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.970290 10151 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.014062  9878 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.020730  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 736) took 1424 ms. Trace:
I20260709 13:02:00.021126  8390 rpcz_store.cc:276] 0709 13:01:58.596377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.598972 (+  2595us) service_pool.cc:224] Handling call
0709 13:02:00.020566 (+1421594us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001a1dd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:00.020679 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257055616}
W20260709 13:02:00.007695 10172 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:00.018472  8463 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:00.006978 10151 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.034447 10181 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.035034 10181 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:00.038964  8540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 805) took 1567 ms (client timeout 1574 ms). Trace:
W20260709 13:02:00.039422  8540 rpcz_store.cc:269] 0709 13:01:58.471604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.475027 (+  3423us) service_pool.cc:224] Handling call
0709 13:01:59.495880 (+1020853us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:02:00.038757 (+542877us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000fb254. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:00.038902 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457159296}
I20260709 13:02:00.043200 10151 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.030112  9961 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.035768 10164 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:00.038062 10171 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:00.052134 10144 log.cc:927] Time spent T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.707s	user 0.003s	sys 0.000s
I20260709 13:02:00.058264  8392 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:00.058655  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.054160  9961 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.062579  8392 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.074364 10156 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:00.045416 10123 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.076838  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:00.077318 10123 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.083531  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.088374  8392 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:00.088730  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 696) took 1223 ms. Trace:
I20260709 13:02:00.095602  8537 rpcz_store.cc:276] 0709 13:01:58.865289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.865890 (+   601us) service_pool.cc:224] Handling call
0709 13:02:00.088510 (+1222620us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400041ad4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:00.088656 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224654208}
I20260709 13:02:00.097087  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:00.098625 10156 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.060822 10164 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:00.102753  8390 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:00.109496  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 709) took 1207 ms. Trace:
I20260709 13:02:00.109849  8541 rpcz_store.cc:276] 0709 13:01:58.902197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.923220 (+ 21023us) service_pool.cc:224] Handling call
0709 13:02:00.109328 (+1186108us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b5400161054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:00.109442 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729546624}
I20260709 13:02:00.111388 10181 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.112452  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.112372  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.113799  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.114974  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.115648  8388 raft_consensus.cc:2393] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 2: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:00.116329  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.122746  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:00.061378 10171 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:00.125968  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 734470us
W20260709 13:02:00.126717  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.127784  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 839) took 1194 ms. Trace:
I20260709 13:02:00.128165 10164 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:00.129009  9749 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:00.129282  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 848) took 1193 ms. Trace:
I20260709 13:02:00.129698  8462 rpcz_store.cc:276] 0709 13:01:58.935632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.151183 (+215551us) service_pool.cc:224] Handling call
0709 13:01:59.151595 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.196035 (+ 44440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.197015 (+   980us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.197492 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.453087 (+255595us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:59.466714 (+ 13627us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.128997 (+662283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.129067 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.129105 (+    38us) raft_consensus.cc:1685] finished
0709 13:02:00.129119 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.129228 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":778824,"prepare.queue_time_us":17651,"prepare.run_cpu_time_us":226,"prepare.run_wall_time_us":1016,"raft.queue_time_us":42669,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":13323,"thread_start_us":170264,"threads_started":1,"wal-append.queue_time_us":391908}
I20260709 13:02:00.132277 10125 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:00.133296 10125 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:00.125610  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.134986  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.139665  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.140961  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.128108  8468 rpcz_store.cc:276] 0709 13:01:58.933096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.117328 (+184232us) service_pool.cc:224] Handling call
0709 13:01:59.117623 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.143934 (+ 26311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.143977 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.144530 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.217592 (+ 73062us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:59.440590 (+222998us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.127506 (+686916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.127570 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.127612 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:00.127622 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.127729 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":724574,"prepare.queue_time_us":131881,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":712908,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":7169,"thread_start_us":179556,"threads_started":2,"wal-append.queue_time_us":139991}
I20260709 13:02:00.142884  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.142889  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.144788  8544 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:00.145210  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.142926  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 836) took 1210 ms. Trace:
I20260709 13:02:00.145893  8537 raft_consensus.cc:2368] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3.
I20260709 13:02:00.146432  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.146806  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.145825  8464 rpcz_store.cc:276] 0709 13:01:58.932200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.117152 (+184952us) service_pool.cc:224] Handling call
0709 13:01:59.117527 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:59.117912 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.117939 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:59.118511 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 13:01:59.161843 (+ 43332us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:59.276662 (+114819us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.051466 (+774804us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:00.125080 (+ 73614us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b1800377f80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe10374c0a 00007fbe19ab4219 00007fbe103fca40 00007fbe103f74e4 00007fbe103f7455 00007fbe134df060 00007fbe134f1716 00007fbe13502287 00007fbe13502208
0709 13:02:00.125305 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.125373 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.142734 (+ 17361us) raft_consensus.cc:1685] finished
0709 13:02:00.142754 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.142873 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47723,"prepare.queue_time_us":138198,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":855568,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":188,"spinlock_wait_cycles":26709248,"thread_start_us":107780,"threads_started":2,"wal-append.queue_time_us":164900}
I20260709 13:02:00.147591  8540 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:00.141984 10164 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.156476  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:00.159312  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 75900.7us
I20260709 13:02:00.159932  8464 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:00.160247  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.162158  8467 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:02:00.161931  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.158553 10078 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.166326 10078 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.166605  9033 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:00.166728  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.158680  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.167481  8542 raft_consensus.cc:2368] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:02:00.168723  9550 consensus_queue.cc:1059] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:00.142263 10125 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:00.169415 10183 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.170138  9550 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:00.169994 10186 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:00.170599 10008 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:00.171293 10125 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:00.171972  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.172755 10171 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:00.174954 10005 raft_consensus.cc:3055] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:00.177352  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.179492  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.181697  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.197587  8537 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:00.183514  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.190255  8538 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:02:00.192126  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:00.207135  8542 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.208597  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.209980  8540 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.178925 10034 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:00.163362  9789 raft_consensus.cc:2764] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:00.162686  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:00.180516  9550 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:00.195976 10072 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.194478 10151 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.195873 10005 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:00.162463 10164 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.210119  8536 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:00.246009  8540 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:00.233558  8535 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:00.257912  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 96239.9us
I20260709 13:02:00.235235  9878 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.254469  9064 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:00.265345  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.243382 10072 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:00.272682  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.235349 10151 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.241990 10159 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:00.284085  8468 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.285243  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.287186  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.287844  8465 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:00.289155  8468 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.290582  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:00.291184  8538 raft_consensus.cc:606] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:00.291515  8538 raft_consensus.cc:614] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:00.268573  9789 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:00.298938  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.312184  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.314213  8465 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:00.317174  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.319051  8465 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:02:00.295222  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:00.332085  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.310958  9789 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.268755  9878 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.288995 10125 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:02:00.261806  9550 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.320644 10194 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.344347  9550 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.350078 10194 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.352586 10194 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.340197  9789 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.341917 10072 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.361946 10164 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.364073  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.365399  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.368296  8462 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.369818  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.372094  8466 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:00.337673  8465 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.274848 10005 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:00.387514 10166 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.506s	user 0.000s	sys 0.003s
I20260709 13:02:00.454797  8468 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:00.457638  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1095) took 1309 ms. Trace:
I20260709 13:02:00.458182  8394 rpcz_store.cc:276] 0709 13:01:59.148598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.205611 (+ 57013us) service_pool.cc:224] Handling call
0709 13:02:00.411843 (+1206232us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54003c8054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:00.457580 (+ 45737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433847168}
I20260709 13:02:00.465410  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 826) took 1613 ms. Trace:
I20260709 13:02:00.466018  8470 rpcz_store.cc:276] 0709 13:01:58.852062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.852188 (+   126us) service_pool.cc:224] Handling call
0709 13:01:59.920352 (+1068164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.921184 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.465092 (+543908us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003cffd0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:00.465313 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2455774464}
I20260709 13:02:00.479979  8470 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.480123  8462 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:00.481313  8468 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:02:00.486477  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.491324  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.459760 10181 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.495641  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1084) took 1984 ms. Trace:
I20260709 13:02:00.496111  8386 rpcz_store.cc:276] 0709 13:01:58.511266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.800980 (+289714us) service_pool.cc:224] Handling call
0709 13:02:00.023288 (+1222308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.036566 (+ 13278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.038222 (+  1656us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.041554 (+  3332us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:00.042486 (+   932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.042572 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.495425 (+452853us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001a1dd0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:00.495571 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729347840}
I20260709 13:02:00.497248  8289 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 2 to 3, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 3 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.499694  8289 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.495119 10181 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:00.513927  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.522693  8470 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:00.410120 10034 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:02:00.530551  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 236535us
I20260709 13:02:00.457314  9775 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.520455 10005 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.537436  8465 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:00.519857 10181 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.504477 10156 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:00.461974  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 60965.5us
W20260709 13:02:00.542479  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.553305  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.539919  9775 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.532730  9789 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.569327  8464 raft_consensus.cc:1240] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:00.575266  8461 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:00.580124  8539 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:00.594538  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.595065  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:00.596536 10060 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:00.596951 10060 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:00.597779 10060 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.600929  9775 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.601878 10060 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:00.604737  8393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1094) took 1456 ms (client timeout 1882 ms). Trace:
W20260709 13:02:00.605149  8393 rpcz_store.cc:269] 0709 13:01:59.148304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.195601 (+ 47297us) service_pool.cc:224] Handling call
0709 13:01:59.879898 (+684297us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:02:00.604516 (+724618us) spinlock_profiling.cc:243] Waited 89 ms on lock 0x7b5400248954. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:00.604668 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209612544}
I20260709 13:02:00.595374  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 713) took 1642 ms. Trace:
I20260709 13:02:00.606528  9775 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.606765  8539 rpcz_store.cc:276] 0709 13:01:58.953143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.121438 (+168295us) service_pool.cc:224] Handling call
0709 13:01:59.121751 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.581700 (+1459949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.590749 (+  9049us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002c97d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:00.593228 (+  2479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3335408000}
I20260709 13:02:00.607141  9775 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.607898 10078 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.609460  9775 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.609988 10119 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:00.612651 10119 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.613039 10119 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.615691  9789 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.617329 10046 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:00.617623 10063 raft_consensus.cc:1064] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:00.611626  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:00.618803  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:00.619360  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.620592  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:00.621181  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.621248  8387 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:00.621999  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.622603  8541 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:00.623831  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.624010  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.624342  8387 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.624557  8393 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.624986  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.625535  8391 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.627355 10151 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.628237  8536 raft_consensus.cc:1240] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:00.629365  9961 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:00.630311  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.630873  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.633395  8508 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:00.635931  8393 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:00.637956  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.639082  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.639325  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.639793  8470 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:00.639828  8468 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:02:00.640684  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.642634  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.642918  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.643499  8467 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:00.644218  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.645124  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.645743  8467 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:00.646884  8470 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:00.648417  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.649765  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:00.650470  8393 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:00.582763 10034 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.651724  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:00.647908  8539 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.655676  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.656328  8395 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.656963  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.651942  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.659466  8393 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.659521  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.662480  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:00.664090  8388 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:00.653340  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.664975  8465 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:02:00.667907  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.730649  8465 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:00.803817  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.804348  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.685271  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:00.801082 10171 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.799638  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.809109  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.650915 10207 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.671943 10059 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.673110  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:00.685959 10193 log.cc:927] Time spent T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:02:00.769663  8393 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:00.797528  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.820218  8470 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
W20260709 13:02:00.672792 10192 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:02:00.807237  8387 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:00.826951  8387 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:00.807842  8395 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:00.808202  8391 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:00.809832  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:00.817088  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:00.796681  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 144994us
I20260709 13:02:00.829468  8395 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.820209 10171 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.832149 10171 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.810211  9789 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.825850 10207 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:00.835366 10207 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.677023 10148 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.805454  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:00.822642  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.846268  8465 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:00.821060  8393 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:00.841423  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.847724  8467 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:00.848057  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.669915 10070 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.821460  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.851205  8470 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:00.852034  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:00.852782  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.853271  8470 raft_consensus.cc:2393] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:00.829897  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:00.669343  9878 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:00.849761  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 44375.9us
I20260709 13:02:00.855199  8508 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.850026  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.855926  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.856511  8467 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:00.857132  8392 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.665987 10156 consensus_queue.cc:1059] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.174s
I20260709 13:02:00.853935  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.863778  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.854907  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.857810  8508 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.858031  8467 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:00.732286 10119 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.867226  8470 raft_consensus.cc:2410] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:00.869385  8467 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:00.871330  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.874238  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.876494  8467 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:00.876453  8508 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.878082  8392 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:00.870218 10081 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.876693 10027 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.862505  9789 raft_consensus.cc:2764] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:02:00.872208 10060 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:02:00.876799  9976 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.877904  9813 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:00.862689 10059 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:00.882462 10206 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:02:00.866464  9550 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.886138  8470 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.887233 10119 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:00.887811 10207 consensus_queue.cc:1059] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:00.889180  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1115) took 1308 ms. Trace:
I20260709 13:02:00.890071  8465 raft_consensus.cc:2393] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:00.889564  8469 rpcz_store.cc:276] 0709 13:01:59.580475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.967608 (+387133us) service_pool.cc:224] Handling call
0709 13:02:00.002253 (+ 34645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.157972 (+155719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.158009 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.158456 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.313334 (+154878us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:00.313371 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.313437 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.888994 (+575557us) raft_consensus.cc:1685] finished
0709 13:02:00.889014 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.889126 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151528,"raft.queue_time_us":155953,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":18584,"spinlock_wait_cycles":1174400,"thread_start_us":146963,"threads_started":1,"wal-append.queue_time_us":233434}
I20260709 13:02:00.891680  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 819) took 1326 ms. Trace:
I20260709 13:02:00.891995 10171 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.892529 10070 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:00.895169  8467 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.892074  8543 rpcz_store.cc:276] 0709 13:01:59.565437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.567361 (+  1924us) service_pool.cc:224] Handling call
0709 13:01:59.567695 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.864363 (+296668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.891438 (+1027075us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54000fcb54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:00.891602 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680210176}
I20260709 13:02:00.892697 10171 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.898768  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.900030  8508 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.903492  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.904803  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.907618  9550 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:00.907823  9813 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.908376  9976 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:00.909477  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50744 (request call id 157) took 7435 ms. Trace:
I20260709 13:02:00.909881  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:00.875685 10034 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.908638  9550 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.927516 10043 consensus_queue.cc:1059] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:00.931587 10181 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:00.932443  8358 leader_election.cc:400] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:02:00.932583 10181 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:00.932852  8358 leader_election.cc:403] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:00.933152 10181 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:00.934682 10181 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.927371 10171 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.936057 10181 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.909909  8290 rpcz_store.cc:276] 0709 13:01:53.474564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.474750 (+   186us) service_pool.cc:224] Handling call
0709 13:01:53.650865 (+176115us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001608d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13451090 00007fbe134eff3a 00007fbe192a61cc 00007fbe193a437e 00007fbe178652a4 00007fbe17865232 00007fbe17865161 00007fbe178650dc 00007fbe17864392 00007fbe1182248c 00007fbe118218c6
0709 13:02:00.909405 (+7258540us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:55.425374 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:55.426023 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:55.426060 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:01:55.426082 (+    22us) tablet.cc:662] Decoding operations
0709 13:01:55.464590 (+ 38508us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:55.464674 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:55.464702 (+    28us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:01:55.571497 (+106795us) tablet.cc:701] Row locks acquired
0709 13:01:55.571517 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:55.571654 (+   137us) write_op.cc:270] Start()
0709 13:01:55.571771 (+   117us) write_op.cc:276] Timestamp: P: 1783602115571609 usec, L: 0
0709 13:01:55.571793 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:55.640938 (+ 69145us) log.cc:844] Serialized 8234 byte log entry
0709 13:01:57.174269 (+1533331us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:01:57.686927 (+512658us) op_driver.cc:464] REPLICATION: finished
0709 13:01:57.748495 (+ 61568us) write_op.cc:301] APPLY: starting
0709 13:01:57.754068 (+  5573us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:57.853114 (+ 99046us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:57.853138 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:57.982960 (+129822us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:57.983237 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:01:57.983284 (+    47us) write_op.cc:312] APPLY: finished
0709 13:01:57.983647 (+   363us) log.cc:844] Serialized 144 byte log entry
0709 13:01:57.983829 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.984008 (+   179us) write_op.cc:454] Released schema lock
0709 13:01:57.984063 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:57.984425 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.984454 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77825,"reported_tablets":46,"spinlock_wait_cycles":260663552,"child_traces":[["op",{"apply.queue_time_us":54032,"apply.run_cpu_time_us":4768,"apply.run_wall_time_us":237251,"num_ops":21,"prepare.queue_time_us":203674,"prepare.run_cpu_time_us":15918,"prepare.run_wall_time_us":564384,"raft.queue_time_us":56439,"raft.run_cpu_time_us":16232,"raft.run_wall_time_us":57465,"replication_time_us":2105489,"spinlock_wait_cycles":9694976,"thread_start_us":426139,"threads_started":4,"wal-append.queue_time_us":357939,"wal-append.run_cpu_time_us":35146,"wal-append.run_wall_time_us":2973706}]]}
I20260709 13:02:00.913690 10207 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:00.939661 10207 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:00.940811 10207 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.914427  8390 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:00.899603  9775 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:00.943210  9775 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.916239 10060 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:00.946043 10060 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.946492 10060 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.901553 10081 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:00.952297  8358 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:00.920397 10059 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.921265  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:00.923776  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.953850  8388 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:00.924443  9952 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.924585 10119 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:00.924868  9813 raft_consensus.cc:2764] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:02:00.926321  8508 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.958710 10156 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:00.959911  8358 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:00.961083 10081 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:00.963112 10164 consensus_queue.cc:1059] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:00.963195 10022 consensus_queue.cc:1059] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:00.917109  9976 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.951836 10131 consensus_queue.cc:1059] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:00.960983 10171 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:00.961907 10151 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:00.968575  8508 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.969663 10151 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.969866  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:00.970106 10151 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.954664  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.970865  8543 raft_consensus.cc:2410] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:00.971700  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.958474 10034 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:00.968196  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.972875  8433 leader_election.cc:400] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
W20260709 13:02:00.975747  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.951485  9775 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:00.974148  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.978560  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.964248 10164 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:00.977178  8508 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:00.970201  8536 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:00.958249 10119 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.978787  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.993865 10119 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.990708  9550 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:00.975435  9813 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.975059 10059 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:02:00.995199 10034 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.961079 10156 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.996089 10156 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.970115 10070 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:00.978186  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.995127  9637 consensus_queue.cc:1059] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:02:00.974599  9976 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.997030 10070 raft_consensus.cc:697] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:00.997814  9637 raft_consensus.cc:3055] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:00.965667 10207 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.987197  8542 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:00.986003 10159 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:02:00.986287  8535 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:00.993170  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:00.994413 10213 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.115s	user 0.004s	sys 0.000s
I20260709 13:02:00.994653  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.985579 10000 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:02:00.989581  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.998252  9637 raft_consensus.cc:740] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:01.007264  8466 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:01.011626  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:01.023725  9878 raft_consensus.cc:3055] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:01.025367 10156 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.028131  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:00.979830  9399 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:01.030166  8464 raft_consensus.cc:2376] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5. Re-sending same reply.
I20260709 13:02:00.991389 10164 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:01.076012  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:01.032171  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:01.081668  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.034029  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:01.083060  8468 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.031229  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:00.987584  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 95) took 1834 ms. Trace:
I20260709 13:02:01.086838  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:01.087047  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:00.999711  9775 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.036504  9637 consensus_queue.cc:260] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.037917 10060 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.038641  9976 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:01.039316  8535 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:02:01.039870  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:01.042141  8461 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:01.098258  8461 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:01.046676  8541 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:01.017153  9550 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:01.053299  8470 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:01.058797 10039 raft_consensus.cc:3055] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:01.059298  8358 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.062436  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:01.071209  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.112017  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.097577  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:01.046299 10069 consensus_queue.cc:1059] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:01.103161  9399 raft_consensus.cc:697] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:01.002894 10070 consensus_queue.cc:237] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.035569  9878 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:01.139030  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:01.119470  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 60299.7us
I20260709 13:02:01.103951  8535 pending_rounds.cc:85] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 2
I20260709 13:02:01.116194  8541 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:01.087971 10194 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.182226  8468 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:01.183471  8540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6595c51b9ae043699167a92b109f328e"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:01.114895 10058 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.184937  8461 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.252540  8461 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.140815 10034 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:01.086347  8389 rpcz_store.cc:276] 0709 13:01:59.153207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.089747 (+936540us) service_pool.cc:224] Handling call
0709 13:02:00.102481 (+ 12734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.163004 (+ 60523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.168481 (+  5477us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.169010 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.260313 (+ 91303us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:00.264792 (+  4479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.630341 (+365549us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b18003c53e0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:00.987142 (+356801us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b540024b154. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:00.987223 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.987302 (+    79us) raft_consensus.cc:1685] finished
0709 13:02:00.987330 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.987508 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3901,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3924,"spinlock_wait_cycles":105971328,"thread_start_us":83563,"threads_started":1,"wal-append.queue_time_us":98599}
I20260709 13:02:01.262717 10156 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.138047 10022 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.176436 10148 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.110422 10039 raft_consensus.cc:740] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:01.244624  8535 pending_rounds.cc:107] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:01.184702 10140 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:01.197193  8463 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:01.201681  9637 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.205309  9961 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.105425  9775 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.124444  8433 leader_election.cc:400] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:01.287290  8433 leader_election.cc:403] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:01.138566  8537 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:01.261674 10034 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.243660  8393 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:01.200700  9399 consensus_queue.cc:237] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:01.200958  8277 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ef4deccb7c274fec97786db5d6131514 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c45599d1dc3b4823b857cf77f276dc7b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:01.256151 10060 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:01.256844  9778 consensus_queue.cc:1059] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:01.226512 10164 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:01.299278  8277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 98639us
I20260709 13:02:01.299717 10164 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.265234  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:01.291708  9950 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:01.266476 10058 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.262941  9966 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:01.304013  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:01.304278  9966 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:01.304612  8462 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.304793  9966 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:01.304939 10058 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:01.305750  9966 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.307696  9994 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:01.308115  9994 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:01.308910  9994 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.281263 10159 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:01.310009 10159 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:01.310132  9994 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:01.310870 10159 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.267303  8470 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:01.312005 10159 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:01.177429  9749 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.313462  9749 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.313951  8386 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:02:01.315640  9749 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:01.270100  8461 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:02:01.316229  8461 pending_rounds.cc:85] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:01.316496  8461 pending_rounds.cc:107] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:02:01.316731  8461 raft_consensus.cc:2889] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:01.239979 10171 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:01.320448 10171 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.244721 10123 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.245467  9550 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.241075  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:01.321866 10123 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:01.290259  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 166007us
I20260709 13:02:01.323104  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:01.323915 10123 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.324553 10123 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:01.324713  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.324940 10123 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:01.325316 10123 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.275271  8535 raft_consensus.cc:2889] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:01.279057  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.327634  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:01.309690 10218 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 13:02:01.328647  8390 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:01.328918  8388 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:02:01.329392 10194 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:01.329862 10219 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.330340 10219 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.331113 10140 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.332340  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:01.333182  9952 raft_consensus.cc:3055] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:01.333568  9952 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:01.333854  8433 leader_election.cc:400] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3.
I20260709 13:02:01.334153  8433 leader_election.cc:403] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:01.332456 10219 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.334805  9950 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3.
I20260709 13:02:01.334328 10039 consensus_queue.cc:260] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:01.336030  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.337841  8462 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:01.338016  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.343329  9813 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.272372 10022 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.345058  8462 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:01.348423  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.351692  8508 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:01.355595  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 240434us
I20260709 13:02:01.336062 10039 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.359714  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.357139  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:01.377766  8462 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:01.338789 10194 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:01.379456  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:01.379760  8507 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:01.380285  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:01.381424  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:01.383903  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.347869 10000 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.384449  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.373610  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.333197 10140 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:01.382169  9813 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:01.361330  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.376698 10081 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:01.337741 10119 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.297035 10034 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:01.449611 10205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.005s	sys 0.027s
I20260709 13:02:01.383237 10219 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.383395  9789 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.383742 10027 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:01.444952 10216 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:01.356873 10060 consensus_queue.cc:1059] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 13:02:01.334390  9952 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.389253 10140 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.440701  9813 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.440379  9950 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:01.457396 10205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.007s	sys 0.027s
I20260709 13:02:01.382933 10069 consensus_queue.cc:1059] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:02:01.467483  8540 raft_consensus.cc:606] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:01.509106  8540 raft_consensus.cc:614] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:01.512723 10181 consensus_meta.cc:287] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.005s
W20260709 13:02:01.516934  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 268747us
I20260709 13:02:01.462111 10118 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.440781 10000 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.486209 10140 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.487174  9813 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.459928 10194 consensus_queue.cc:1059] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:02:01.488462 10081 raft_consensus.cc:697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:01.525461  9952 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.464102 10219 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:01.578480  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 193045us
W20260709 13:02:01.566236 10151 consensus_meta.cc:287] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.002s
W20260709 13:02:01.581670  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 201975us
I20260709 13:02:01.575626  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:01.528429 10156 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:02:01.588056  8388 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:01.588893  8507 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:01.589654  9789 raft_consensus.cc:3055] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:02:01.589774 10232 log.cc:927] Time spent T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:01.593119 10219 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.594238  8386 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:01.599534 10171 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.525719 10181 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 13:02:01.603161  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.588863 10222 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:01.608007  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:01.614807  8393 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:01.628213  8507 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:01.627243  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51689.6us
I20260709 13:02:01.629431  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:01.598178 10027 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:01.649417  9032 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.605319  9775 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.663623  8390 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.670475  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:01.632959  9789 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:01.635995  9550 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:01.671645  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:01.672181  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:01.599181  9988 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:02:01.587913 10151 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:01.684340  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 56201.7us
I20260709 13:02:01.689204  8462 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:02:01.690054  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 163588us
I20260709 13:02:01.695039  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:01.695355  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:01.660213 10239 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.696101  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:01.699891  8462 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.689235  8388 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
W20260709 13:02:01.700574  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.662225  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:01.643009 10227 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:02:01.705754  8507 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:01.674976 10022 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:01.699270 10207 consensus_meta.cc:287] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.003s
I20260709 13:02:01.712018  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:01.691465 10159 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:01.692265 10242 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:01.778532  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 66617.9us
I20260709 13:02:01.751451  9789 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.688786  9550 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.658684 10219 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:01.699438  9775 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.777209  8462 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:01.661145 10081 consensus_queue.cc:237] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.780131  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:01.783277  8390 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:01.784433  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 759) took 1150 ms. Trace:
I20260709 13:02:01.793648  8394 rpcz_store.cc:276] 0709 13:02:00.634158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.634712 (+   554us) service_pool.cc:224] Handling call
0709 13:02:00.635002 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.642887 (+  7885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.642919 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.643346 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:02:01.032836 (+389490us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b18002a6fa0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:02:01.201506 (+168670us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:01.201548 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.204010 (+  2462us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.773055 (+569045us) raft_consensus.cc:1685] finished
0709 13:02:01.773084 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.784346 (+ 11262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7533,"raft.queue_time_us":13198,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9737,"spinlock_wait_cycles":12248320,"thread_start_us":168490,"threads_started":1,"wal-append.queue_time_us":724665}
I20260709 13:02:01.784464  8469 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:01.712683 10243 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.787421 10046 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:02:01.766582  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.787258  9550 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.801944 10069 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:01.802026 10241 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:02:01.793141  8536 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:02:01.808761  9961 consensus_meta.cc:287] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.006s
I20260709 13:02:01.809520  9961 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
W20260709 13:02:01.811631 10228 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:01.817402 10060 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:01.817941 10060 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:01.818939 10060 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:01.822424 10229 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 13:02:01.822476 10060 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:01.824085 10237 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:02:01.830935 10151 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.828773  9878 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.797966 10247 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.838678 10247 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.784188 10117 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:01.799535 10223 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260709 13:02:01.799801  9789 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.746589 10246 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:02:01.853633  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:01.838029  9878 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.867952  8462 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:01.798053  9775 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:01.789958 10159 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:01.850750 10046 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:02:01.885015 10245 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:01.884859 10118 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:01.890681  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 187053us
I20260709 13:02:01.891469  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:01.892918  9976 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:01.895476  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:01.887454 10148 consensus_meta.cc:287] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.001s
I20260709 13:02:01.900553 10258 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:01.893383  9976 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:01.886677  9966 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.885753 10245 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:01.956087  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.975191  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 69172.5us
W20260709 13:02:01.902105 10164 consensus_meta.cc:287] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 13:02:01.904247 10027 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:02.000650 10027 raft_consensus.cc:697] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:01.888237 10239 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:02:02.005584 10159 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:02.007519 10245 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:01.983629 10247 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:01.985777 10234 log.cc:927] Time spent T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:02:01.991528 10171 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:01.993023 10123 consensus_meta.cc:287] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.000s
W20260709 13:02:01.996289  9994 consensus_meta.cc:287] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.002s
I20260709 13:02:01.996028 10140 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.033440 10140 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.998097 10241 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:02.015292  8393 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:02.037163 10241 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:01.904047  9399 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 13:02:02.038697  9775 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:01.905941 10148 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.025480  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1153) took 1006 ms. Trace:
I20260709 13:02:01.974947  9976 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.029706 10123 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.001569 10027 consensus_queue.cc:237] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:02.034775 10248 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:02:02.035817  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:01.998072 10249 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:02:02.052536  8465 rpcz_store.cc:276] 0709 13:02:01.019213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.093720 (+ 74507us) service_pool.cc:224] Handling call
0709 13:02:01.101384 (+  7664us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:01.102506 (+  1122us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:01.349807 (+247301us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.000552 (+650745us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b1800394d80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe1308f4bc 00007fbe103dd48b 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a
0709 13:02:02.000730 (+   178us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:02.001325 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 13:02:02.001473 (+   148us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:02.001508 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.001574 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.013243 (+ 11669us) raft_consensus.cc:1685] finished
0709 13:02:02.025151 (+ 11908us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.025392 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6123,"prepare.queue_time_us":163229,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":8501,"raft.run_cpu_time_us":1679,"raft.run_wall_time_us":92390,"spinlock_wait_cycles":20948608,"thread_start_us":227944,"threads_started":2,"wal-append.queue_time_us":73496}
I20260709 13:02:02.042457 10171 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:02:02.066789  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 90897.4us
I20260709 13:02:02.058672  9813 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.071165 10241 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:02:02.077863  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 185141us
I20260709 13:02:02.051513 10046 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:02:02.055450 10140 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:02:02.012921  9550 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.084738  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.086391  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1160) took 1025 ms. Trace:
I20260709 13:02:02.086788  8470 rpcz_store.cc:276] 0709 13:02:01.061310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.312607 (+251297us) service_pool.cc:224] Handling call
0709 13:02:01.312942 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:01.636516 (+323574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.636563 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:01.646427 (+  9864us) log.cc:844] Serialized 26 byte log entry
0709 13:02:01.797366 (+150939us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:01.797412 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.015799 (+218387us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000a00d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:02.015867 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.086107 (+ 70240us) raft_consensus.cc:1685] finished
0709 13:02:02.086127 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.086327 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91698,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3509,"spinlock_wait_cycles":355121024,"thread_start_us":249170,"threads_started":2,"wal-append.queue_time_us":173385}
I20260709 13:02:02.103399  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:02.102988 10260 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:02.120589 10260 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.120965 10260 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.123978  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1155) took 1088 ms. Trace:
W20260709 13:02:02.124775  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.126605 10239 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:02.128919 10123 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.124432  8466 rpcz_store.cc:276] 0709 13:02:01.035688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.100338 (+ 64650us) service_pool.cc:224] Handling call
0709 13:02:01.100849 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:01.251079 (+150230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.251144 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:01.251691 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:02:01.387336 (+135645us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:01.446688 (+ 59352us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.633235 (+186547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.123572 (+490337us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000c9c54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:02.123621 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.123668 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:02.123766 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.123915 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69807,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":76081,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":22369,"spinlock_wait_cycles":344547840,"thread_start_us":285563,"threads_started":2,"wal-append.queue_time_us":196249}
I20260709 13:02:02.126063 10257 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:02:02.142095  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.134502 10258 consensus_queue.cc:1059] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:02.139806 10148 raft_consensus.cc:476] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:02.170183  9813 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.103904 10171 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.179087  9878 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:02.187044 10238 log.cc:927] Time spent T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.673s	user 0.004s	sys 0.000s
I20260709 13:02:02.187486  9878 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:02.195048  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 682972us
I20260709 13:02:02.182801 10171 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:02.197777  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.202869  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.203349  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.204039  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.204866 10148 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.205129  9550 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.206686  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.189671  9878 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.212267  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:02.220425  8359 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.221329 10148 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.221661  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 849) took 1242 ms. Trace:
I20260709 13:02:02.222213  8359 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.222925 10148 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.222329  8536 rpcz_store.cc:276] 0709 13:02:00.979594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.992900 (+ 13306us) service_pool.cc:224] Handling call
0709 13:02:02.221399 (+1228499us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400087fd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:02.221573 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763379584}
I20260709 13:02:02.223834  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.224615 10148 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.224709  9923 raft_consensus.cc:3055] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.225133  9923 raft_consensus.cc:740] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:02.226119 10148 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:02.226012  9923 consensus_queue.cc:260] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.240262 10000 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:02.244881  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.247025  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.248148  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.245918  9878 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:02.213151 10171 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:02.244722 10063 consensus_queue.cc:237] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:02.249698  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.249047 10148 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.254426  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:02.241317 10260 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.251467  9878 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.255806  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:02.253831 10266 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:02:02.256747 10164 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:02.260005  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.260236 10164 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.260607 10164 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.260809  9775 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:02.262125  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.262850  9775 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.263113 10260 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.263868 10148 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:02.271474  9775 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:02.273284  8359 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.275174  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:02.275815 10148 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.276557 10148 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:02.278623  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.280033 10148 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.280725 10148 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:02.281513  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 840) took 1313 ms. Trace:
I20260709 13:02:02.281963  8539 rpcz_store.cc:276] 0709 13:02:00.968409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.970722 (+  2313us) service_pool.cc:224] Handling call
0709 13:02:02.281315 (+1310593us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54000b6dd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:02.281453 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190169728}
I20260709 13:02:02.283404 10148 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:02.285627 10148 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.287045 10260 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.287477  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.287596 10260 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.288446  8393 raft_consensus.cc:2410] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:02:02.288666 10231 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.775s	user 0.007s	sys 0.000s
I20260709 13:02:02.288946  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.290202  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:02.290570  8395 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:02.290791  8388 raft_consensus.cc:2376] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3. Re-sending same reply.
I20260709 13:02:02.289436  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:02.291954  8387 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:02.292855  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:02.293382  8386 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.290159  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1157) took 1249 ms. Trace:
W20260709 13:02:02.296268  9032 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.276003  9069 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:02.298655  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.299856  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:02.300436  8388 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.300964  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.301627  8395 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:02.302528  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:02.303274  8395 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:02.303164  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.294252  8464 rpcz_store.cc:276] 0709 13:02:01.040729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.228417 (+187688us) service_pool.cc:224] Handling call
0709 13:02:01.228787 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:01.229114 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.229142 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:01.234015 (+  4873us) log.cc:844] Serialized 26 byte log entry
0709 13:02:01.458347 (+224332us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:01.458431 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.458597 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.288085 (+829488us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:02.289880 (+  1795us) raft_consensus.cc:1685] finished
0709 13:02:02.289902 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.290103 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8959,"spinlock_wait_cycles":7345024,"thread_start_us":178011,"threads_started":1,"wal-append.queue_time_us":245135}
I20260709 13:02:02.320050  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.321295  8540 raft_consensus.cc:2393] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:02.322626  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.321677  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:02.322012  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.325675  8541 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:02.255271 10171 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.328979  8538 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:02.337653  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:02.338475  8540 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:02.334120  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.257836  9878 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.343245  8388 raft_consensus.cc:2410] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:02.344486  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.276595  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:02.314647  9550 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.349377  9550 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.351727  9550 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.353061  8541 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:02.336731 10181 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:02:02.346921  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.347502  9778 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:02.326653 10027 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.342429 10260 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.360528  8386 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:02.362401  8358 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.366983  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:02.354136 10159 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.376411  8358 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.360186 10058 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.364800  8539 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:02.361126 10164 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.372700  9775 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.384445 10247 raft_consensus.cc:2764] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:02:02.385214  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.392760  9976 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.395144  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:02.365692 10027 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.402940 10027 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.387506 10148 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:02.404085 10148 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:02.404484 10148 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:02.404857 10148 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.393587 10187 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.406427  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:02.406373 10187 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:02.383811 10058 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.409426 10058 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.411113  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:02.418520  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.418884  8394 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:02.420462  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.422142  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.422325  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:02.422959  8466 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.424840  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.424767  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.426605  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.387224 10043 raft_consensus.cc:3055] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:02.430485  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:02.432624  8464 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:02.433547  8537 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.380930 10159 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.441108  8466 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:02.442945 10280 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:02.447314  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:02.448050  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 62962.6us
I20260709 13:02:02.449499  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.450203  8386 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
I20260709 13:02:02.449234  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.412724  9775 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:02.454095 10277 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.125s	user 0.000s	sys 0.004s
I20260709 13:02:02.433153 10043 raft_consensus.cc:740] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:02.429286 10027 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.451299 10280 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:02.460712  8539 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.468065  8537 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:02.468257  8536 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:02.460559 10187 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.459929  9775 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.469213 10043 consensus_queue.cc:260] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:02.495599  9976 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.497545 10159 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.474889  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:02.475261  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:02.473845  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:02.479820  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.473426 10280 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.492411  9775 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.464010 10282 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.501111  8537 raft_consensus.cc:2368] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:02.513661  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:02.514734  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.515645  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.509936  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:02.521750  8537 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:02:02.522941  8433 leader_election.cc:400] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:02.523336  8433 leader_election.cc:403] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.510921  9976 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:02.525861  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.526068  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.527077  8464 raft_consensus.cc:2368] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
I20260709 13:02:02.527115  8470 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:02:02.528512  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.510828 10285 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:02.518409 10027 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:02.519795  9775 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:02.532456  8470 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
W20260709 13:02:02.533907  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 157584us
I20260709 13:02:02.526752  9789 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:02.567034  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.568364  8359 leader_election.cc:400] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 3. Current term is 4.
W20260709 13:02:02.643714  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 75510us
I20260709 13:02:02.521083  9813 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:02.631835  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 95081.1us
I20260709 13:02:02.532203  9976 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:02.645264  9813 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.645913  9976 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.532404 10171 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:02.566744 10164 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.544215 10027 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:02.655752 10279 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:02:02.655475 10171 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.657430 10027 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.643002  8470 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:02.534072 10140 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:02.659453 10140 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.663580 10241 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:02.664191 10241 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.636197  9775 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:02.642009  8358 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:02.679544 10235 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 1.043s	user 0.001s	sys 0.006s
I20260709 13:02:02.648151  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:02.686439  8463 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:02.648761 10217 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 1.402s	user 0.000s	sys 0.009s
I20260709 13:02:02.694068 10171 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.696143 10148 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.699270 10148 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.703415  9064 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:02.684962  9878 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:02.706343  9878 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.707295  8390 raft_consensus.cc:1240] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:02.702191  9749 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:02.712622  9749 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.715106  8541 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:02.714996  8537 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:02.715557  8541 pending_rounds.cc:85] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 2
I20260709 13:02:02.715859  8541 pending_rounds.cc:107] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:02.716076  8541 raft_consensus.cc:2889] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:02.716437  9961 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.716599  9749 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.702593 10241 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.691836 10219 consensus_queue.cc:1059] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:02.718676  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 76807.3us
I20260709 13:02:02.722198  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.727560  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:02.728716  8358 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.721612  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:02.730124  8388 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.724484  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:02.716970  9961 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.649300  9813 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.744766 10148 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:02.749974 10148 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:02.750730  9033 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:02.751067 10148 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.752828  8388 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:02.753320 10187 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:02.753844 10187 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.754200 10187 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.755654  8536 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:02.718544  9789 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.757917  9789 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:02.760767  9789 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.745222 10280 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.673636 10034 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.669432  9775 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.775245  8463 raft_consensus.cc:2410] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:02.729578  9878 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:02.785599  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.785761  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 55931.6us
W20260709 13:02:02.786975  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.779996  9988 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:02.800280  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.805223  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.806226  8388 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:02.809180  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.809862  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:02.810770  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.810552  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.811622  8388 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:02:02.813589  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.814407  8388 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:02:02.817934  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.790032 10280 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:02.828104  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.789742 10164 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.835307  8538 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:02.827077 10034 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:02.820266  9988 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.860735 10140 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.855667 10119 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:02.849857 10164 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.866993  9961 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:02.863755 10034 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:02.879246 10285 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:02.902282 10285 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:02.928630  8277 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ef4deccb7c274fec97786db5d6131514 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c45599d1dc3b4823b857cf77f276dc7b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:02.941526  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 29) took 8501 ms. Trace:
I20260709 13:02:02.786975  8358 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:02.949824  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 162866us
I20260709 13:02:02.951902  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:02.947705  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 303118us
I20260709 13:02:02.947872  8289 rpcz_store.cc:276] 0709 13:01:54.439902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.442679 (+  2777us) service_pool.cc:224] Handling call
0709 13:02:02.941231 (+8498552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:00.617933 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:00.731168 (+113235us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:00.731204 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:00.731221 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:00.732778 (+  1557us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:00.732875 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:00.732917 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:00.733239 (+   322us) tablet.cc:701] Row locks acquired
0709 13:02:00.733258 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:00.733454 (+   196us) write_op.cc:270] Start()
0709 13:02:00.733597 (+   143us) write_op.cc:276] Timestamp: P: 1783602120733398 usec, L: 0
0709 13:02:00.733625 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:02:00.740265 (+  6640us) log.cc:844] Serialized 974 byte log entry
0709 13:02:01.065446 (+325181us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe103dd0ac 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b
0709 13:02:01.863757 (+798311us) op_driver.cc:464] REPLICATION: finished
0709 13:02:02.068633 (+204876us) write_op.cc:301] APPLY: starting
0709 13:02:02.073480 (+  4847us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:02.073662 (+   182us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:02.073695 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:02.089275 (+ 15580us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:02.104061 (+ 14786us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:02:02.108091 (+  4030us) write_op.cc:312] APPLY: finished
0709 13:02:02.119266 (+ 11175us) log.cc:844] Serialized 28 byte log entry
0709 13:02:02.140472 (+ 21206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:02.144013 (+  3541us) write_op.cc:454] Released schema lock
0709 13:02:02.144505 (+   492us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:02.176202 (+ 31697us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:02.178801 (+  2599us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2067116,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":193968,"apply.run_cpu_time_us":3064,"apply.run_wall_time_us":111931,"num_ops":2,"prepare.queue_time_us":91972,"prepare.run_cpu_time_us":38623,"prepare.run_wall_time_us":903624,"raft.queue_time_us":39701,"raft.run_cpu_time_us":91637,"raft.run_wall_time_us":118505,"replication_time_us":1129807,"spinlock_wait_cycles":78112128,"thread_start_us":975057,"threads_started":4,"wal-append.queue_time_us":814109}]]}
I20260709 13:02:02.954589  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:02.959363  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:02.968104  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.969333  8461 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:02.971055  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.975121  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.975428  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.976955  8468 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:02.977118  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:02.978566  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:02.980880  8470 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:02.961041  8392 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:02.985633  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:02.991989  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 128692us
I20260709 13:02:02.993088  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:02.972090  8461 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:02.994293  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.994467  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:02.993090  8539 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:03.005180  9813 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.005631  9923 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:03.007728  9950 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.020601 10140 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.021821 10140 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.024928  9813 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.026012 10140 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.026270  8463 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:03.020817  8542 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:03.018348  9988 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:03.082376  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:03.062170  9789 raft_consensus.cc:476] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:03.087342  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:03.095844  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:03.101977 10181 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:03.108311  8468 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:03.109383 10305 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:03.109575 10298 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.110625 10297 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.110744 10298 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.111910 10297 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.122596 10313 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:03.123799 10313 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:03.114089 10295 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.135972 10123 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.136824 10123 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.138008 10241 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.138914 10241 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.139436 10123 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.143143  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:03.143688  9399 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.144517  9399 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.145844 10194 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.146389 10261 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.146929 10261 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.146596 10194 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.147370 10261 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.149094 10194 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.149997 10311 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.150935 10119 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.150766 10311 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:03.151577 10119 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.154431 10164 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.114797 10140 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.155597 10140 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.107735 10181 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.158625 10181 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.159289 10043 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:03.163049  8468 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:03.163434  8467 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:03.164692  8468 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:03.114400  9789 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:02:03.167362  8463 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:03.168330 10220 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 1.658s	user 0.011s	sys 0.000s
I20260709 13:02:03.137172 10313 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:03.166816 10295 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.180827 10298 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.181350 10140 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.182562 10297 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.141680 10241 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.183465 10311 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:03.186610  8544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 847) took 2209 ms (client timeout 2368 ms). Trace:
W20260709 13:02:03.187098  8544 rpcz_store.cc:269] 0709 13:02:00.977482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.977620 (+   138us) service_pool.cc:224] Handling call
0709 13:02:03.186203 (+2208583us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54000f37d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:03.186414 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3817571072}
I20260709 13:02:03.187997 10296 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.188560 10119 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:03.189250  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:03.190282  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:03.191581 10295 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.192698 10034 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.147405 10259 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:02:03.195812  9813 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.197345  8535 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:02:03.229475  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 276467us
I20260709 13:02:03.228231  8467 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:02:03.147401  9399 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:03.180160 10123 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.247459  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 117949us
I20260709 13:02:03.126991  9950 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.248982  8463 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:02:03.249228  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.266199 10123 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:03.440563  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.458104  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.459030 10187 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:03.265565 10296 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:03.603065  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.604970  9813 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.605471  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 904) took 1075 ms. Trace:
I20260709 13:02:03.606383 10207 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:03.607300  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.609153  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:03.267985 10034 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:03.612540  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 220758us
I20260709 13:02:03.613015 10298 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:03.614494 10181 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.257241 10027 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:03.618068 10297 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:03.622644  9923 consensus_meta.cc:287] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.034s
W20260709 13:02:03.619684  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 360309us
I20260709 13:02:03.627975 10295 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.638641 10241 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.741899 10241 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.637167  8465 rpcz_store.cc:276] 0709 13:02:02.529901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.535316 (+  5415us) service_pool.cc:224] Handling call
0709 13:02:02.566345 (+ 31029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.842697 (+276352us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:02:02.842758 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.843324 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.185444 (+342120us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:03.185525 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.185619 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.605073 (+419454us) raft_consensus.cc:1685] finished
0709 13:02:03.605094 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.605273 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76680,"raft.queue_time_us":91601,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":528132,"threads_started":2,"wal-append.queue_time_us":412084}
I20260709 13:02:03.641155 10207 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:03.650274  9064 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:03.643491 10261 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.653339  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 868) took 1319 ms. Trace:
I20260709 13:02:03.654011 10151 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:03.658984 10148 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:03.662840  8462 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:03.669407 10027 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.669819 10297 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.670627 10063 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.671612 10159 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.671838 10296 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.756074 10297 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.756340 10261 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:03.757730  8507 leader_election.cc:336] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Timed out: RequestConsensusVote RPC to 127.7.28.193:35967 timed out after 1.511s (SENT)
I20260709 13:02:03.753122  9749 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:02:03.760540  9749 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:03.760737  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 902) took 1232 ms. Trace:
I20260709 13:02:03.761040  9749 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:03.761313  8464 rpcz_store.cc:276] 0709 13:02:02.528436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.528928 (+   492us) service_pool.cc:224] Handling call
0709 13:02:02.529197 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.800396 (+271199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.800439 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.819707 (+ 19268us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.177013 (+357306us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:03.194085 (+ 17072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.233501 (+ 39416us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.758646 (+525145us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5400296e20. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe1345cdbe 00007fbe13467930 00007fbe134678d8 00007fbe13467858 00007fbe13467813 00007fbe13466a9c 00007fbe19352626 00007fbe1934cdd8 00007fbe134a37cb 00007fbe134a62c0
0709 13:02:03.760287 (+  1641us) raft_consensus.cc:1685] finished
0709 13:02:03.760316 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.760570 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101820,"raft.queue_time_us":118498,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":1462,"spinlock_wait_cycles":52064640,"thread_start_us":260126,"threads_started":2,"wal-append.queue_time_us":257740}
I20260709 13:02:03.764887  8464 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:03.673286  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:03.675148  8463 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:03.745393 10295 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.766247  8467 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:03.676684  8538 raft_consensus.cc:606] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:03.767047  8538 raft_consensus.cc:614] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:03.666141 10140 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.768206 10295 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.767938 10063 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.767967 10140 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.770016  9399 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:03.771023 10140 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.770743 10063 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:03.692862 10315 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.692586  9789 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.714781 10259 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.718039  9923 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.703512 10298 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.712459  9950 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.705538 10034 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.716130  9813 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.745769  8535 rpcz_store.cc:276] 0709 13:02:02.334071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.335187 (+  1116us) service_pool.cc:224] Handling call
0709 13:02:02.862377 (+527190us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b58000b3d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:02:03.196826 (+334449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.234599 (+ 37773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.653088 (+418489us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b5400189cd0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:03.653261 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779453056}
I20260709 13:02:03.749706  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:03.771644  9399 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:03.773115 10320 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:03.685777  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:03.634691 10119 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.751067  8462 raft_consensus.cc:1275] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:02:03.786008  8507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.193:35967 timed out after 1.626s (SENT) [suppressed 12 similar messages]
I20260709 13:02:03.790338  9789 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.791157 10207 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:03.782262 10159 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:03.792865 10298 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.795547 10259 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:03.800486  8469 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:03.785567  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:03.787665 10123 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.805230  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:03.801573  9399 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:03.802136 10140 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.815778 10305 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:03.793635  9923 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.816483 10305 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.765937  9994 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:02:03.822692 10259 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:03.822119  9399 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.827108  8461 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:03.823033  8392 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
W20260709 13:02:03.832139  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 62413.9us
I20260709 13:02:03.835629 10181 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.815253 10123 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:02:03.838169 10119 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.847512  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:03.810305 10315 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.852824  8461 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.806988 10151 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:03.863972 10159 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:03.857980 10295 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:02:03.863979 10027 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.858731  8358 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:03.860515 10241 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.871903 10119 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:03.858291 10181 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.876915 10181 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:03.877081 10316 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.680s	user 0.004s	sys 0.001s
I20260709 13:02:03.878777  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:03.879356 10181 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.879469  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:03.879555  8394 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.880713  9065 raft_consensus.cc:2410] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:02:03.882834  9399 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:03.879546  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:03.884004  9069 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:03.886031 10207 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:03.886832  9032 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:03.887814 10183 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:03.888238 10183 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.888595 10183 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.874702 10140 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:03.877067  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:03.877297  9923 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:03.872289 10187 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.807220  9749 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.899377 10063 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:03.903205 10063 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.896739 10305 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.906036 10305 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:03.906761 10305 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.907389 10305 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.912925 10315 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.910100 10063 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:03.921763 10314 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
I20260709 13:02:03.923460  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 898) took 1398 ms. Trace:
I20260709 13:02:03.923861  8466 rpcz_store.cc:276] 0709 13:02:02.524595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.524714 (+   119us) service_pool.cc:224] Handling call
0709 13:02:02.525039 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.525359 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.525384 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.528960 (+  3576us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.984523 (+455563us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18003a0c00. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:02:03.131053 (+146530us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:03.173510 (+ 42457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.178608 (+  5098us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.923039 (+744431us) raft_consensus.cc:1685] finished
0709 13:02:03.923059 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.923276 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2179,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2920,"spinlock_wait_cycles":2402176,"thread_start_us":89543,"threads_started":1,"wal-append.queue_time_us":702375}
I20260709 13:02:03.926054 10207 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:03.927358 10207 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.930891  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:03.933348 10027 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:03.857435 10317 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.938843  8465 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:03.946862  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 164007us
I20260709 13:02:03.959403  8394 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
W20260709 13:02:03.956940  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 57945.5us
I20260709 13:02:03.929630 10151 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:03.909734 10305 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.954062  9789 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.965819  9813 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.968389 10140 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.978451 10305 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.978953  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:03.981441 10305 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.991876 10305 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:03.961261 10317 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:03.960772 10119 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:04.001474  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 70746.6us
I20260709 13:02:04.005602 10151 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:04.007185 10317 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.020856  9923 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:04.015887 10119 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:04.048451  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 189943us
W20260709 13:02:04.049386  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.051307  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.054128 10247 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.055251 10247 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.039048  9923 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.058115 10247 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.066373  9994 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.066634  9399 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:04.067162  9994 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.090698  8461 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:04.044719 10151 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.070204 10043 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.096295  9950 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:04.131634  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:04.118012  9399 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.143790  9033 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.146034  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.146339  9399 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.147936  9872 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:04.149051 10207 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:04.132262 10043 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.151206 10207 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.151638 10207 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.152076 10207 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.153498  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:04.154426 10317 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.155030 10317 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.155900 10034 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.156630 10034 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.157279 10317 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.157347 10034 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:04.158493 10327 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:02:04.161195  9749 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.162770 10119 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:04.163146  8288 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 2 to 3, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 3 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.164093  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:04.158589  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:04.168244  8358 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.172044  9399 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.177320  9994 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.178905 10151 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.165365  9950 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.165333 10305 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.135701  9923 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.183946  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1196) took 1214 ms. Trace:
I20260709 13:02:04.192461  9069 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:04.195029 10043 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.131373 10183 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:04.210739  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 76839.5us
I20260709 13:02:04.211887  8358 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:04.214095  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55632.5us
I20260709 13:02:04.215124  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:04.215499  9950 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.216270  9950 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:04.216781  9950 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:04.216895  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:04.217308  9950 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:04.217869 10317 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:04.218060 10151 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.218465 10317 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:04.218678 10151 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:04.218976 10317 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.219172 10151 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.221463  9778 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:04.213503  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.222308  9778 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:04.225376  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.198487 10034 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:04.228080  9923 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.228006  9813 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:04.228840  9923 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.208562 10305 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:04.232951  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 85733.2us
I20260709 13:02:04.205143  8470 rpcz_store.cc:276] 0709 13:02:02.969935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.623061 (+653126us) service_pool.cc:224] Handling call
0709 13:02:03.760302 (+137241us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b5800003698. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:02:03.760512 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.821999 (+ 61487us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:03.822362 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.855247 (+ 32885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.855327 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.855384 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.169773 (+314389us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b18001b72a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419
0709 13:02:04.183690 (+ 13917us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b540040d154. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:04.183738 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.183888 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":110,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":159,"spinlock_wait_cycles":153957376,"thread_start_us":32315,"threads_started":1,"wal-append.queue_time_us":180344}
I20260709 13:02:04.230125 10034 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.232637  9872 raft_consensus.cc:697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:04.250488  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.251101  9872 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:04.254833 10330 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.255604 10330 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.259052  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.233985 10148 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:04.264606  8508 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.271975 10317 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.276608 10317 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.276759  9994 consensus_queue.cc:1048] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:04.277552 10043 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.278031  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:04.278162 10043 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.278841  8391 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.280350 10043 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.283003 10159 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:04.276925 10342 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.284660 10342 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.284897  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.285626  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.286121  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.286378  8390 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:04.286623  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.286883  8389 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:04.287704  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.288494  8388 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:04.288563  8395 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:04.285657  8392 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:04.285099 10342 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.289865  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.290576  8394 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:04.290992  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.266008  9778 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.292601  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.293645 10247 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:04.294265 10282 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.288765  8538 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:04.295018 10282 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.295396  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.295053  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.294158  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.294090 10247 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:04.298130 10247 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.298133  8543 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:04.305222 10043 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.305285 10183 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.306008 10043 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.306771  8391 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:04.307369  9923 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:04.308039  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.310851 10342 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.321643  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:04.322276  8542 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:02:04.266661  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 121794us
I20260709 13:02:04.323300  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.323957  8465 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:04.324020  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.324990  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.325217  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.321414  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.326785  8468 raft_consensus.cc:2410] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:02:04.327620  8466 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:04.313099 10342 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.327637  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.328775  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.328927  8462 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:04.329077  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:04.329358  8463 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:04.329653  8464 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.330652  8288 catalog_manager.cc:5697] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.331420 10282 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.333459  9778 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.314599  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.334986  8543 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
I20260709 13:02:04.321375  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:04.335918  9778 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:04.336042  8539 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.341746  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:04.340570  8542 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:04.348412  8543 raft_consensus.cc:606] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.348956  8543 raft_consensus.cc:614] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:04.350365  8464 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:04.354426 10330 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.355247 10342 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.355865 10342 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.358556 10342 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.359510 10317 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:04.359643 10305 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.360538  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:04.360265 10317 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.361161  8543 raft_consensus.cc:606] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.361501  8543 raft_consensus.cc:614] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:04.341089  8288 catalog_manager.cc:5697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 4 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.364061  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:04.364579  8288 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 4 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.366333  9778 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.367199  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:04.368175 10317 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.369249  9778 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.376637 10247 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.379842  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.399942  8391 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:02:04.380972  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.401134  8394 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:04.382694  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.382891  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.402355  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.403014  8392 raft_consensus.cc:2393] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:04.347280 10148 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.383634  8288 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 2 to 3, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 3 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.404011  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.404790  8536 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:02:04.406157  8288 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 1 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:04.406806  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.407558  8388 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 1.
I20260709 13:02:04.407989  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.407896  8288 catalog_manager.cc:5697] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 2 to 3, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:04.383410  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.409685  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.410033  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.410749  8462 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:02:04.385005  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 171609us
I20260709 13:02:04.315965 10151 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.393556  9033 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.401003  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.392350  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:04.314934 10043 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.405508 10148 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.416285  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.431296  8541 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:04.421702  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.432403  8465 raft_consensus.cc:2410] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:04.422286  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.433017  8461 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:04.440548  8539 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:04.417748  8470 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.424515  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.443639  8542 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:04.425370  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.425872 10321 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:04.444766  8535 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:04.426614  8395 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:02:04.426117  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.430254  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.444861 10321 raft_consensus.cc:697] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:04.426085  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.450317  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.446811  8462 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:04.450070  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.451954  8394 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:02:04.451673  8392 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:04.457717 10247 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.459195 10321 consensus_queue.cc:237] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:04.421286  8288 catalog_manager.cc:5697] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 2 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.462859  8358 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.464133  8388 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
W20260709 13:02:04.469061  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.469367  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.471019  8462 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:04.471715  8466 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:04.473311  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.474275  8392 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:02:04.479844  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:04.480757  8462 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.489974  8358 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.491590  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.492439  8388 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:04.493467  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.494195  8542 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:04.495014 10282 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.477033  8536 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:04.482275 10207 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.502254  8544 raft_consensus.cc:2368] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7.
I20260709 13:02:04.490026 10330 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:04.503808 10330 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.509972  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.510823  8463 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:02:04.477227 10148 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:04.535038  8542 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:04.535473 10151 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.538012 10183 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:04.538607  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.539551  8536 raft_consensus.cc:2393] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:04.520057  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.540609  8391 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:02:04.541286  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.477274 10247 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.542164  8394 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:04.542557  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.543537 10207 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:04.526453  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.550145  8395 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:04.527271  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.551172 10207 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:04.552546 10034 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.554358  8461 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:04.555315 10034 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.556650  8461 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:04.559803 10345 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:04.530951  9950 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.565311  9950 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:04.532087  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.532785  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.483294  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.544267 10063 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.544778 10259 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.547443  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.566016  8466 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:04.542218 10247 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.531366  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.506706 10330 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.568830  8470 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:04.569890  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.582381  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.593041  8388 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:04.582377  8391 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:04.583573  8539 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:04.573395  8462 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:04.591457  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:04.595692  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49957.1us
I20260709 13:02:04.596418  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.598284  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.601042  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.601305  8389 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:04.601864  8393 raft_consensus.cc:2410] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:04.605469  8508 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.609613  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:04.610736  8541 raft_consensus.cc:2410] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:04.611280  8392 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:04.615842  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.616678  8461 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:04.618817  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:04.619146  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.619787  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.620136  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.620342  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.620901  9749 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:04.621232  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.621425  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.618928  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.622450 10207 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.622723  8508 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.623035 10207 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.623474 10207 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.623907  8468 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:04.624195  8470 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:04.622082  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:04.628465  8469 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:04.624439 10342 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:04.624933 10259 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:04.625005  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.631147  8468 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:02:04.587716 10063 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.627614  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:04.622063  8463 raft_consensus.cc:2393] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:04.617713  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:04.629617  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.623997  8508 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:04.622372  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.632009  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.621940  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.637055  8470 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
W20260709 13:02:04.633807  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 131397us
I20260709 13:02:04.631518  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:04.637699  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.638149  8466 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:04.635893  8461 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:04.642939  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.644296  8508 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.645598  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.647859  8468 raft_consensus.cc:2410] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:04.646919  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.649780 10159 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.650262  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:04.650372 10330 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.650487 10346 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.655711  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:04.651892  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.630699 10342 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.653101  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.636655 10063 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.630681  9950 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.630874 10259 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.641914  9923 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.646219 10261 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:04.634661  9749 consensus_queue.cc:1059] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:02:04.646520 10034 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.651234 10296 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:04.650274 10159 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.679526  8392 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:04.679942  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.680904  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.656041 10346 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.651197 10330 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.663026 10342 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.671051  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.675235 10259 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.677584 10261 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:04.693985  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.694123  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.697569  8542 raft_consensus.cc:2410] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:04.682037  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.697762  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.688053 10346 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.685190 10159 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.704520  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.711391  8391 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:04.711584  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.693411 10148 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.696198 10140 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.717157  8393 raft_consensus.cc:2410] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:04.716279  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.699710 10261 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.674696  9950 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.750551  8388 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:04.720124  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.698553 10296 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:04.698261 10151 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:04.711905 10317 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:04.758889  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.715005 10297 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.771708  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.772176  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.772996  8390 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:04.778978  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.762411 10317 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.794823  8388 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:04.775954 10119 raft_consensus.cc:3055] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:04.771592 10297 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.803121 10359 log.cc:927] Time spent T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:04.803399  8390 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:04.788877 10313 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:04.816874  8469 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:04.788177  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.825866  8389 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:04.827486  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.828445  8393 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:04.748283 10140 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:04.796866 10317 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:04.834930  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.782755 10151 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.836298  8388 raft_consensus.cc:2410] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:04.803781 10247 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.817524 10297 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.776571 10148 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:04.804032 10119 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:04.824095 10313 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.844988  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 181479us
I20260709 13:02:04.848623  8393 raft_consensus.cc:1275] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:04.850934  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.857537  8392 raft_consensus.cc:2410] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:02:04.868507  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 157956us
I20260709 13:02:04.837249 10140 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.867554  8508 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.869503  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.851792 10313 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.875758  8389 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:04.872453  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:04.858493 10043 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.882640  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.883281  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.886780  8386 raft_consensus.cc:2410] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:04.851372 10187 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:02:04.882675  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:04.882632 10364 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:02:04.836764 10296 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:04.908917  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.912545  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.913821  9399 consensus_queue.cc:1059] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:04.915263  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:04.885357 10043 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.887445  9923 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:04.919767  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:04.935168  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:04.936513  8389 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:04.939152  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:04.942137 10366 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:02:04.942430  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:04.943253  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:04.943580 10371 log.cc:927] Time spent T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:02:04.943913  8389 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:02:04.947021  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 74542.4us
I20260709 13:02:04.921464  9923 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.921707 10043 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.921825 10369 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:04.924517 10330 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.887641 10367 consensus_queue.cc:1059] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
W20260709 13:02:04.991200 10357 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.269s	user 0.000s	sys 0.008s
W20260709 13:02:05.002696  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 94088.3us
I20260709 13:02:05.001204  8386 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:04.999739  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.023114  8391 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:04.993435  9923 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.032536  8536 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:04.945845  9950 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:04.998939 10369 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:05.022554  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.040498  8389 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:05.036232  8388 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:05.032840  8391 pending_rounds.cc:85] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 2
I20260709 13:02:05.046015  9399 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:05.048208  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:05.048985  9399 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:05.049036  8508 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:05.050163 10367 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:05.050784 10367 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:05.051856 10367 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.057078  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.058404  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.059451  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.060491  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.068392 10384 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:02:05.071640  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.054622 10148 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.072229  8389 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.041765  8391 pending_rounds.cc:107] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:05.077674  8391 raft_consensus.cc:2889] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.945649 10119 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:05.049675  9399 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:05.029713 10387 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:05.110694  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.055302  9950 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:05.112083  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.115027  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:05.084757 10358 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:02:05.114166  9950 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.114522  8544 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:05.079022 10151 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.119127  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.128582  8391 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:05.125115  8392 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:05.135346  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.112229 10387 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.144207  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.145092  8391 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:05.082782 10370 consensus_queue.cc:1059] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:02:05.147008  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:05.146728  9399 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.155902  8389 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:05.147553 10387 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.158098  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.159301  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.160290  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.143630 10386 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:02:05.127663  9950 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:05.168643  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 220250us
I20260709 13:02:05.169827  8433 leader_election.cc:400] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7.
I20260709 13:02:05.170010  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.170147  8433 leader_election.cc:403] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:05.170370  9923 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.171887  8544 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:05.171880  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.173928  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.175005  8541 raft_consensus.cc:2393] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:05.176210  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:05.177347  9923 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:05.162846 10363 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:02:05.147099 10119 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.185599  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.187069 10313 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.188899  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:05.189970  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.194276  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.191892  8392 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:05.196642  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.197681  8391 raft_consensus.cc:2410] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:05.183561 10063 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.235163  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.205961 10370 raft_consensus.cc:3055] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:05.164634 10369 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.244287  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.252802 10313 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.240962 10399 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.260663 10261 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.261207  8541 raft_consensus.cc:2410] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:05.261953  8544 raft_consensus.cc:1240] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:05.280401  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 81259.4us
I20260709 13:02:05.288075  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.289172  8394 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:05.245278 10370 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:05.277805 10388 log.cc:927] Time spent T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:05.292557  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:05.290529  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.292569  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.302380  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:05.308208 10382 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:02:05.311375  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:05.293489 10342 consensus_meta.cc:287] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.013s
I20260709 13:02:05.316267  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:05.316704 10159 consensus_meta.cc:287] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.003s
I20260709 13:02:05.317178 10159 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.318074  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.318432  8537 raft_consensus.cc:2368] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5.
I20260709 13:02:05.318715  8391 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:05.319334 10159 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:05.321707  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.323189 10387 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.331302  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.336537  8395 raft_consensus.cc:1240] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:05.298942 10369 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.340374  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.307235 10313 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.349673  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:05.360122  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.363128  8393 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:05.361516  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:05.364728  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:05.357389 10207 consensus_meta.cc:287] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.733s	user 0.006s	sys 0.007s
I20260709 13:02:05.367164  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.346118 10313 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:05.379657  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:05.368713  8386 raft_consensus.cc:2376] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7. Re-sending same reply.
I20260709 13:02:05.381646  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.359181 10387 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.364481 10331 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:05.368585 10148 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.337502 10342 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:05.384025  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:05.353246 10247 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:02:05.386179 10406 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.387048  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.348861 10151 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:02:05.368010 10399 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7.
I20260709 13:02:05.378080 10330 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:05.376437 10313 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.373019 10207 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.365479 10297 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.389029 10063 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:05.400038  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.389223 10148 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.403128 10148 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.373739 10370 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.406178  8535 raft_consensus.cc:2393] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:05.408353 10368 raft_consensus.cc:3055] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:05.408476 10297 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.408937 10368 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:05.410228  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.409927 10368 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.410584  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.410862  8395 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:05.411103 10368 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.411757  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.412137 10207 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:05.412477  8395 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:05.413051  8536 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:05.413301  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.413672 10342 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:05.414781  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:05.415444  8536 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.415572  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:05.416198  9069 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEARNER]: Advancing to term 6
I20260709 13:02:05.387962 10140 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.419734 10140 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.419880  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:05.398949 10406 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.397891 10330 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.387838 10331 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.422483 10330 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.422609 10331 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:05.422852 10406 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.423399  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.424219  8544 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:05.425050 10402 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:05.425220  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:05.425480 10402 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.425910 10402 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:05.427246 10361 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.641s	user 0.005s	sys 0.000s
I20260709 13:02:05.411132  8392 raft_consensus.cc:2376] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5. Re-sending same reply.
I20260709 13:02:05.429596  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.430222  8392 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:02:05.432578 10034 consensus_meta.cc:287] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.004s
I20260709 13:02:05.432999 10034 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.434415  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:05.434818 10356 log.cc:927] Time spent T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.372s	user 0.000s	sys 0.003s
I20260709 13:02:05.438823  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.439563  8391 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.440650  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.441246  8393 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.410231  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.442255  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 765) took 1060 ms. Trace:
I20260709 13:02:05.442636  8538 rpcz_store.cc:276] 0709 13:02:04.381964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.387501 (+  5537us) service_pool.cc:224] Handling call
0709 13:02:04.387892 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.388366 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.388398 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.388929 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.634729 (+245800us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:04.634787 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.634886 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.002045 (+367159us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18003d98a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:05.434128 (+432083us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:05.442033 (+  7905us) raft_consensus.cc:1685] finished
0709 13:02:05.442053 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.442191 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10950,"raft.queue_time_us":3842,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":23959,"spinlock_wait_cycles":35723904,"thread_start_us":223026,"threads_started":1,"wal-append.queue_time_us":244177}
I20260709 13:02:05.444834  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.445430  8538 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:05.446578  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.452690  8394 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.453359  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.454974  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.465217  8391 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:05.456177  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.471159  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:05.471800  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 73332.2us
W20260709 13:02:05.467248 10346 consensus_meta.cc:287] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.007s
I20260709 13:02:05.474156  9069 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:05.474659  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:05.479674 10317 consensus_meta.cc:287] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.016s
I20260709 13:02:05.480089 10317 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.468470 10399 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.481989 10399 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.482039 10261 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:05.482488 10399 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.489363  8538 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:05.466355 10151 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.490455 10151 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.492503 10151 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.473099 10406 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.475068 10297 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.493826 10297 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.494207 10297 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.496462  8461 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:05.475349 10140 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:02:05.496992 10321 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:05.500674  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.493048 10148 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.514081  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.513438  8393 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:05.523298  8538 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:05.524309  8390 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:05.528993  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.522895 10313 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.554914  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.525236 10330 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.517715 10034 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:05.558919  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 44987.3us
I20260709 13:02:05.565871  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.559259  8394 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:05.494226 10317 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.563541  8386 raft_consensus.cc:2368] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
I20260709 13:02:05.567272  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.567183 10395 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:05.474004 10043 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.571626  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.555848  8391 raft_consensus.cc:2376] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7. Re-sending same reply.
I20260709 13:02:05.588493  8536 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:05.510063 10346 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.598284  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.589681  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.600059  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.601400  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.530479 10345 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 13:02:05.602521  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 124475us
I20260709 13:02:05.563293 10406 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:05.607931  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.563875 10034 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.620319  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.617975  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.621341  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:05.617584  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.621351  8387 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.627163  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.627674  8539 raft_consensus.cc:2368] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:05.629099  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.630210 10387 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.630764 10387 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:05.631199 10387 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.574980 10187 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:02:05.635995  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.636660  8390 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.640384 10411 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.640977 10411 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.644590 10414 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:05.645215 10414 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.645689 10414 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.589538 10395 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.650220  8540 raft_consensus.cc:2368] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:05.654277  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:05.657155  8390 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:05.664810  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.665515  8389 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:05.666519  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.667316  8389 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:02:05.671614 10409 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
I20260709 13:02:05.683406  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:05.624992 10034 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.625182 10386 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:05.719162  8544 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:05.681864  8392 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:05.720175  8392 pending_rounds.cc:85] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 2
W20260709 13:02:05.701647  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 74572.6us
I20260709 13:02:05.624715 10317 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:05.649739 10259 consensus_meta.cc:287] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.925s	user 0.015s	sys 0.004s
I20260709 13:02:05.703044  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:05.646198 10387 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.703595  8469 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:05.704571 10296 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.605749  9950 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.680212 10370 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:05.683560  8394 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:05.708142 10412 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.318s	user 0.001s	sys 0.001s
I20260709 13:02:05.709700 10346 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:05.710834 10331 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.712783  8387 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:05.700794  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:05.745645  8390 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.647822 10369 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:02:05.721801  8391 raft_consensus.cc:2376] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7. Re-sending same reply.
I20260709 13:02:05.726713  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.659415 10395 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:05.722168 10386 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.727124 10259 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.742818 10313 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.745466  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:05.610517 10406 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.720692  8392 pending_rounds.cc:107] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:05.753232  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:05.760427  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.857110  8469 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.857561  8464 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:05.859016  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:05.860311  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:05.860837  8464 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.680086 10297 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.780637  8462 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
W20260709 13:02:05.861331  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 328200us
W20260709 13:02:05.786381  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 59781.6us
I20260709 13:02:05.863672  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:05.721463 10317 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.789922  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.735302 10296 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.806849 10392 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:05.810925  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.811198 10411 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:05.820420  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 790) took 1026 ms. Trace:
I20260709 13:02:05.798179 10140 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.841768 10408 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.842868 10330 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.844272 10043 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:05.846261 10387 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:05.848476  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.850934  8542 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:05.852089 10259 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:05.794225 10386 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.854192  8395 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:05.627002 10384 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:02:05.857133  8392 raft_consensus.cc:2889] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:05.862112  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:05.654701 10399 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.733449 10375 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:02:05.870183  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:05.872460  8539 raft_consensus.cc:2393] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:02:05.872598  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 63863.5us
I20260709 13:02:05.873800  8358 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:05.825977  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.872051 10296 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.881618  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:05.933398  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.948133  8462 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:05.861434 10406 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.865733 10317 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.875069  8540 rpcz_store.cc:276] 0709 13:02:04.794050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.794198 (+   148us) service_pool.cc:224] Handling call
0709 13:02:05.820102 (+1025904us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54000fcb54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:05.820255 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727897984}
I20260709 13:02:05.871959 10392 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:05.991928  8464 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
W20260709 13:02:05.996655  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 122997us
I20260709 13:02:06.006635  8390 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:06.007076  8358 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:05.910354 10313 consensus_queue.cc:1059] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.085s
W20260709 13:02:06.036857  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 47688.5us
I20260709 13:02:05.993728 10392 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.007673 10140 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.975374 10408 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:05.979478  9872 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:02:06.046955 10313 raft_consensus.cc:2764] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:02:06.101559  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 94619.5us
W20260709 13:02:06.089303 10402 consensus_meta.cc:287] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.000s
I20260709 13:02:06.114464 10375 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:06.120222  8469 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:06.107631  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:06.111140 10419 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:06.115916  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 71283.1us
W20260709 13:02:06.120956 10417 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:02:06.105988 10140 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:06.009656 10387 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:06.112366 10148 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.113004  9950 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.127882  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.151597 10393 consensus_queue.cc:1048] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:06.152405 10425 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:06.152839  8508 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:06.153556 10430 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:06.112041  9778 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:06.154068  9923 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.154419  9778 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.154955  9923 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:06.156925  9778 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.156335  9923 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.154114 10043 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:06.159063 10043 raft_consensus.cc:697] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:06.160516 10043 consensus_queue.cc:237] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:06.145334 10408 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.122648 10259 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:02:06.082073 10151 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.144761 10399 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.148406 10140 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:02:06.222985  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 79457.5us
I20260709 13:02:06.230777  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:06.223475 10424 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 13:02:06.233634 10368 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.137286 10402 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.149147 10411 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:02:06.241632 10368 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:06.241891 10431 log.cc:927] Time spent T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:02:06.241919  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:06.149770 10375 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.242810  8465 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.242853 10368 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.245503  8358 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:06.249049  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.249842  8463 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:06.238153 10399 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:06.256176  8466 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.139204  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:06.262243  8469 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.255033 10387 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.271667  8358 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.253875 10330 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.279369  8358 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:06.278733  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 397167us
I20260709 13:02:06.275794  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:06.282024  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.267645 10399 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.280193  9778 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:06.283576  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.258935 10151 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:06.284862  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:06.292253  8469 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:06.293222  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:06.296636  8358 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.297457  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.301995  8462 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:06.302765  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:06.303953 10330 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.305244  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.305845  9950 consensus_queue.cc:1059] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:06.306056 10330 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.306393  8358 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.306780 10313 raft_consensus.cc:3055] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:06.307202 10313 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:06.307258 10330 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.307627  8358 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.308077 10313 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.308784  8358 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.310501 10387 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.311184 10435 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:06.311599 10435 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:06.311728 10402 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.312058 10435 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.255972 10140 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:06.313043  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.282524 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51684 (request call id 0) took 2095 ms. Trace:
I20260709 13:02:06.313558 10259 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.313802  9778 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.294313 10148 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.314723  9778 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:06.315033 10385 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:06.315886 10432 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:06.282693 10346 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.299383 10437 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.324589 10437 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:06.325035 10437 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.329154 10442 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.282116 10297 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:06.344377 10034 consensus_meta.cc:287] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.001s
I20260709 13:02:06.344821 10034 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.244519 10375 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.319734  8465 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:06.344902 10317 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.350842  8462 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.337267 10296 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.355998  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.347563 10346 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.363947  8462 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.298553 10151 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.314028 10393 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:02:06.361720 10375 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:06.370267 10346 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.364967 10259 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:06.388028 10414 consensus_meta.cc:287] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.742s	user 0.007s	sys 0.007s
I20260709 13:02:06.314000 10321 rpcz_store.cc:276] 0709 13:02:04.186816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.189948 (+  3132us) service_pool.cc:224] Handling call
0709 13:02:04.269719 (+ 79771us) log.cc:844] Serialized 494 byte log entry
0709 13:02:04.479476 (+209757us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b1800436780. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13460142 00007fbe13440eaa 00007fbe13447d53
0709 13:02:04.528181 (+ 48705us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b540034c4a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13460142 00007fbe13440eaa 00007fbe13447d53 00007fbe13447cd9 00007fbe13447c69 00007fbe13447c31 00007fbe13446dfd 000000000038f354 000000000038f199 00007fbe103fa475
0709 13:02:04.532231 (+  4050us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b540034c4a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13460142 00007fbe13440eaa 00007fbe13447d53 00007fbe13447cd9 00007fbe13447c69 00007fbe13447c31 00007fbe13446dfd 000000000038f354 000000000038f199 00007fbe103fa475
0709 13:02:06.282379 (+1750148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":360,"raft.run_cpu_time_us":6567,"raft.run_wall_time_us":266248,"spinlock_wait_cycles":115177344,"thread_start_us":120441,"threads_started":1,"wal-append.queue_time_us":120815,"wal-append.run_cpu_time_us":2484,"wal-append.run_wall_time_us":1058591}
W20260709 13:02:06.422785  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 107559us
W20260709 13:02:06.423681  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 114958us
I20260709 13:02:06.424754  8358 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.410733 10375 raft_consensus.cc:697] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:02:06.433638  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 79626us
I20260709 13:02:06.436285  8358 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.440378  8358 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.421617 10317 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.442394  8358 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:06.438632 10395 consensus_meta.cc:287] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.006s
I20260709 13:02:06.439254  8279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef4deccb7c274fec97786db5d6131514 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 4)
I20260709 13:02:06.451000 10148 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.425592 10414 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.472630  8467 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.472759 10331 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.473659 10414 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.474452 10034 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.474260 10386 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:06.457108 10370 consensus_meta.cc:287] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.002s
I20260709 13:02:06.444212 10399 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.451756  8507 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:06.457818 10429 log.cc:927] Time spent T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.321s	user 0.000s	sys 0.011s
I20260709 13:02:06.454381 10259 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.477636  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:06.465068 10296 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.449656 10395 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.484020 10395 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.484730  8464 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:06.485448  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.486230  8388 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:06.468436  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.469729  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.486990  8466 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:06.474540  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:06.444973  9778 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.441198 10393 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:02:06.460611 10406 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.463362  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 786) took 1752 ms. Trace:
I20260709 13:02:06.446717 10446 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.444073 10445 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.488400  8358 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.488359  8542 rpcz_store.cc:276] 0709 13:02:04.711173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.711316 (+   143us) service_pool.cc:224] Handling call
0709 13:02:06.463118 (+1751802us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400161054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:06.463266 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618138880}
I20260709 13:02:06.492551  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.493386  8542 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:06.494303  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.494921  8388 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.497643  8543 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 2.
I20260709 13:02:06.499478  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:06.500645  8470 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.487839 10370 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.503643  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.486312 10043 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.505865  8507 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.507530  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.511816  8507 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.501302  9778 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.514816 10406 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.492163 10330 consensus_queue.cc:1059] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:02:06.495087 10437 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.515899 10330 raft_consensus.cc:3055] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:06.516286 10330 raft_consensus.cc:740] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:06.517210 10437 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.491184 10392 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.518190 10411 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:06.518584  8461 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.521624  8507 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:06.535777  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.540395  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:06.540851  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.541226  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.541677  8395 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:06.541934  8390 raft_consensus.cc:2368] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7.
I20260709 13:02:06.544301  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.546186  8390 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:06.530012 10411 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.517129 10330 consensus_queue.cc:260] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:06.540207 10441 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:02:06.565094  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.566144  8469 raft_consensus.cc:2393] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:06.549256  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.566690  8394 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.550122  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:06.554569 10151 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.555383  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.556345 10392 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.557950  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.577704  8387 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.578162  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:06.579238  8469 raft_consensus.cc:2368] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5.
I20260709 13:02:06.560034  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:06.561429  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.530076  8358 leader_election.cc:400] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5.
I20260709 13:02:06.580716  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:06.580781  8358 leader_election.cc:403] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.582083  8469 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:06.587028  8537 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:06.587065  8388 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:06.583261  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.594497  8469 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:06.588088  8544 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:06.588384  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.591287  8386 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:06.591791  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:06.592355  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.509363 10375 consensus_queue.cc:237] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.596555  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.592903  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:06.606709  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 76745.5us
I20260709 13:02:06.611524  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.612354  8536 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.612521  8358 leader_election.cc:400] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:06.613055  8358 leader_election.cc:403] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:02:06.614627 10452 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:06.609436  8394 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
W20260709 13:02:06.610319  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.611192  8465 raft_consensus.cc:2393] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:06.621006  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.621171  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.621766  8465 raft_consensus.cc:2393] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:06.622558  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:06.623338  8465 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:06.625020  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:06.625648  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 104112us
I20260709 13:02:06.626633  8469 raft_consensus.cc:2393] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:06.627427  8469 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:06.628896  8387 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:06.630208  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:06.544773 10435 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.632694  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.632606  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.620311 10445 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.635071  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:06.616281 10392 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.636011  8465 raft_consensus.cc:2410] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:06.635366  8469 raft_consensus.cc:1240] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.616454 10151 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5.
I20260709 13:02:06.635170  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.624397 10330 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.639470  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:06.620433 10413 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:06.637288  8507 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.628355 10247 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.642656  8463 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.644831  8507 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.641368  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:06.647306  8469 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.648546 10259 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.648725  8536 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:06.640019 10437 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.658656 10247 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.661926 10386 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.632102 10446 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:06.685989 10446 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.688612 10446 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.636905  9950 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:06.664152 10395 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.665210  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:06.689697 10395 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.690152 10395 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.690721  8433 leader_election.cc:400] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:06.691800  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:06.650527  8507 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.693972 10261 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.694190 10247 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.694423 10261 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:06.694908 10261 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.697142  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:06.698160  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 47732.6us
I20260709 13:02:06.698293  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.699041  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.699452  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:06.700069  8540 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:06.700469  8507 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.700795  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.636752 10411 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.701553 10331 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:06.641937 10392 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.702381 10368 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.702143 10331 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.703218 10368 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.703347  8465 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:06.704581 10331 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.704285 10392 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.667841 10296 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.707377 10399 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:06.707971 10399 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:06.710000 10386 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.708940 10399 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.715603  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1261) took 1064 ms. Trace:
I20260709 13:02:06.715749  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.716419  8507 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.718222  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.720319  8507 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.669414  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:06.721740  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:06.716048  8470 rpcz_store.cc:276] 0709 13:02:05.651525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.652756 (+  1231us) service_pool.cc:224] Handling call
0709 13:02:05.653005 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.501042 (+848037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.715382 (+214340us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400096fd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:06.715547 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949003520}
I20260709 13:02:06.728171  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.731935  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.734655  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:06.737947  8507 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.740211  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.743392  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.744149  8395 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.743407  8433 leader_election.cc:400] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7.
I20260709 13:02:06.744774  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.744911  8433 leader_election.cc:403] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.745420  8391 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.752444  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.752458  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.754383  8463 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:06.753799  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:06.755934  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.748049  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.756913  8386 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.758761  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.760582  8507 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.762434  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:06.762698  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.763073  8394 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:06.764050  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.764209  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:06.763065  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 138919us
W20260709 13:02:06.766258  8359 leader_election.cc:336] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.533s (SENT)
I20260709 13:02:06.766611  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.726750 10247 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.787264  8507 leader_election.cc:400] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
I20260709 13:02:06.788407  8507 leader_election.cc:403] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.788466  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.727191 10411 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.791446  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:06.791759  8540 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:06.796449  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.727512 10368 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.792685  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.753152 10063 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.797289  8393 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.757726 10034 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.758718 10435 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.815382  8391 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:06.752343 10296 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7.
I20260709 13:02:06.768246 10397 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.787321  9950 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.821645  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:06.787830 10414 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:06.665472 10413 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.826311  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:06.826735  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 60513.7us
I20260709 13:02:06.862185  8395 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:06.758450 10392 consensus_queue.cc:1059] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:02:06.830201  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:06.824630 10375 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:06.857374  8393 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:06.794612 10247 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.798880 10369 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.816447 10438 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:06.869464  8359 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.731s (SENT)
I20260709 13:02:06.831910  8389 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:06.827765 10331 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.859021  8386 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
W20260709 13:02:06.873863  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 47655.6us
I20260709 13:02:06.878715  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.876507  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.876634  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:06.865064 10385 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:06.891610 10346 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.893990 10392 consensus_queue.cc:1243] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer 2122d8c723e84e3da22f81f7eeb4b1a9 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:06.894759 10392 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:06.895139 10392 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:06.900341 10247 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.901262  8388 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.906559 10446 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:06.908282 10438 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:06.909773 10438 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.880625 10414 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:06.912545 10414 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.913322 10445 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
W20260709 13:02:06.914218  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 44790.1us
I20260709 13:02:06.914960 10437 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.916909  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.918198 10446 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.922761  8359 leader_election.cc:400] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5.
I20260709 13:02:06.927161  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.937435  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1266) took 1284 ms. Trace:
W20260709 13:02:06.944782  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 66099.5us
I20260709 13:02:06.944928  8464 rpcz_store.cc:276] 0709 13:02:05.652823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.011881 (+359058us) service_pool.cc:224] Handling call
0709 13:02:06.012317 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.485167 (+472850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.937122 (+451955us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54000d6e54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:06.937362 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085960576}
I20260709 13:02:06.928933 10259 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.925379 10261 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.939375 10413 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:06.879279 10375 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:06.875195  9950 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:06.885730 10442 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.942860  8388 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:06.943969  8394 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:06.946467  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.948478  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.949168  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.951329 10317 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.982190 10317 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:06.983168 10317 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.944352 10392 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:06.986104  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.986326 10392 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.987499  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:06.988324  8537 raft_consensus.cc:2393] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:06.989342  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:06.945827  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:06.991016  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 63947.5us
I20260709 13:02:06.991110  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.992501  8359 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:06.978331  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:06.993747  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 48050.1us
I20260709 13:02:06.994647  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.996650  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:06.998498  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.999491  8536 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:07.000517  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:07.002271  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:07.003767  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.007485 10370 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.008311 10408 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.010732 10408 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:07.011777 10408 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:07.007525  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.014194 10435 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:07.014775 10435 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:07.015553 10434 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.697s	user 0.003s	sys 0.000s
I20260709 13:02:07.016228 10034 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:07.016650 10034 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.017146 10034 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.018186  8541 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:07.018677  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:06.979125 10442 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:07.019244 10442 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.019712  8541 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:07.018296  9950 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.022447  8544 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:07.022437  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:07.023288  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 206186us
I20260709 13:02:07.025681  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:07.026347  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:07.027204  8540 raft_consensus.cc:2368] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6.
I20260709 13:02:06.981285 10346 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:07.027173  8508 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:07.028051  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:06.993119 10445 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.029357  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:07.009164  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:06.972704 10395 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.034040  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:07.000104 10399 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:07.033825  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.035270  8358 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.037750  8537 raft_consensus.cc:2368] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:07.006206 10437 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:07.006278 10331 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.042681  8358 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.043298 10148 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.043849 10247 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:07.044672 10446 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:07.047565  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.024843 10435 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:07.027624 10413 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.024997 10396 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:07.027474  9923 consensus_queue.cc:1059] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:02:07.045670 10063 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:07.042346 10297 raft_consensus.cc:2764] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 13:02:07.067082  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 44722us
W20260709 13:02:07.068838  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.070050  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.073091  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:07.075243  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.041623 10397 consensus_queue.cc:1059] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:02:07.056707 10151 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:07.079560  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:07.083118  8464 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.045949 10043 consensus_queue.cc:1059] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:02:07.085278  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.052744 10346 consensus_queue.cc:1059] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:02:07.058053 10471 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:07.085641  8394 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.077258 10261 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:07.076690 10148 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.099997  8464 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
W20260709 13:02:07.096752  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49930.9us
I20260709 13:02:07.087653  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.080677  9778 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.088737 10411 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.101119  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.090164 10399 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:07.063771 10396 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.099159 10471 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:07.127367  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:07.128120 10471 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:07.128610  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.130015  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.098337 10397 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:02:07.149582  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.154067  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.099360 10259 consensus_queue.cc:1059] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:02:07.157123  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:07.159296  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.160053  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:07.155578 10297 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:07.155809 10475 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.205698  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.208171  8464 raft_consensus.cc:2393] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:07.146644 10474 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:07.201628  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.158258 10411 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.197942 10063 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.200136 10437 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:02:07.228933  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 181269us
I20260709 13:02:07.162719 10481 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:02:07.229949  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 178282us
I20260709 13:02:07.230263  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.206962 10471 raft_consensus.cc:3055] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:07.204280 10395 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:07.207770 10297 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.230685  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.222142  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.231149  8468 raft_consensus.cc:2410] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:07.209903 10369 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
W20260709 13:02:07.228173  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 78671.2us
I20260709 13:02:07.222478 10484 raft_consensus.cc:3055] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:07.209748 10370 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.233129 10474 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.208570 10346 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:07.234107 10481 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:07.251767 10346 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:07.252127 10481 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:07.211843 10151 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:07.254137 10481 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:07.254072 10151 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:07.255442 10468 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:02:07.255708  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:07.256006 10483 raft_consensus.cc:3055] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:07.256398 10483 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.249300 10484 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.257390 10483 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.257824 10484 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.258659 10483 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.259080 10484 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.259830  8463 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:07.261034 10034 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.211584 10148 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:07.262036 10148 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:07.262104 10411 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.264149 10148 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:07.224927 10485 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:02:07.266240 10482 raft_consensus.cc:3055] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:07.266652 10482 raft_consensus.cc:740] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.267556 10482 consensus_queue.cc:260] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.268618 10346 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:07.268986 10482 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.250613 10313 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:07.271677  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 796) took 1967 ms (client timeout 1914 ms). Trace:
W20260709 13:02:07.272117  8543 rpcz_store.cc:269] 0709 13:02:05.303974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.382838 (+ 78864us) service_pool.cc:224] Handling call
0709 13:02:07.271494 (+1888656us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001239d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:07.271607 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493083392}
I20260709 13:02:07.207322  9778 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:07.249092  8464 raft_consensus.cc:2393] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:07.256485 10151 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:07.232661 10471 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.273928  8507 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.276491  8468 raft_consensus.cc:1240] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:07.276887  8464 raft_consensus.cc:1240] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.284509  8464 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.248435  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:02:07.279693  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 49044.3us
I20260709 13:02:07.237219 10297 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.288771  8358 leader_election.cc:400] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6.
I20260709 13:02:07.289175  8358 leader_election.cc:403] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:07.291985 10247 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.295125  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:07.295804  8537 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
W20260709 13:02:07.297184  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 48859.1us
I20260709 13:02:07.298651  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.282232 10148 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.302877  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:07.303819  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:07.266279 10396 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:07.308702  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.222625 10479 consensus_queue.cc:1059] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 13:02:07.312407  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 210610us
I20260709 13:02:07.309672  8464 raft_consensus.cc:1240] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.302963 10296 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:07.314280  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:07.321718 10476 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:02:07.312327 10375 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:07.322180 10486 raft_consensus.cc:3055] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:07.322747 10486 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.322419 10471 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.323817 10471 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.323748 10486 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.325286 10486 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.326372  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:07.327769 10063 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.328022  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:07.326524  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:07.332027  8390 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.234207 10399 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.315188 10487 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:07.317386  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:07.316485  8387 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:07.321190  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:07.342733  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:07.317152  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:07.237263 10442 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.347771  8391 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:07.349316  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:07.282192  9778 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.351794 10489 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:07.352634  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:07.353168  8393 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.356071  8467 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:07.358975 10034 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:07.313386 10396 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.363116  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1256) took 1714 ms. Trace:
I20260709 13:02:07.316156  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.370489  8461 rpcz_store.cc:276] 0709 13:02:05.648820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.648933 (+   113us) service_pool.cc:224] Handling call
0709 13:02:05.666513 (+ 17580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.518983 (+852470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.362875 (+843892us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54000a0854. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:07.363053 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959203712}
I20260709 13:02:07.314711 10296 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:07.333525 10386 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.340413 10395 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.394309  8468 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.408056  8461 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:02:07.408526  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 92438.1us
I20260709 13:02:07.332989 10437 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.344825 10487 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:07.443785  8390 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:07.423367 10442 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:07.427186 10261 raft_consensus.cc:3055] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:07.432533  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1282) took 1401 ms. Trace:
I20260709 13:02:07.393205 10296 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.441890  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.447060  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:07.450228  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.445858  8470 rpcz_store.cc:276] 0709 13:02:06.031281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.725195 (+693914us) service_pool.cc:224] Handling call
0709 13:02:06.725563 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.725841 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:06.955948 (+230107us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.425592 (+469644us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b18002adf60. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe1308f4bc 00007fbe103dd48b 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f7455 00007fbe134df060 00007fbe134f1716 00007fbe13502287
0709 13:02:07.425715 (+   123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.425766 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:07.432193 (+  6427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.432290 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.432458 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97155,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":31793,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4766,"spinlock_wait_cycles":2875264,"thread_start_us":311846,"threads_started":3,"wal-append.queue_time_us":88823}
W20260709 13:02:07.380198  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67149.7us
I20260709 13:02:07.391645  8389 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:07.437155 10411 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.409626  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:07.439430 10396 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.434572 10406 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:07.446424  8393 raft_consensus.cc:2410] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:07.459118  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:07.459517  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.462811  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:07.462891  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.445657 10487 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.447428 10261 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.454589 10479 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:07.473732  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.453884 10395 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.478246  8433 leader_election.cc:400] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:07.456496 10034 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.485510  8390 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:07.481429  8391 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.445184 10397 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:02:07.487993  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:07.467247 10386 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.493153 10247 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6.
W20260709 13:02:07.493880  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.445217 10297 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.489485 10261 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.470681  9950 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.482779 10063 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:07.454494 10411 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:07.503082  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.464052 10369 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:02:07.545840  8538 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.452672 10490 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:02:07.498023 10479 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.549021  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:07.533248  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 74213.4us
I20260709 13:02:07.549685  8539 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
W20260709 13:02:07.549880  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46750.1us
I20260709 13:02:07.535434  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:07.536693 10492 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:07.551914  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:07.531443 10368 consensus_queue.cc:1059] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:02:07.554656  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:07.555223  8394 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.504195 10395 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:07.540493  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:07.555810  8539 raft_consensus.cc:2955] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:07.563607  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:07.541491  8390 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:02:07.542070  8463 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:07.565250  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.545807 10369 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:02:07.567028  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.533722  8386 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:07.462370 10396 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.571705  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.547756  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:07.538259 10063 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:07.537431 10494 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:07.556233  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1274) took 1812 ms. Trace:
I20260709 13:02:07.564499 10151 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.574292  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.581146  8462 rpcz_store.cc:276] 0709 13:02:05.744208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.351886 (+607678us) service_pool.cc:224] Handling call
0709 13:02:06.362271 (+ 10385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.367044 (+  4773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.556038 (+1188994us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b54002e7f54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:07.556182 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3357568}
I20260709 13:02:07.583818  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.584749  8394 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:07.585048  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.586015  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.556650 10313 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:07.587456  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:07.589093  8470 raft_consensus.cc:2393] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:07.591511  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:07.592280  8462 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:07.570598 10369 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.600059 10479 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.593905  8538 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:07.594574  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:07.601620  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:07.591382 10330 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:07.573401 10395 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:07.604281 10395 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.583155 10247 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:02:07.594615 10498 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:02:07.587386 10413 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:07.594404 10499 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:07.580051 10442 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.611141  8538 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:07.579644 10148 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.618676  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
W20260709 13:02:07.709091  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 90545.4us
I20260709 13:02:07.711258  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:07.597306 10140 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:07.651815 10408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.008s
W20260709 13:02:07.703666  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 118712us
I20260709 13:02:07.597999 10313 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.718952  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:07.715138 10408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.005s	sys 0.008s
I20260709 13:02:07.716828 10063 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.729223  8388 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:02:07.729558  8467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 936) took 1372 ms (client timeout 1679 ms). Trace:
W20260709 13:02:07.729991  8467 rpcz_store.cc:269] 0709 13:02:06.357466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.474274 (+116808us) service_pool.cc:224] Handling call
0709 13:02:07.729372 (+1255098us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540039fb54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:07.729477 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937364736}
I20260709 13:02:07.730444  8388 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:07.731568  8388 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:07.733192  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.734762  8433 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:07.735463 10034 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.736013 10034 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.703926 10151 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.742432 10375 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:07.743144 10034 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:07.747560 10495 log.cc:927] Time spent T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:02:07.748719 10508 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:07.714913 10414 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:07.713886 10406 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:07.667032  9950 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:02:07.757053  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:07.799944 10411 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:07.800776 10503 log.cc:927] Time spent T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:02:07.785394 10414 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:07.779824 10493 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.800865 10502 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:02:07.855713 10493 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.803421  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:07.781236 10406 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:07.856989 10406 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.857496  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 128) took 1487 ms. Trace:
I20260709 13:02:07.858112 10493 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:07.776957 10330 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:07.850209  8540 raft_consensus.cc:3055] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:07.858055  8469 rpcz_store.cc:276] 0709 13:02:06.370566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.909052 (+538486us) service_pool.cc:224] Handling call
0709 13:02:06.909387 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.912260 (+  2873us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:06.912286 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.422032 (+509746us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b2c00040298. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:02:07.422723 (+   691us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.461282 (+ 38559us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:07.461342 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.461488 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.857094 (+395606us) raft_consensus.cc:1685] finished
0709 13:02:07.857122 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.857418 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2310,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"spinlock_wait_cycles":21777792,"thread_start_us":38138,"threads_started":1,"wal-append.queue_time_us":108939}
I20260709 13:02:07.857028  8542 raft_consensus.cc:606] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:07.862766  8542 raft_consensus.cc:614] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:07.861949  8540 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:07.863498 10247 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.868507 10148 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:07.869663 10496 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.372s	user 0.003s	sys 0.000s
I20260709 13:02:07.778920 10369 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.873086 10369 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:07.878942  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.885064  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 946) took 1452 ms. Trace:
I20260709 13:02:07.885229 10414 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.886466  8540 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.890591  8463 rpcz_store.cc:276] 0709 13:02:06.432384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.260600 (+828216us) service_pool.cc:224] Handling call
0709 13:02:07.260895 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.565549 (+304654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.884712 (+319163us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54000974d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:07.884984 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645884288}
I20260709 13:02:07.905941 10396 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:07.895121 10486 consensus_meta.cc:287] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.004s
I20260709 13:02:07.915761  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1279) took 1911 ms. Trace:
W20260709 13:02:07.916237  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 159277us
I20260709 13:02:07.916662  8538 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:07.916195  8465 rpcz_store.cc:276] 0709 13:02:06.004030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.640549 (+636519us) service_pool.cc:224] Handling call
0709 13:02:06.640844 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.703777 (+ 62933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.915430 (+1211653us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b54003cc8d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:07.915682 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143013120}
I20260709 13:02:07.904847 10508 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:07.926599 10511 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:02:07.927793 10471 consensus_meta.cc:287] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.004s
I20260709 13:02:07.968318  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:07.975108  8543 raft_consensus.cc:606] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:02:07.974637  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 110401us
I20260709 13:02:07.920977 10296 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.980799  8390 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:07.985468 10514 consensus_queue.cc:1059] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:02:07.987903 10515 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.988480 10515 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:07.989897  8394 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:07.967478 10487 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:07.980245 10512 consensus_queue.cc:1059] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:02:07.997254  8387 raft_consensus.cc:2393] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 4: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:07.997423 10512 raft_consensus.cc:3055] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:07.997913 10512 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:07.998236 10487 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:07.998703 10512 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.000025 10261 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.999612  8543 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:08.000130 10512 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.002751  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:08.002862 10514 raft_consensus.cc:3055] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:07.889559 10321 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:08.030839  8394 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:08.016481 10514 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:02:08.019793 10482 consensus_meta.cc:287] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.750s	user 0.014s	sys 0.000s
I20260709 13:02:08.047874 10296 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.050781 10515 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.025481 10487 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.051728 10487 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.054445  8535 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:08.056340 10514 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:08.060570 10510 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:02:08.061729 10408 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.062177 10408 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:08.063053 10408 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.064301 10408 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.066534  8392 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:08.068100 10406 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:08.069281  8467 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:08.070847 10482 consensus_queue.cc:1059] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:08.071908 10482 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:08.072563 10445 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.073187 10482 raft_consensus.cc:3055] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.073028 10445 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.073966 10493 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:08.074388  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:08.075201 10445 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.075979  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:08.077033  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.081440  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:08.082473  8465 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:02:08.085529  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 78675.4us
I20260709 13:02:08.090099 10313 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:08.093482 10505 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:02:08.105707  9778 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.073549 10482 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:08.123312  8394 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:08.125255  8463 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:08.131438  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6595c51b9ae043699167a92b109f328e"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:08.132054  8535 raft_consensus.cc:606] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:08.132380  8535 raft_consensus.cc:614] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:08.127626 10385 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:08.077243 10483 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:02:08.137888  8469 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:08.140826  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:08.146281  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:08.146530  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.147079  8542 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:08.150373  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:08.150391  8462 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:08.151391  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.154016  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.154331  8464 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:08.154703  8537 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:08.152813 10487 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.156708  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:08.157327  8461 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:08.158288 10504 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:02:08.158675 10485 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:08.159107 10485 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:08.160058 10485 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.161500 10485 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:08.074005 10396 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:08.162215 10482 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.162863  8466 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:08.129974 10438 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.138195 10385 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.133481 10397 consensus_queue.cc:1059] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:02:08.165428  8461 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:08.174317  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:08.187041  8464 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:08.191088  8508 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:08.195225  8462 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:08.168895 10396 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:08.214310 10151 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.214821 10151 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:08.215983 10151 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.217396 10151 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:08.192375 10395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.015s	sys 0.012s
I20260709 13:02:08.188592 10446 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.201007 10482 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.197528 10397 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:08.186287 10406 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:08.234607  8468 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:08.207229 10480 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.355774 10480 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:08.237025 10395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.015s	sys 0.012s
I20260709 13:02:08.183048 10438 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:08.357250  8469 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:08.359073 10438 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.359686 10521 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:08.360337 10521 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.363217 10521 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.365557  8540 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.370450  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1257) took 1035 ms. Trace:
I20260709 13:02:08.370921  8387 rpcz_store.cc:276] 0709 13:02:07.335017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.349049 (+ 14032us) service_pool.cc:224] Handling call
0709 13:02:08.370245 (+1021196us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54001f7054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:08.370386 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488323328}
I20260709 13:02:08.374977 10508 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.375597 10508 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.376124  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:08.376758  8394 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:08.377710 10508 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.243086 10504 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 13:02:08.344234 10396 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.383036  8289 catalog_manager.cc:5697] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 2 to 4, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 4 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:08.386417  8358 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:08.383074 10396 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:08.388900 10508 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:08.381685 10395 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.388108  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:08.392267 10297 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.394116 10297 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.394578 10297 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.384824  8289 catalog_manager.cc:5697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.397480 10247 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.397931 10247 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.398725 10406 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.399217 10406 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.400267 10330 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.400820 10330 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.401197 10406 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.396638 10297 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.398314 10247 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.404908  8390 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:08.409307  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:08.410897 10413 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:08.393675 10395 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.413057 10413 consensus_queue.cc:1059] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:08.414336 10471 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.414790 10471 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:08.242019 10446 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:08.414996 10151 raft_consensus.cc:3055] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:08.240631 10490 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.180s
W20260709 13:02:08.425725 10346 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:02:08.422696 10514 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.412110  8358 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:08.430717 10521 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.431175 10521 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:08.431227  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:08.431761 10521 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.415668 10471 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.434125  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:08.434535  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:08.436169  8535 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:08.437098  8538 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:08.439419  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 196040us
I20260709 13:02:08.440299  8508 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:08.441241 10346 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:08.441646 10346 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.420445 10446 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:08.442059 10346 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.420310 10151 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:08.442430 10471 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.389669 10508 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:08.417181 10395 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.444355 10508 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:08.445508  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.443703 10406 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:08.447876 10406 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.450004 10406 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.454746  8395 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:08.456769 10517 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:08.457772  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.457859 10517 raft_consensus.cc:3055] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:08.458494 10517 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:08.459337 10517 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:08.460500 10330 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.463557  8390 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:08.464250  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.460628 10517 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.464280  8387 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:08.477617  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1251) took 1143 ms. Trace:
I20260709 13:02:08.479112  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:08.478209  8388 rpcz_store.cc:276] 0709 13:02:07.333893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.732194 (+398301us) service_pool.cc:224] Handling call
0709 13:02:07.732459 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.853262 (+120803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.853312 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.853997 (+   685us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.209429 (+355432us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:08.298661 (+ 89232us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.345438 (+ 46777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.345510 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.477386 (+131876us) raft_consensus.cc:1685] finished
0709 13:02:08.477409 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.477545 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25704,"prepare.queue_time_us":148279,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":86992,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":158,"thread_start_us":451322,"threads_started":2,"wal-append.queue_time_us":564824}
I20260709 13:02:08.481010 10490 consensus_queue.cc:1059] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:08.481065 10368 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:08.482108 10490 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.482012 10483 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:08.482627 10490 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.482856 10483 consensus_queue.cc:1243] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer d2a645dcec4c479ba4c94d075b1bc98c log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:08.482978 10368 raft_consensus.cc:3055] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.483420 10483 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:08.483726 10368 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:08.483796 10483 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:08.485059 10483 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.443212 10151 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.442121  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:08.485622 10368 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.521088  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.503155  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:08.534205  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.503755  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:08.506753  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:08.502632  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:08.535749  8538 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:08.464835  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.534822  8387 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:08.343133  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
W20260709 13:02:08.541275  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 99256.6us
I20260709 13:02:08.536010  8395 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:08.529157  8394 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:08.544740  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:08.487641  8508 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:08.535210  8390 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:08.497776  8289 catalog_manager.cc:5697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.489988 10446 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.549304 10438 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:08.550985  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:08.557961  8540 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:08.560189  8388 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:02:08.560870  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:08.561192  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.561847  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:08.562418  8387 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:08.563786  8387 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:08.566263  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.569265  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.570436  8386 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
W20260709 13:02:08.570789  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 84110.9us
I20260709 13:02:08.571653  8386 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:08.483084 10490 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.493635 10330 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.549376 10446 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:08.597182  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.600337  8391 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:02:08.608620  8391 pending_rounds.cc:85] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 2
I20260709 13:02:08.608924  8391 pending_rounds.cc:107] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:08.609141  8391 raft_consensus.cc:2889] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.487257 10450 consensus_queue.cc:1059] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:02:08.566955 10151 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.596344  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:08.612321  8393 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:08.568696 10368 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.549333 10395 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:08.607645  8541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:08.623795  8541 raft_consensus.cc:606] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:08.624204  8541 raft_consensus.cc:614] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:08.610206  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.565955 10483 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.611057  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.606570  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.628702  8387 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:08.628717  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.568044 10438 raft_consensus.cc:697] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:08.621881  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.486269 10346 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.602231 10397 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:08.629503  8541 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:02:08.629967  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.628911  8535 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
W20260709 13:02:08.631824  8288 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50742 (request call id 136) took 14978 ms (client timeout 15000 ms). Trace:
I20260709 13:02:08.567804 10247 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.654521  8464 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:08.611775 10512 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.663257 10406 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:08.665372  8542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.004s	sys 0.032s
I20260709 13:02:08.654791  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:08.691555  8542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.004s	sys 0.032s
I20260709 13:02:08.575723 10408 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:02:08.611865 10445 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:08.611804 10313 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:08.609931 10414 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:02:08.575775 10385 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.610965 10330 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.611518 10297 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:08.682329  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:08.676667  8507 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:08.695600  8358 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:08.716420  8535 raft_consensus.cc:2410] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:08.733695  8507 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:08.692965  8470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.016s	sys 0.028s
W20260709 13:02:08.702009  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.671360  8288 rpcz_store.cc:269] 0709 13:01:53.653372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.654150 (+   778us) service_pool.cc:224] Handling call
0709 13:02:08.631763 (+14977613us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:04.783044 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:04.803027 (+ 19983us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:04.803094 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:02:04.803110 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:04.907193 (+104083us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:04.922490 (+ 15297us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:04.925017 (+  2527us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:02:05.185685 (+260668us) tablet.cc:701] Row locks acquired
0709 13:02:05.199538 (+ 13853us) write_op.cc:260] PREPARE: finished
0709 13:02:05.227216 (+ 27678us) write_op.cc:270] Start()
0709 13:02:05.250686 (+ 23470us) write_op.cc:276] Timestamp: P: 1783602125215319 usec, L: 0
0709 13:02:05.273882 (+ 23196us) op_driver.cc:348] REPLICATION: starting
0709 13:02:05.331419 (+ 57537us) log.cc:844] Serialized 3233 byte log entry
0709 13:02:06.110225 (+778806us) op_driver.cc:464] REPLICATION: finished
0709 13:02:06.434202 (+323977us) write_op.cc:301] APPLY: starting
0709 13:02:06.442244 (+  8042us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.488038 (+ 45794us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.499724 (+ 11686us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.561426 (+ 61702us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.561753 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:02:06.561850 (+    97us) write_op.cc:312] APPLY: finished
0709 13:02:06.562300 (+   450us) log.cc:844] Serialized 64 byte log entry
0709 13:02:06.562533 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.562671 (+   138us) write_op.cc:454] Released schema lock
0709 13:02:06.562745 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.563132 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.563166 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7423,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":276879,"apply.run_cpu_time_us":3902,"apply.run_wall_time_us":144956,"num_ops":8,"prepare.queue_time_us":129842,"prepare.run_cpu_time_us":10792,"prepare.run_wall_time_us":669642,"raft.queue_time_us":366977,"raft.run_cpu_time_us":13647,"raft.run_wall_time_us":170227,"replication_time_us":836143,"spinlock_wait_cycles":31488,"thread_start_us":541931,"threads_started":4,"wal-append.queue_time_us":44461,"wal-append.run_cpu_time_us":15753,"wal-append.run_wall_time_us":2180015}]]}
I20260709 13:02:08.651433 10396 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.650192 10259 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:02:08.674809 10397 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:08.715549 10487 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:08.709649 10445 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:08.698199  8536 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.027s
I20260709 13:02:08.703107 10406 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.717468 10261 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:08.726429 10140 consensus_meta.cc:287] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 1.010s	user 0.014s	sys 0.004s
I20260709 13:02:08.688246 10521 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.706485 10484 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.708861 10480 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:08.734805  8470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.017s	sys 0.028s
I20260709 13:02:08.703418 10512 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:08.749996  8536 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.027s
I20260709 13:02:08.742923 10396 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.748994 10247 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.714519  9923 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:02:08.775758  8538 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:08.780290  8541 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:08.783936  8539 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:08.731071 10043 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:02:08.745234 10487 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:08.808413  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 208926us
I20260709 13:02:08.778149 10497 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.814798 10521 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.802678 10408 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:08.828886  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:08.807814 10487 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:08.740913 10438 consensus_queue.cc:237] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.784513 10484 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.793421 10504 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:02:08.784415 10480 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.839674  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:08.826124 10482 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.846390  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:08.824909 10521 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.849112  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:08.829030 10479 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.835175 10446 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.851691 10395 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 13:02:08.865052 10536 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:02:08.865515 10395 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:08.867035 10395 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:08.838840 10397 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.851926 10034 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.868533 10034 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.868916 10034 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.852793 10482 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.870867 10385 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:08.872149 10482 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:08.873397 10446 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.874310  8387 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:08.875236 10187 raft_consensus.cc:3055] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:08.875659 10187 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:08.875808 10330 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.876585 10187 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:08.877204 10445 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.873942 10446 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:08.878973 10187 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:08.880540 10446 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.882936 10484 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:08.846024 10313 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.883647 10313 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.883996 10313 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.843670 10063 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:08.887414 10063 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:08.856637 10479 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.887866 10063 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.889460 10479 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:08.844280 10369 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:02:08.831243 10414 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:08.828346 10297 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:02:08.858250 10346 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:08.897420 10261 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:08.902453 10396 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:08.862493 10296 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.906896 10406 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:08.862867 10532 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:02:08.820405 10497 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.908439 10512 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:08.856063 10521 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.911842 10480 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:08.915107 10413 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.836424 10408 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:08.923342 10508 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:08.933750  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.962172  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.948637 10296 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.926440 10490 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:08.976435 10446 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:08.979092 10406 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.002676  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 309015us
I20260709 13:02:08.981106 10296 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.976915 10413 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.007974  8470 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:09.012975  8358 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:09.015599  8540 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:09.019277 10151 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.019719 10151 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.020076 10151 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.022938  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.024202  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.025461  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.026353  8470 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:09.026574  8464 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:09.027397  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.027926  8465 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.030093  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:08.976807 10487 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.031140  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.005508 10396 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:09.035486  8541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:09.040102  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.041548  8541 raft_consensus.cc:606] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:09.042644  8541 raft_consensus.cc:614] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:09.034845  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 230106us
I20260709 13:02:09.061432  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:09.062531  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.063371  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.064368  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.065178  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.006094 10446 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.075346  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.010778 10406 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.033268 10512 consensus_queue.cc:1059] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:09.025979 10313 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.081017  9069 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:09.082720  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:09.082049  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 233004us
I20260709 13:02:09.083395  8536 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.090112  8470 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:09.056897 10396 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:09.101899 10538 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:02:09.108143 10438 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.261955 10438 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:09.262454 10546 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.182s	user 0.008s	sys 0.004s
I20260709 13:02:09.264074 10438 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.108402 10521 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.264890 10063 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.253545 10406 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.241092 10446 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.242251  9064 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:09.267411  9064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 50) took 1083 ms. Trace:
I20260709 13:02:09.267802  9064 rpcz_store.cc:276] 0709 13:02:08.184500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.197825 (+ 13325us) service_pool.cc:224] Handling call
0709 13:02:09.267230 (+1069405us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400163354. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:09.267331 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788692224}
I20260709 13:02:09.242704  8536 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:09.243062 10396 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:09.243862 10508 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:09.270133 10545 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.184s	user 0.006s	sys 0.000s
I20260709 13:02:09.270242  8435 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:09.272718 10330 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:09.273105 10330 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:09.273973 10406 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:09.274551 10406 raft_consensus.cc:697] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:09.274262 10330 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.275671 10330 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.275521 10406 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:09.280293 10297 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.280882 10297 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.282900 10297 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:09.284139 10541 log.cc:927] Time spent T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.253s	user 0.000s	sys 0.011s
I20260709 13:02:09.098501 10553 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 13:02:09.245335  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 153693us
W20260709 13:02:09.284986  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 183857us
I20260709 13:02:09.076373 10549 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:02:09.286347 10549 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:09.286834 10482 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:09.287156 10547 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.287077 10043 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:09.287710 10547 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.286881  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:09.248350  8465 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:09.249157  8538 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:09.290135 10547 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:09.245159 10296 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.250015 10414 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.250595 10542 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.251104 10151 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.291052 10414 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.292557 10151 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.292851 10547 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:09.252022 10313 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.291080 10542 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.293210 10414 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.252408 10408 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.255110 10413 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.257292 10497 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.258247 10555 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.295704 10555 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.297281 10296 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.260006 10487 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:09.260353  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 160112us
I20260709 13:02:09.261173 10490 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:09.261248 10540 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.179s	user 0.003s	sys 0.003s
I20260709 13:02:09.289776 10369 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.308416  8508 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:09.244700  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:09.311678  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 67058.9us
I20260709 13:02:09.295732 10542 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:09.312983  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.301030  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.301535  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.318249  8543 raft_consensus.cc:2410] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:09.302841  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:09.304111  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:09.305285  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.319746  8538 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:09.307510  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:09.320539  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.321277  8464 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:09.321662  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:09.299742 10512 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.319701  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.323308  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:09.325039  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:09.325809  8468 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:09.330432  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.331857  8468 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:09.332535  8464 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:09.333242  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.334905  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.335639  8386 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:09.335673  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.336146  8468 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:09.337930 10414 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:09.339565 10497 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:09.340159 10497 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:09.340492 10514 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:09.341157 10514 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.342846 10063 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:09.343390 10514 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.344017  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:09.344585  8389 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.346864  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:09.347774  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.347951  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.348449  8394 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:09.349269  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.349349 10034 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:09.307518 10555 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.350395 10521 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.311177 10369 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.350872 10521 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.351456 10369 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.351537 10034 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.352954 10521 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.354835  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.355455  8391 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:09.312628 10445 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.355958  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.356269  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.356365 10445 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.357024  8391 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:09.357156  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.324489 10296 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:09.358369  8393 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:09.359349  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.336300  8461 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:09.359737  8388 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:09.360033  8393 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:09.315383 10490 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:09.361693 10490 raft_consensus.cc:697] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:09.362092  8461 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:09.362412  8387 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:09.362591 10490 consensus_queue.cc:237] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.359627  8465 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:09.364882  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.365509  8391 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:09.348456  8466 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:09.366796  8462 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:09.336545  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:09.370678  8386 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.374436  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:09.323493 10413 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.375839 10413 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.376914 10330 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.377411 10330 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:09.378149  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49868.4us
I20260709 13:02:09.381716  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.383279  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.383634 10330 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.386143  8394 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:09.337564  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.388240  8464 raft_consensus.cc:2393] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:09.323251 10487 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.391772  8358 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:09.394855  8536 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:09.396195  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.381160  8389 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:09.341224 10497 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.327440 10512 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.395078 10508 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:09.406574  8386 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:09.393680 10330 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:09.414609  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.404666  8358 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:09.417027  8358 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:09.418002 10514 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:09.418527 10514 raft_consensus.cc:697] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:09.419430 10514 consensus_queue.cc:237] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.422869  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.424206  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.425755  8541 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 2.
I20260709 13:02:09.426476  8507 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:09.433866 10508 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:09.435210 10508 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.395529 10346 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:09.407522 10413 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.445570  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.446082  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.446833  8541 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:02:09.441825  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:09.394153 10487 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.445351  8507 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:09.452893  8386 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.456079  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.457037  8466 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:09.457468  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.458282  8465 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:09.459074  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.459589  8465 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:09.459869  8358 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:09.460748  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.462260  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.463001  8463 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.440330 10151 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.481837  8537 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:09.482167  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.470052  8462 raft_consensus.cc:2393] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:09.470680  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.476830 10446 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:09.483723  8465 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.483805 10446 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:09.484066  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.485306  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.486677  8543 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:02:09.487166  8543 pending_rounds.cc:85] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 3
I20260709 13:02:09.487430  8543 pending_rounds.cc:107] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:02:09.487711  8543 raft_consensus.cc:2889] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.489393  8540 raft_consensus.cc:1240] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:09.494246  8538 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:09.495520  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:09.466810 10558 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:02:09.496778  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.414382 10368 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:02:09.449360 10330 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:09.508816  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.499495  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.509552  8461 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:09.466215 10548 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.508148  8536 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:09.484954 10446 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.510671  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:09.470631 10445 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.442862 10413 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:09.511413  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.497344 10261 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:09.523763  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.524561  8464 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:02:09.467209 10521 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:09.515492  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.498339 10151 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.515096 10548 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.528751  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.529109 10548 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.530647  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:09.531181  8542 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.531477  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.532687  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.533473  8538 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:09.500058 10414 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.534091  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:09.517633  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 72385.4us
I20260709 13:02:09.527670 10413 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.528172 10445 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:09.535894  8507 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:09.528723 10151 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.507663  8463 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:09.530443 10261 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:09.549579 10261 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.550465 10549 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.550843 10261 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.551025 10549 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.553233 10549 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:09.553931 10445 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.515837 10346 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:02:09.556191  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.557050 10445 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.558175 10413 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.560185 10550 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.560719 10550 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.561764 10151 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.562896 10550 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:09.557610 10445 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:09.564252 10151 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.576671  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.578584  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.584753  8538 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:09.582371  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:09.588225  8507 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:09.599377  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.600271  8540 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:09.606379  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.538686 10483 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.618618 10483 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.619452 10512 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.620823 10483 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:09.623974  8464 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:09.627437  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.628528  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.628713  8464 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:09.630915  8508 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:09.627828  8542 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:09.634482  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:09.605470 10346 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.635118  8463 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:09.608566 10480 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.644456  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.656347  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:09.657440  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.659205  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.660018  8542 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:09.669551  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:09.678169  8386 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:09.564764 10521 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:09.685252  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45665.1us
I20260709 13:02:09.686546  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:09.688720  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.611s (SENT) [suppressed 21 similar messages]
I20260709 13:02:09.658393  8536 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:09.690732  8465 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:09.568997 10414 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.584693 10445 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.733201  8392 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:09.726517  8386 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:09.739223  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:09.636709 10346 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.743973  8536 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:09.728729  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:09.743098  8544 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:02:09.745512  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 155737us
W20260709 13:02:09.753623  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 293812us
I20260709 13:02:09.652782 10480 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:09.653644 10512 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:09.710016 10504 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.730944 10413 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.762548  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.786834  8544 raft_consensus.cc:2393] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:09.763594  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.764421  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.767254  8461 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 2: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:09.637120 10159 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:02:09.710335 10406 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:09.726487 10034 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.769400  8358 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:09.757200 10549 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:09.767349 10557 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:02:09.751727 10346 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.780591 10504 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.757598 10479 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.759450  8392 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:02:09.818426 10539 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:09.790046 10487 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:09.793628  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.772188 10397 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:02:09.831604  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 142927us
W20260709 13:02:09.887297  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.767941  9923 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 13:02:09.838266  8433 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.28.254:35733, user_credentials={real_user=slave}} blocked reactor thread for 85409.5us
I20260709 13:02:09.731258 10330 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.767203 10369 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.833148 10504 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:09.800894 10544 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:09.774474 10480 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.785501 10512 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.842440 10479 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.909029 10296 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.820986  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:10.033797  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 268471us
I20260709 13:02:10.035092  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:09.806209 10482 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:02:09.825297 10034 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.035832  8544 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:09.828542 10549 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:09.890697 10151 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:09.890245 10572 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:10.068100  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 149205us
I20260709 13:02:10.058005  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:10.062680  8539 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:09.825091 10406 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:10.072777  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:10.075520  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:10.023242 10514 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.027474 10487 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.089035  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:10.049554 10479 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.076380  8392 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:10.094578  8358 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:02:10.106168 10562 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
W20260709 13:02:10.086469 10539 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:02:10.108354 10566 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
W20260709 13:02:10.111881  8495 heartbeater.cc:646] Failed to heartbeat to 127.7.28.254:35733 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.28.254:35733 timed out after 15.000s (SENT)
W20260709 13:02:10.119611 10567 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:02:10.063526 10151 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:10.126317  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 82193.7us
I20260709 13:02:10.062167 10296 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:10.193971  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 66785us
I20260709 13:02:10.198825  8507 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:10.200317  8507 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:10.203472  8507 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:10.144912 10151 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:10.256873  9069 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:10.081705 10572 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.090512 10514 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.102176 10487 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.195539 10414 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.204885 10413 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:10.285598  8543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.006s	sys 0.011s
W20260709 13:02:10.295224  8543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.007s	sys 0.011s
W20260709 13:02:10.292503  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 197849us
I20260709 13:02:10.241871 10482 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:10.298473  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:10.304895  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:10.246760 10551 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:10.322909  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 83398.2us
W20260709 13:02:10.300580 10564 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.551s	user 0.000s	sys 0.001s
I20260709 13:02:10.330963  8507 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:10.284934 10585 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:10.285198 10445 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.298185 10521 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.300745 10550 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.301450 10482 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:10.317636 10490 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.316053 10551 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:10.348274 10408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.018s
I20260709 13:02:10.297953 10553 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:02:10.343483 10497 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.337996 10446 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.342056 10413 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:10.317778 10484 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:10.381419 10482 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:10.391896 10408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.009s	sys 0.019s
W20260709 13:02:10.392354 10578 log.cc:927] Time spent T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.507s	user 0.000s	sys 0.001s
I20260709 13:02:10.389353 10183 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.438654  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1337) took 1118 ms. Trace:
I20260709 13:02:10.390626 10551 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:10.388736 10369 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:10.440737  8470 rpcz_store.cc:276] 0709 13:02:09.319967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.322166 (+  2199us) service_pool.cc:224] Handling call
0709 13:02:09.345013 (+ 22847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.345328 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.345357 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.364373 (+ 19016us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.536002 (+171629us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.536041 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.536106 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.438438 (+902332us) raft_consensus.cc:1685] finished
0709 13:02:10.438457 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.438598 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":788,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":160068,"threads_started":1,"wal-append.queue_time_us":259167}
W20260709 13:02:10.433744 10261 consensus_meta.cc:287] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260709 13:02:10.404029  9923 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:10.415145 10512 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.416718 10413 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.391072 10490 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.520464  8540 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:10.421481 10159 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.408161 10497 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:10.434036 10565 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:02:10.447253 10043 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.587230  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 199032us
W20260709 13:02:10.460614 10573 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 13:02:10.513810 10603 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.428884 10484 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:10.588980 10296 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:10.562892 10570 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.463s	user 0.000s	sys 0.001s
I20260709 13:02:10.594391  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:10.618952  8544 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:10.592864  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 865) took 1100 ms. Trace:
I20260709 13:02:10.527724 10413 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.603518  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1294) took 1266 ms. Trace:
W20260709 13:02:10.585901 10581 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:02:10.582521  9923 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:10.562270 10549 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:10.438907 10034 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:10.618096  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 227915us
I20260709 13:02:10.523142 10594 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 13:02:10.589139 10159 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.462469 10183 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:10.619773  8535 rpcz_store.cc:276] 0709 13:02:09.492453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.492581 (+   128us) service_pool.cc:224] Handling call
0709 13:02:09.492834 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.493015 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.493040 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.493414 (+   374us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.628507 (+135093us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:09.628540 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.628612 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.592663 (+964051us) raft_consensus.cc:1685] finished
0709 13:02:10.592683 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.592812 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":134756,"threads_started":1,"wal-append.queue_time_us":295719}
I20260709 13:02:10.562844 10408 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:02:10.583019 10479 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.642411  8387 rpcz_store.cc:276] 0709 13:02:09.336692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.363880 (+ 27188us) service_pool.cc:224] Handling call
0709 13:02:09.364127 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.384603 (+ 20476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.384645 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.389066 (+  4421us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.655177 (+266111us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:09.655230 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.655322 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.603304 (+947982us) raft_consensus.cc:1685] finished
0709 13:02:10.603322 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.603442 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9344,"raft.queue_time_us":12297,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":262610,"threads_started":1,"wal-append.queue_time_us":454131}
W20260709 13:02:10.685765  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 81175.1us
I20260709 13:02:10.687810  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:10.688525  8387 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:10.593976 10521 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.676025  8544 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:10.635612 10585 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:10.615020 10487 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:10.684995 10577 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.402s	user 0.000s	sys 0.004s
I20260709 13:02:10.607502 10043 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:10.686002  8535 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:10.594983 10553 consensus_queue.cc:1059] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:02:10.614616 10576 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:10.681195  8359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.020s	sys 0.062s
I20260709 13:02:10.705260 10553 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:10.706736 10553 raft_consensus.cc:3055] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:10.707307  8359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.021s	sys 0.062s
W20260709 13:02:10.708232  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 619332us
I20260709 13:02:10.708585  8536 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:10.615631 10603 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:10.718556  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:10.711539 10484 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:10.715034 10183 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:10.716092 10586 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260709 13:02:10.695936  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:10.720465  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:10.699822 10034 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:02:10.691306 10572 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.720288  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:10.707113 10553 raft_consensus.cc:740] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:10.826763  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 864) took 1334 ms. Trace:
I20260709 13:02:10.720458  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:10.818805  8436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.002s	sys 0.024s
I20260709 13:02:10.844543  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 876) took 1189 ms. Trace:
W20260709 13:02:10.930856  8436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.012s	sys 0.029s
I20260709 13:02:10.931870  8386 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.735661  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:10.823632  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1291) took 1487 ms. Trace:
I20260709 13:02:10.900466  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:10.906108  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:10.927175  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:10.933223  8535 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:02:10.934579  8544 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:02:10.935015  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 214629us
I20260709 13:02:10.698625 10521 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.935755  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:10.938022  8535 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
W20260709 13:02:10.849421 10605 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.416s	user 0.001s	sys 0.000s
I20260709 13:02:10.893173  8358 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:02:10.956395  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 63760.7us
I20260709 13:02:10.931759  8540 rpcz_store.cc:276] 0709 13:02:09.655862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.656040 (+   178us) service_pool.cc:224] Handling call
0709 13:02:10.844276 (+1188236us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54000fb754. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:10.844464 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982251776}
W20260709 13:02:10.798487 10604 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:02:10.856612  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 883) took 1085 ms. Trace:
I20260709 13:02:10.965097  8388 rpcz_store.cc:276] 0709 13:02:09.770972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.771153 (+   181us) service_pool.cc:224] Handling call
0709 13:02:09.799146 (+ 27993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.799449 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.799485 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.820534 (+ 21049us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.311084 (+490550us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:10.311141 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.311221 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.856308 (+545087us) raft_consensus.cc:1685] finished
0709 13:02:10.856338 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.856520 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":296064,"threads_started":1,"wal-append.queue_time_us":825027}
I20260709 13:02:10.718274 10406 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:02:10.781450 10592 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
W20260709 13:02:10.799216 10606 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:02:10.781663 10548 consensus_meta.cc:287] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 1.252s	user 0.008s	sys 0.005s
W20260709 13:02:10.754340 10582 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:02:10.932659 10261 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.942510  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 222359us
I20260709 13:02:10.992931  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:10.934232  8393 rpcz_store.cc:276] 0709 13:02:09.335812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.361272 (+ 25460us) service_pool.cc:224] Handling call
0709 13:02:09.361572 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.364641 (+  3069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.364668 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.376741 (+ 12073us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.433698 (+ 56957us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b18001972c0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:02:09.734639 (+300941us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:09.734691 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.734781 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.807746 (+1072965us) raft_consensus.cc:1685] finished
0709 13:02:10.818106 (+ 10360us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.823553 (+  5447us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9804,"raft.queue_time_us":11523,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":2615,"spinlock_wait_cycles":9006464,"thread_start_us":300705,"threads_started":1,"wal-append.queue_time_us":634792}
I20260709 13:02:10.930603  8537 rpcz_store.cc:276] 0709 13:02:09.492081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.492223 (+   142us) service_pool.cc:224] Handling call
0709 13:02:09.492537 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.492752 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.492776 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.493232 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.779120 (+285888us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.779164 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.779235 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.826475 (+1047240us) raft_consensus.cc:1685] finished
0709 13:02:10.826497 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.826692 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":285539,"threads_started":1,"wal-append.queue_time_us":590521}
I20260709 13:02:10.954921 10414 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:10.935716  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:10.851368 10151 consensus_meta.cc:287] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.003s
W20260709 13:02:10.852897 10599 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
W20260709 13:02:10.846628 10613 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:02:10.878160  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:02:10.851414 10480 consensus_meta.cc:287] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.802s	user 0.009s	sys 0.000s
W20260709 13:02:10.855669 10504 consensus_meta.cc:287] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.824s	user 0.007s	sys 0.002s
I20260709 13:02:10.798410 10603 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:10.970808 10589 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:10.974380 10487 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:10.939633 10595 log.cc:927] Time spent T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.504s	user 0.002s	sys 0.000s
I20260709 13:02:10.794279  9064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58874 (request call id 93) took 1481 ms. Trace:
I20260709 13:02:10.969484  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:10.797991 10159 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:10.902861 10497 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.797760  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:10.797261  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:10.924657 10484 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:10.781268 10611 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.042372  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 862) took 1551 ms. Trace:
I20260709 13:02:11.043087  8465 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:10.996223 10548 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.895790 10576 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:10.936525 10575 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.048483 10621 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:11.048934 10621 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.049209 10514 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.849179 10479 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:10.988848  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:11.050127 10609 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:11.050382  8469 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:11.050544 10609 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.050894 10609 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.848147 10043 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:11.052028 10618 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:11.052307  8536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 972) took 1281 ms (client timeout 1614 ms). Trace:
I20260709 13:02:11.052568 10618 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:11.052700  8536 rpcz_store.cc:269] 0709 13:02:09.770598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.793289 (+ 22691us) service_pool.cc:224] Handling call
0709 13:02:11.052123 (+1258834us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54000fbc54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:11.052253 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902926080}
I20260709 13:02:11.007390 10151 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:10.957851  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:10.998034  8467 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:10.900454  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:11.000938  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:11.002214  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 66576.2us
I20260709 13:02:11.034220  9064 rpcz_store.cc:276] 0709 13:02:09.294564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.315907 (+ 21343us) service_pool.cc:224] Handling call
0709 13:02:09.513409 (+197502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:09.549317 (+ 35908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.549354 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:09.550666 (+  1312us) log.cc:844] Serialized 582 byte log entry
0709 13:02:09.896917 (+346251us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.901561 (+  4644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.029373 (+127812us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.707818 (+678445us) raft_consensus.cc:1685] finished
0709 13:02:10.709217 (+  1399us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.753438 (+ 44221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5178,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":298732,"threads_started":1,"wal-append.queue_time_us":638107}
I20260709 13:02:11.068992 10514 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:10.967594 10330 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:10.989825 10346 consensus_meta.cc:287] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 1.147s	user 0.013s	sys 0.000s
I20260709 13:02:11.070574 10346 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.072741 10346 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.072820 10151 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.990170 10508 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:11.073503 10413 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:11.074787 10590 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.641s	user 0.002s	sys 0.000s
I20260709 13:02:11.074882 10514 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.028457  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.029265  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1356) took 1388 ms. Trace:
I20260709 13:02:11.029636  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:10.781385  9923 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.077678  8462 rpcz_store.cc:276] 0709 13:02:09.640428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.640592 (+   164us) service_pool.cc:224] Handling call
0709 13:02:09.641024 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.653994 (+ 12970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.654041 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.654614 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.207629 (+553015us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:10.207681 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.207764 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.715470 (+507706us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:11.022286 (+306816us) raft_consensus.cc:1685] finished
0709 13:02:11.022324 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.029214 (+  6890us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30676,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15458,"spinlock_wait_cycles":60366720,"thread_start_us":435067,"threads_started":1,"wal-append.queue_time_us":622730}
I20260709 13:02:11.079566  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 880) took 1434 ms. Trace:
I20260709 13:02:11.080044  8394 rpcz_store.cc:276] 0709 13:02:09.645311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.724687 (+ 79376us) service_pool.cc:224] Handling call
0709 13:02:09.725134 (+   447us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:09.737335 (+ 12201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.737380 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:09.738185 (+   805us) log.cc:844] Serialized 78 byte log entry
0709 13:02:10.029431 (+291246us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:10.393154 (+363723us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.394345 (+  1191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.394425 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.073993 (+679568us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:11.077061 (+  3068us) raft_consensus.cc:1685] finished
0709 13:02:11.079298 (+  2237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.079489 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29056,"prepare.queue_time_us":177453,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":223799,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":26417,"spinlock_wait_cycles":68461312,"thread_start_us":547207,"threads_started":2,"wal-append.queue_time_us":663882}
I20260709 13:02:10.976711 10446 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:02:11.081977 10413 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:10.837004 10585 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
W20260709 13:02:11.028301 10580 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.017s	sys 0.045s
I20260709 13:02:11.031764  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:11.027762 10504 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.036489  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:11.087152  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.087630  8468 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.995930 10261 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.039768  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 879) took 1394 ms. Trace:
I20260709 13:02:10.932891 10490 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.042799  8543 rpcz_store.cc:276] 0709 13:02:09.491446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.498242 (+  6796us) service_pool.cc:224] Handling call
0709 13:02:09.498521 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.499633 (+  1112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.499670 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.500075 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.295779 (+795704us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:10.295833 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.296013 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.042164 (+746151us) raft_consensus.cc:1685] finished
0709 13:02:11.042185 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.042317 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":967,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3541,"thread_start_us":795395,"threads_started":1,"wal-append.queue_time_us":1114123}
I20260709 13:02:11.092902 10261 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:11.088652 10580 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.017s	sys 0.045s
W20260709 13:02:11.096330 10482 consensus_meta.cc:287] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 13:02:11.031203 10589 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.046262 10591 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.046413 10587 log.cc:927] Time spent T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:11.046867  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:11.049278 10621 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.049698 10619 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:10.993433  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:11.113072  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 119813us
I20260709 13:02:11.045415 10497 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:11.057564  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 882) took 1322 ms. Trace:
I20260709 13:02:11.114027  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:11.058535 10551 consensus_meta.cc:287] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.000s
I20260709 13:02:11.060168 10550 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:11.061533  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 886) took 1092 ms. Trace:
I20260709 13:02:11.062099  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 873) took 1465 ms. Trace:
I20260709 13:02:11.045136 10484 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.065029  8542 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:11.022106 10480 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:11.077458  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55569.7us
I20260709 13:02:11.078217  8388 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:11.074818  8387 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:02:11.031761  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 62367.2us
I20260709 13:02:11.107764 10482 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.124758  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.006223 10414 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.073522 10508 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:11.126219  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:11.082803 10514 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.126853  8388 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.086175  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.087759  8390 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
W20260709 13:02:11.089164  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 44283.7us
I20260709 13:02:11.064543 10548 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.030614 10553 consensus_queue.cc:260] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.088963  8391 rpcz_store.cc:276] 0709 13:02:09.645033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.724321 (+ 79288us) service_pool.cc:224] Handling call
0709 13:02:09.724702 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.726902 (+  2200us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:09.726950 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.749733 (+ 22783us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.081028 (+331295us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:10.081086 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.081181 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.039548 (+958367us) raft_consensus.cc:1685] finished
0709 13:02:11.039570 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.039710 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1797,"raft.queue_time_us":18723,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":18176,"thread_start_us":255970,"threads_started":1,"wal-append.queue_time_us":524386}
I20260709 13:02:11.134287  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:11.090921 10608 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.091719 10504 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.092455  8541 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:11.025420  9067 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:10.983917  8386 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:11.141978  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:11.142547  8386 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.142885  8388 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:11.100345  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:11.146088  8537 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:11.101022  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:11.101537  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:11.099689  8358 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:02:11.613984  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 514425us
I20260709 13:02:11.616539 10572 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:11.617072 10572 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:11.617493 10572 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.149861  8386 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:11.622943  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:11.623906  8386 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:11.114090  8389 rpcz_store.cc:276] 0709 13:02:09.734920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.736378 (+  1458us) service_pool.cc:224] Handling call
0709 13:02:09.765825 (+ 29447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:09.766253 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.766275 (+    22us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:09.842797 (+ 76522us) log.cc:844] Serialized 52 byte log entry
0709 13:02:10.333773 (+490976us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:10.467144 (+133371us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.584608 (+117464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.584798 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.852189 (+267391us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:11.057245 (+205056us) raft_consensus.cc:1685] finished
0709 13:02:11.057348 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.057505 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127008,"prepare.queue_time_us":132304,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":170679,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":11581,"spinlock_wait_cycles":71438976,"thread_start_us":283342,"threads_started":1,"wal-append.queue_time_us":533051}
I20260709 13:02:11.128356  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.761066  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.140364  8391 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:11.790491  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 898) took 1226 ms. Trace:
I20260709 13:02:11.790827  8391 rpcz_store.cc:276] 0709 13:02:10.564316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.134014 (+569698us) service_pool.cc:224] Handling call
0709 13:02:11.790429 (+656415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.791837  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.792347  8391 raft_consensus.cc:2376] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6. Re-sending same reply.
I20260709 13:02:11.077740  8393 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:02:11.795011  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60598 (request call id 173) took 1019 ms. Trace:
I20260709 13:02:11.795334  8393 rpcz_store.cc:276] 0709 13:02:10.775727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.026646 (+250919us) service_pool.cc:224] Handling call
0709 13:02:11.794956 (+768310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.796682  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 171) took 1409 ms. Trace:
I20260709 13:02:11.796979  8393 rpcz_store.cc:276] 0709 13:02:10.387468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.795953 (+1408485us) service_pool.cc:224] Handling call
0709 13:02:11.796209 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.796384 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.796409 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.796449 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.796481 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.796532 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.796639 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.122233  8392 rpcz_store.cc:276] 0709 13:02:09.968884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.116721 (+147837us) service_pool.cc:224] Handling call
0709 13:02:10.117039 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.332945 (+215906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.332978 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.333463 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.587171 (+253708us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:10.587213 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.061129 (+473916us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400249354. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:11.061182 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.061228 (+    46us) raft_consensus.cc:1685] finished
0709 13:02:11.061242 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.061471 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127071,"raft.queue_time_us":120981,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":18377,"spinlock_wait_cycles":462393600,"thread_start_us":198835,"threads_started":1,"wal-append.queue_time_us":314134}
I20260709 13:02:11.127566  8394 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:11.115582  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:11.111723  8468 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:11.805843 10408 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:11.198766  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 63693.9us
I20260709 13:02:11.793637  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 170) took 1406 ms. Trace:
I20260709 13:02:11.808737  8391 rpcz_store.cc:276] 0709 13:02:10.387190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.792921 (+1405731us) service_pool.cc:224] Handling call
0709 13:02:11.793183 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.793354 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.793380 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.793420 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.793448 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.793498 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.793592 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.146896  8540 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.122284  8538 rpcz_store.cc:276] 0709 13:02:09.597116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.597314 (+   198us) service_pool.cc:224] Handling call
0709 13:02:09.597710 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.604887 (+  7177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.604932 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.605511 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.911698 (+306187us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b1800446e60. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:02:10.186426 (+274728us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:10.186485 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.186595 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.845326 (+658731us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:11.061896 (+216570us) raft_consensus.cc:1685] finished
0709 13:02:11.061915 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.062045 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13031,"raft.queue_time_us":7614,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7214,"spinlock_wait_cycles":83002624,"thread_start_us":274470,"threads_started":1,"wal-append.queue_time_us":810929}
I20260709 13:02:11.146986  8543 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
W20260709 13:02:11.270937 10630 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:11.397703  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.819736  8387 raft_consensus.cc:2393] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:11.820266  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 890) took 1490 ms. Trace:
I20260709 13:02:11.820628  8387 rpcz_store.cc:276] 0709 13:02:10.335946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.397403 (+1061457us) service_pool.cc:224] Handling call
0709 13:02:11.820201 (+422798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.420954  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.260622  8537 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:02:11.457716 10628 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.411s	user 0.000s	sys 0.002s
I20260709 13:02:11.189229 10043 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.121590 10034 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:11.077281 10330 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:11.830097 10330 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.829704 10043 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.214380 10414 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.189481 10490 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:11.835690 10490 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.220291 10480 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.107129 10549 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.347752 10521 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.216014 10508 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:11.209473 10548 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:11.209512 10553 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.841877  8540 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:11.121698 10551 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.069878 10576 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:11.244451 10575 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.113134 10591 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.169718 10596 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:11.433727 10610 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.864136 10591 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.864297 10610 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.119293 10619 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.866804 10610 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.867308 10619 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.265218 10618 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.268605 10621 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.374122 10397 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.842540 10548 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.870177 10397 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.122241 10625 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:11.871855 10625 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.872221 10397 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.872385 10625 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.227185 10609 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.888876 10609 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.890079  8391 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:11.151219 10608 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.894326 10608 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.114152 10497 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:11.222280 10484 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:11.510147 10579 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 1.075s	user 0.005s	sys 0.001s
I20260709 13:02:11.523102  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:11.540421  8541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 968) took 1779 ms (client timeout 2171 ms). Trace:
I20260709 13:02:11.906543  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1281) took 2574 ms. Trace:
W20260709 13:02:11.906849  8541 rpcz_store.cc:269] 0709 13:02:09.760758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.763311 (+  2553us) service_pool.cc:224] Handling call
0709 13:02:11.540162 (+1776851us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400030054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:11.540350 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3000876288}
I20260709 13:02:11.554687 10487 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:11.908004 10497 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:11.908502 10487 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:11.906981  8395 rpcz_store.cc:276] 0709 13:02:09.332440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.334528 (+  2088us) service_pool.cc:224] Handling call
0709 13:02:09.354136 (+ 19608us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:09.391563 (+ 37427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.391591 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:09.397038 (+  5447us) log.cc:844] Serialized 52 byte log entry
0709 13:02:09.804048 (+407010us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:10.146677 (+342629us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.332449 (+185772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.441527 (+1109078us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b54003f7ad4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:11.441588 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.509306 (+ 67718us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:11.906220 (+396914us) raft_consensus.cc:1685] finished
0709 13:02:11.906242 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.906424 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11163,"prepare.queue_time_us":293212,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6037,"raft.queue_time_us":233296,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":10559,"spinlock_wait_cycles":90757760,"thread_start_us":840400,"threads_started":3,"wal-append.queue_time_us":995809}
I20260709 13:02:11.911237 10487 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:11.567016 10159 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.912021 10159 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.914525 10159 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.570346 10514 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:11.916354 10514 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.917604  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1308) took 1031 ms. Trace:
I20260709 13:02:11.578296 10482 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.579700 10151 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.580786  8360 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
W20260709 13:02:11.919662  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 338990us
I20260709 13:02:11.919445 10151 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.920400  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:11.921725 10151 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.586692 10296 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:11.922484 10296 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:11.923509  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 308745us
I20260709 13:02:11.924266  8358 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:11.924705 10296 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.599875 10446 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:11.925608  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:11.638620 10612 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.657135 10261 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:11.926672 10612 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.926901 10261 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.927417  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:11.665645  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:11.676900  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 878) took 2005 ms. Trace:
I20260709 13:02:11.682032  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.688032 10572 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.929643  8542 rpcz_store.cc:276] 0709 13:02:09.672014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.674527 (+  2513us) service_pool.cc:224] Handling call
0709 13:02:09.674887 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.123641 (+1448754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.676608 (+552967us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000b5ed4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:11.676833 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3196795776}
I20260709 13:02:11.691190 10611 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:11.709860 10406 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:11.931921 10572 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.932024 10611 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.932127 10406 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.933284 10151 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:11.691884 10445 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:11.933738 10151 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.934207 10151 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.934046 10445 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.934626 10406 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.727331  9064 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:11.929118 10612 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.414538  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:11.937686 10609 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:11.938184 10609 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:11.938611 10609 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.938956  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1310) took 1052 ms. Trace:
I20260709 13:02:11.761710  8390 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:11.783052 10413 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:11.784350 10369 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:11.939636  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1303) took 1054 ms. Trace:
I20260709 13:02:11.939335  8395 rpcz_store.cc:276] 0709 13:02:10.887027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.910212 (+1023185us) service_pool.cc:224] Handling call
0709 13:02:11.910596 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.936837 (+ 26241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.936858 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.936892 (+    34us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:11.936912 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.938684 (+  1772us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b5400118fd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:11.938732 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.938890 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59990784}
I20260709 13:02:11.940203  8390 rpcz_store.cc:276] 0709 13:02:10.884954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.760821 (+875867us) service_pool.cc:224] Handling call
0709 13:02:11.939581 (+178760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.925434 10446 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.941735 10611 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.942158  8388 raft_consensus.cc:2410] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:11.942818 10445 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.943579  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1311) took 1056 ms. Trace:
I20260709 13:02:11.944218  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1313) took 1056 ms. Trace:
I20260709 13:02:11.944695  8388 rpcz_store.cc:276] 0709 13:02:10.887855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.420597 (+532742us) service_pool.cc:224] Handling call
0709 13:02:11.944043 (+523446us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400306bd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:11.944166 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274471808}
I20260709 13:02:11.944006 10487 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:11.788477  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:11.939669 10413 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.945602 10487 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:11.805275  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 689809us
I20260709 13:02:11.950215  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:11.806273 10408 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.823570 10063 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:11.825043  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 52) took 1232 ms. Trace:
I20260709 13:02:11.824905  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:11.956213  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:02:11.956468  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 131708us
I20260709 13:02:11.956589 10408 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.839267 10549 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.955996  9069 rpcz_store.cc:276] 0709 13:02:10.592305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.592575 (+   270us) service_pool.cc:224] Handling call
0709 13:02:10.604532 (+ 11957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.700281 (+ 95749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.700414 (+   133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.710496 (+ 10082us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.029080 (+318584us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.029107 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.029151 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.457101 (+427950us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:11.824719 (+367618us) raft_consensus.cc:1685] finished
0709 13:02:11.824744 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.824980 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113175,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":141,"spinlock_wait_cycles":42163584,"thread_start_us":296731,"threads_started":2,"wal-append.queue_time_us":254439}
I20260709 13:02:11.845960 10504 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.846679 10330 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:11.218133 10589 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.856696  8394 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:11.981374  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1315) took 1093 ms. Trace:
I20260709 13:02:11.981858  8390 rpcz_store.cc:276] 0709 13:02:10.888381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.980534 (+1092153us) service_pool.cc:224] Handling call
0709 13:02:11.980900 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.981063 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.981088 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.981125 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:11.981157 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.981221 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.981320 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.982950 10330 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.983150  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1299) took 1099 ms. Trace:
I20260709 13:02:11.983325  8390 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:11.983560  8394 rpcz_store.cc:276] 0709 13:02:10.883756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.802147 (+918391us) service_pool.cc:224] Handling call
0709 13:02:11.802399 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.981713 (+179314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.982954 (+  1241us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b54003f9dd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:11.983102 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119740160}
I20260709 13:02:11.859127  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 172) took 1465 ms. Trace:
I20260709 13:02:11.985255  8392 rpcz_store.cc:276] 0709 13:02:10.393672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.799947 (+1406275us) service_pool.cc:224] Handling call
0709 13:02:11.800255 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.851527 (+ 51272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.851580 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.851649 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.851735 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.858712 (+  6977us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b5400248954. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:11.858784 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.859038 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117310336}
I20260709 13:02:11.849462 10551 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.842128 10043 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.855335 10576 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:11.874043 10490 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.862304 10034 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:11.883438 10621 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.886322 10596 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.010053 10596 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.009876 10151 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:12.011304  8389 raft_consensus.cc:2393] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:12.013520 10151 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:11.871768 10548 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.891888  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1306) took 1006 ms. Trace:
I20260709 13:02:11.891898 10625 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.014248  8391 rpcz_store.cc:276] 0709 13:02:10.885852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.810896 (+925044us) service_pool.cc:224] Handling call
0709 13:02:11.811161 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.890612 (+ 79451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.891576 (+   964us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b54001199d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:11.891821 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180850432}
I20260709 13:02:12.014709 10609 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.015700 10625 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:12.015933  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:12.016901 10609 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:12.019047  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1316) took 1130 ms. Trace:
I20260709 13:02:12.019428  8389 rpcz_store.cc:276] 0709 13:02:10.888669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.632750 (+744081us) service_pool.cc:224] Handling call
0709 13:02:11.788283 (+155533us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:02:12.018855 (+230572us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b54001f7054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:12.018988 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275169408}
I20260709 13:02:11.123633 10550 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.918485 10514 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:11.929085 10261 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:12.021188 10549 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:11.745631  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 30) took 7336 ms. Trace:
I20260709 13:02:12.022349  8289 rpcz_store.cc:276] 0709 13:02:04.409651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.416139 (+  6488us) service_pool.cc:224] Handling call
0709 13:02:11.745531 (+7329392us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:09.082672 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:09.099253 (+ 16581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:09.099296 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:02:09.099319 (+    23us) tablet.cc:662] Decoding operations
0709 13:02:09.255508 (+156189us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:09.255604 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:09.255637 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:09.255979 (+   342us) tablet.cc:701] Row locks acquired
0709 13:02:09.255999 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:02:09.256148 (+   149us) write_op.cc:270] Start()
0709 13:02:09.256268 (+   120us) write_op.cc:276] Timestamp: P: 1783602129256101 usec, L: 0
0709 13:02:09.256291 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:09.257036 (+   745us) log.cc:844] Serialized 1350 byte log entry
0709 13:02:10.384644 (+1127608us) op_driver.cc:464] REPLICATION: finished
0709 13:02:10.855572 (+470928us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe103dd0ac 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe16f1def0
0709 13:02:11.132007 (+276435us) write_op.cc:301] APPLY: starting
0709 13:02:11.139838 (+  7831us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:11.199363 (+ 59525us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:11.203154 (+  3791us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:11.226164 (+ 23010us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:11.226339 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:02:11.226382 (+    43us) write_op.cc:312] APPLY: finished
0709 13:02:11.226620 (+   238us) log.cc:844] Serialized 34 byte log entry
0709 13:02:11.275797 (+ 49177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:11.275902 (+   105us) write_op.cc:454] Released schema lock
0709 13:02:11.275956 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:11.277078 (+  1122us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:11.277114 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":720621,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":719705,"apply.run_cpu_time_us":27943,"apply.run_wall_time_us":153439,"num_ops":3,"prepare.queue_time_us":463165,"prepare.run_cpu_time_us":23619,"prepare.run_wall_time_us":266338,"raft.queue_time_us":793232,"raft.run_cpu_time_us":63619,"raft.run_wall_time_us":784564,"replication_time_us":1073579,"spinlock_wait_cycles":74362752,"thread_start_us":1489174,"threads_started":5,"wal-append.queue_time_us":184390,"wal-append.run_cpu_time_us":38852,"wal-append.run_wall_time_us":1437925}]]}
I20260709 13:02:11.929899  8386 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:12.026036  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 893) took 1608 ms. Trace:
I20260709 13:02:11.922504  8539 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:11.917999  8387 rpcz_store.cc:276] 0709 13:02:10.886415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.821387 (+934972us) service_pool.cc:224] Handling call
0709 13:02:11.822088 (+   701us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:11.862925 (+ 40837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.883639 (+ 20714us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:11.892941 (+  9302us) log.cc:844] Serialized 582 byte log entry
0709 13:02:11.917265 (+ 24324us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:11.917305 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.917377 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.917417 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:11.917428 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.917546 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10700,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":118,"thread_start_us":48340,"threads_started":2,"wal-append.queue_time_us":14636}
I20260709 13:02:11.953511  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1312) took 1066 ms. Trace:
I20260709 13:02:11.944350  8395 rpcz_store.cc:276] 0709 13:02:10.887306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.942714 (+1055408us) service_pool.cc:224] Handling call
0709 13:02:11.943057 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.943224 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.943252 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.943308 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:11.943351 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.943422 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.943527 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.952252  8358 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:12.027201  8388 rpcz_store.cc:276] 0709 13:02:10.887579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.945461 (+1057882us) service_pool.cc:224] Handling call
0709 13:02:11.945722 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.953050 (+  7328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.953100 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.953162 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:11.953205 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.953282 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.953441 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:12.027855  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 75676us
I20260709 13:02:12.028712  8358 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:11.958544  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:11.837721  8293 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:12.029657  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 71179.6us
I20260709 13:02:12.036398  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:11.950205 10487 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:11.962558 10159 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:12.026331  8386 rpcz_store.cc:276] 0709 13:02:10.417773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.624531 (+1206758us) service_pool.cc:224] Handling call
0709 13:02:12.025979 (+401448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.963941 10296 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:11.964290 10406 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:02:11.966120 10504 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.019622 10413 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:12.037122  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.060017  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:11.959950 10612 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.043431  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.045894  8358 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:12.055693  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:12.059065  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 92043.8us
I20260709 13:02:12.060180  8461 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:12.037451  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:12.066664  8467 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.055330 10514 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:12.066409  8466 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:12.044649 10261 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:12.095383  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 49595.9us
I20260709 13:02:12.096122  8462 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:02:12.093748 10644 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.076s	user 0.004s	sys 0.000s
I20260709 13:02:12.099361  8358 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:12.046484 10296 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.106540  8507 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:12.107267  8467 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:12.060622 10487 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:12.095885 10514 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.111552 10261 raft_consensus.cc:697] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:12.119837 10261 consensus_queue.cc:237] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.099779 10413 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:12.023398 10034 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.105469  8293 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 4 to 5, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 5 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.111454 10576 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:12.110309 10296 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.142906 10612 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:12.143564 10612 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.143991 10612 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.056732 10159 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:12.186058  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:12.193495  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:12.195137  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:12.197165  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 68995.1us
I20260709 13:02:12.197903  8536 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:12.195395  8466 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:12.124243 10514 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.197110  8462 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:12.198469  8466 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:12.198134  8507 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:12.199332  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.199544  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:12.200734 10609 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:12.187156  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.201254  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.202030  8542 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:12.202338  8536 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:12.123760 10487 raft_consensus.cc:697] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:12.207216  8541 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:12.208410  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1304) took 1323 ms. Trace:
I20260709 13:02:12.211189  8386 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:12.136240 10576 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:12.214010  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:12.214251  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.214941  8470 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:12.216007  8507 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:12.216568  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.219614  8386 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:12.210600  8393 rpcz_store.cc:276] 0709 13:02:10.885228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.808279 (+923051us) service_pool.cc:224] Handling call
0709 13:02:11.809700 (+  1421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.893310 (+ 83610us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:11.912259 (+ 18949us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.963816 (+ 51557us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.969019 (+  5203us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.969191 (+   172us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:11.969240 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.987765 (+ 18525us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b54001185d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:11.987812 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.196734 (+208922us) raft_consensus.cc:1685] finished
0709 13:02:12.208205 (+ 11471us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.208348 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18436,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1145,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":5242,"spinlock_wait_cycles":191466368,"thread_start_us":69736,"threads_started":2,"wal-append.queue_time_us":91184}
I20260709 13:02:12.205262  8462 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:12.224337  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.224754  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.204457  8466 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.225991  8466 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.173012 10413 raft_consensus.cc:697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:12.186232 10446 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:12.227972  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:12.228650  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.229071  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:12.229596  8390 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.229777  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:12.230404  8388 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.236706  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.236876  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.230400  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.237546  8393 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:12.230269  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.237538  8392 raft_consensus.cc:1813] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Handling vote request from an unknown peer d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:12.238770  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:12.239315  8392 raft_consensus.cc:2368] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:12.238642  8470 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:12.241017  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:12.247193  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.248780  8508 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:12.250610  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.250939  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.220407 10576 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.252934  8293 catalog_manager.cc:5697] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 2 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 3 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.269101  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.254684  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.249961 10446 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:12.322961  8390 raft_consensus.cc:2410] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:12.227383 10369 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.334542 10063 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:12.241328 10151 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:12.342092 10159 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:12.291373  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.195598 10406 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:02:12.255489 10487 consensus_queue.cc:237] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.251353  8542 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:12.223977 10385 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:12.212253 10549 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.345257 10446 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.346325 10063 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:12.338063  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.326051  8470 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:02:12.259927  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.334955  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:12.367064  8539 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.367089  8389 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:12.367838  8388 raft_consensus.cc:2410] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:12.346139  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:12.305558  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 56884.5us
I20260709 13:02:12.305146  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.370440  8461 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:12.370795  8508 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:12.372439  8293 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 4 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.357961  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.374637  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.349644 10406 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:12.258548 10596 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:12.361641  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:12.368232  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.375864  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.376188  8389 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:12.366528 10151 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.379909  9069 raft_consensus.cc:2393] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:12.380425  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.381255  8389 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:12.357228  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.384684  8390 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 2.
I20260709 13:02:12.249120 10484 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:12.368508  8393 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:12.370870  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.335963 10550 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.377022  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:12.315145  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:12.346808 10413 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.388932  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.550354  8466 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:12.567340  8388 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:02:12.443310  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.467955  8539 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:12.366168 10330 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.366345 10445 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:02:12.511328  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.565429  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 203900us
I20260709 13:02:12.569284  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.574090  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.372771 10063 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.566485  8470 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
W20260709 13:02:12.555670  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 333168us
I20260709 13:02:12.379454 10596 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:12.547654 10653 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:02:12.594441 10330 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:12.599485  8469 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.010s
I20260709 13:02:12.388929 10406 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:12.423483 10369 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.390595 10159 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:12.380121 10549 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.604079  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:12.516175 10497 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:12.395576 10572 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:12.607390  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:12.472510  8565 debug-util.cc:398] Leaking SignalData structure 0x7b0800137c80 after lost signal to thread 7286
I20260709 13:02:12.389130 10484 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:12.569907 10151 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:12.610766  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:12.853085  8467 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:12.853799  8390 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:12.860881  8469 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.010s	sys 0.026s
W20260709 13:02:12.839437  9033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.001s	sys 0.033s
W20260709 13:02:12.864141  9033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.001s	sys 0.034s
W20260709 13:02:12.864471  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 676517us
I20260709 13:02:12.868845  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.876264  8508 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:12.877974  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:12.869210  8433 connection.cc:256] RPC call timeout handler was delayed by -1.1376836099999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:02:12.880728  8433 connection.cc:256] RPC call timeout handler was delayed by -1.1277836099999377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:02:12.832940 10649 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
W20260709 13:02:12.881160  8433 connection.cc:256] RPC call timeout handler was delayed by -1.0206836099999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 13:02:12.798048 10261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.030s
I20260709 13:02:12.886785  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:12.781196 10628 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:02:12.887938  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.893919  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.895430  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:12.896122  8393 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.900864  8390 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:12.853703 10484 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.823452 10446 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:12.874696 10151 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.875361 10034 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.889900 10261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.019s	sys 0.032s
I20260709 13:02:12.914084  8393 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:12.928162  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.628322 10445 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.884626 10482 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:12.891069 10408 consensus_meta.cc:287] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.934s	user 0.010s	sys 0.007s
I20260709 13:02:12.621237 10385 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.289s
W20260709 13:02:12.937420  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 340361us
I20260709 13:02:12.654461 10612 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:12.934784 10666 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:02:12.919374  8565 debug-util.cc:398] Leaking SignalData structure 0x7b08000a23c0 after lost signal to thread 8327
I20260709 13:02:12.910142 10369 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:12.932704  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:12.875437 10572 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.874696 10497 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.916538  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:12.949635  8390 raft_consensus.cc:2393] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:02:12.942067 10656 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:02:12.947106  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.946834 10369 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:12.938748 10482 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:12.950793  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:12.958575  8390 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:12.940793 10408 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:12.963632  8465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.037s
I20260709 13:02:12.952891 10504 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:12.953137 10572 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:12.939203 10397 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:02:12.929934 10151 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:12.934298 10034 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:12.953352  8565 debug-util.cc:398] Leaking SignalData structure 0x7b080038daa0 after lost signal to thread 8419
W20260709 13:02:12.939119  8359 leader_election.cc:336] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.611s (SENT)
I20260709 13:02:12.964129  8390 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:12.957779 10550 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:13.006946  8465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.011s	sys 0.037s
I20260709 13:02:12.959203 10369 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.960547 10482 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:13.069734  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 198381us
I20260709 13:02:13.071522  9069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58882 (request call id 69) took 1056 ms. Trace:
I20260709 13:02:12.938524 10406 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.073067  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.079281  9069 rpcz_store.cc:276] 0709 13:02:12.015519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.015666 (+   147us) service_pool.cc:224] Handling call
0709 13:02:13.071260 (+1055594us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540034bcd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:13.071454 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835323264}
W20260709 13:02:13.083029 10662 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:02:13.086123 10330 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:13.087945 10296 consensus_meta.cc:287] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.908s	user 0.009s	sys 0.001s
I20260709 13:02:13.088438 10296 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.090621 10445 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.091953 10612 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.093364 10497 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:13.103202  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.103809 10576 consensus_meta.cc:287] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.731s	user 0.005s	sys 0.006s
I20260709 13:02:13.104316 10576 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.105537  8392 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:13.106465 10549 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:13.108692 10514 consensus_meta.cc:287] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.000s
W20260709 13:02:13.110934  8565 debug-util.cc:398] Leaking SignalData structure 0x7b08002907a0 after lost signal to thread 8494
W20260709 13:02:13.112428  8565 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7d40 after lost signal to thread 8568
W20260709 13:02:13.112776  8565 debug-util.cc:398] Leaking SignalData structure 0x7b0800345b60 after lost signal to thread 8569
I20260709 13:02:13.118824 10408 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.126559 10406 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.097106 10034 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.099267 10151 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:13.142956  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 203878us
W20260709 13:02:13.084583 10664 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:02:13.152815  8359 leader_election.cc:336] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.614s (SENT)
I20260709 13:02:13.109191 10514 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.148295 10572 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:13.157662  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 294550us
I20260709 13:02:13.153589  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.177202  8507 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:13.187448  8394 raft_consensus.cc:2368] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7.
I20260709 13:02:13.187124  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:13.189626  8507 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.191030  8507 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:13.156435  8565 debug-util.cc:398] Leaking SignalData structure 0x7b08001d69c0 after lost signal to thread 9093
W20260709 13:02:13.194417  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 316537us
I20260709 13:02:13.176131 10413 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:13.220845  8464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.025s
W20260709 13:02:13.221308  8464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.000s	sys 0.025s
I20260709 13:02:13.164634 10159 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:13.186760 10548 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.196978  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:13.217563  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.017s
I20260709 13:02:13.181463 10385 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:02:13.188803 10504 consensus_queue.cc:1059] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:02:13.245972 10413 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.256562  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.017s
I20260709 13:02:13.311537 10547 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:13.319144 10487 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:13.342931 10296 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.357012 10547 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.350098 10550 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.350327 10479 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:13.339023 10413 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.376729 10679 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:13.395071 10547 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.395731 10683 raft_consensus.cc:3055] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:13.396584 10550 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:13.378612 10159 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.378957 10487 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:13.475881 10063 consensus_meta.cc:287] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.001s
I20260709 13:02:13.403251 10514 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.404974 10550 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.493042 10661 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:13.406492 10681 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:02:13.474182  9067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 55) took 1340 ms. Trace:
I20260709 13:02:13.494421 10661 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:13.496982 10413 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.403594 10683 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:13.500905 10487 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:13.500267 10683 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.400220 10679 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:13.456117  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 265037us
I20260709 13:02:13.502348 10679 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.445030  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1329) took 1213 ms. Trace:
I20260709 13:02:13.503355  8393 rpcz_store.cc:276] 0709 13:02:12.231553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.960942 (+729389us) service_pool.cc:224] Handling call
0709 13:02:12.962732 (+  1790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.962890 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:12.964469 (+  1579us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.314123 (+349654us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b18003c9880. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a 00007fbe134f1a2a
0709 13:02:13.443609 (+129486us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.443787 (+   178us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:13.443961 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.444171 (+   210us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.444649 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1509,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":8752,"raft.queue_time_us":38984,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":448,"spinlock_wait_cycles":116233984,"thread_start_us":128611,"threads_started":1,"wal-append.queue_time_us":400287}
I20260709 13:02:13.495334  9067 rpcz_store.cc:276] 0709 13:02:12.043073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.045426 (+  2353us) service_pool.cc:224] Handling call
0709 13:02:12.185431 (+140005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.211548 (+ 26117us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:12.649580 (+438032us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.343644 (+694064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.349855 (+  6211us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:13.353986 (+  4131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.374464 (+ 20478us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.382949 (+  8485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26858,"prepare.queue_time_us":735828,"prepare.run_cpu_time_us":2659,"prepare.run_wall_time_us":41177,"raft.queue_time_us":236300,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8238,"thread_start_us":963161,"threads_started":2}
I20260709 13:02:13.506505  8507 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.509859 10479 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:13.511617  8394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1325) took 1281 ms (client timeout 1683 ms). Trace:
W20260709 13:02:13.464664  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 268637us
W20260709 13:02:13.455555  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 257513us
I20260709 13:02:13.525312 10479 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:13.512230  8394 rpcz_store.cc:269] 0709 13:02:12.230395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.230507 (+   112us) service_pool.cc:224] Handling call
0709 13:02:13.511046 (+1280539us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400049554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:13.511362 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184735360}
W20260709 13:02:13.436019  8359 leader_election.cc:336] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.811s (SENT)
I20260709 13:02:13.530900  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1321) took 1301 ms. Trace:
I20260709 13:02:13.532562  8395 rpcz_store.cc:276] 0709 13:02:12.229276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.233926 (+  4650us) service_pool.cc:224] Handling call
0709 13:02:12.309999 (+ 76073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.427350 (+117351us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:12.516082 (+ 88732us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.885016 (+368934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.885071 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:12.885111 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.502419 (+617308us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540024a254. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:13.502497 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.502799 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":559,"prepare.queue_time_us":95183,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":47294,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"spinlock_wait_cycles":286342400,"thread_start_us":367950,"threads_started":1,"wal-append.queue_time_us":428277}
I20260709 13:02:13.534286  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:13.535125 10487 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.536020 10487 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.540786 10548 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.541949  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:13.543358  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 107738us
W20260709 13:02:13.544154  8359 leader_election.cc:336] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.862s (SENT)
I20260709 13:02:13.544706  8359 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.545965 10683 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.546566 10514 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.547626 10514 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.532981  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:13.561589 10487 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.467674  9064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58874 (request call id 96) took 1741 ms. Trace:
W20260709 13:02:13.571877  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.577457 10684 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:13.579692 10479 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.585856 10547 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.588343 10684 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.589195 10547 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.590035 10482 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.590276 10479 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:13.594415  8392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1338) took 1356 ms (client timeout 1701 ms). Trace:
W20260709 13:02:13.620452  8392 rpcz_store.cc:269] 0709 13:02:12.238326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.246954 (+  8628us) service_pool.cc:224] Handling call
0709 13:02:13.594061 (+1347107us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54003c8054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:13.594233 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734252928}
I20260709 13:02:13.596031 10479 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.597993 10482 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.582064 10548 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:13.493304 10063 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.592512 10684 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.595386  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:13.625941 10576 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:13.633555  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 89527.9us
I20260709 13:02:13.623698 10548 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.599850  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:13.655431  8536 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
I20260709 13:02:13.641021 10548 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.662556  8387 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.664808 10550 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.668306  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:13.668627  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.668918  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.669893  8540 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
W20260709 13:02:13.661572  8359 leader_election.cc:336] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.872s (SENT)
I20260709 13:02:13.672734  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:13.674237  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:13.674588  8539 raft_consensus.cc:2393] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:13.680044  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1394) took 1475 ms. Trace:
I20260709 13:02:13.669078 10550 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.689183  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.692945  8544 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:13.694551  8508 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:13.695628 10684 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:13.695776  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1385) took 1656 ms. Trace:
I20260709 13:02:13.696146 10684 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.696749 10684 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.582628  9064 rpcz_store.cc:276] 0709 13:02:11.726313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.726555 (+   242us) service_pool.cc:224] Handling call
0709 13:02:11.726941 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.727185 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:12.185203 (+458018us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.257498 (+1072295us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.466787 (+209289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.466906 (+   119us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:13.467057 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.467189 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.467434 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21704,"prepare.queue_time_us":40492,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":343635,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":7626,"thread_start_us":1110738,"threads_started":4,"wal-append.queue_time_us":637579}
I20260709 13:02:13.701668  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:02:13.710843  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 52486.1us
W20260709 13:02:13.720672 10484 consensus_meta.cc:287] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.792s	user 0.002s	sys 0.017s
I20260709 13:02:13.720954 10034 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.721097 10484 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:13.705907  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 796514us
W20260709 13:02:13.705978 10625 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.590s	user 0.002s	sys 0.033s
I20260709 13:02:13.723924 10548 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.725042  8387 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:13.712960  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1324) took 1482 ms. Trace:
W20260709 13:02:13.724877 10625 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.660s	user 0.002s	sys 0.034s
I20260709 13:02:13.712073  8507 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.766980  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1322) took 1537 ms. Trace:
I20260709 13:02:13.765743 10683 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.769208 10683 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:13.769820 10683 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:13.705773 10406 consensus_meta.cc:287] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.010s
W20260709 13:02:13.765616 10646 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.509s	user 0.010s	sys 0.021s
W20260709 13:02:13.774109 10646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.638s	user 0.010s	sys 0.021s
W20260709 13:02:13.774372  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.767390  8387 rpcz_store.cc:276] 0709 13:02:12.229549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.234015 (+  4466us) service_pool.cc:224] Handling call
0709 13:02:13.599348 (+1365333us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:02:13.766919 (+167571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3745536}
I20260709 13:02:13.715998 10691 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:13.776883  8544 raft_consensus.cc:1240] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:13.716846 10487 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.710575 10608 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.740670 10484 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.696575  8465 rpcz_store.cc:276] 0709 13:02:12.039166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.039770 (+   604us) service_pool.cc:224] Handling call
0709 13:02:12.040005 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.040168 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:12.437671 (+397503us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.694847 (+1257176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.694972 (+   125us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:13.695059 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.695213 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.695467 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664621,"prepare.queue_time_us":214385,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"thread_start_us":988933,"threads_started":3,"wal-append.queue_time_us":663100}
I20260709 13:02:13.714051 10616 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:13.717926 10063 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.786051 10414 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:13.793371 10369 consensus_meta.cc:287] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.010s
I20260709 13:02:13.795169 10497 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.795845 10497 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.706887 10679 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.680580  8462 rpcz_store.cc:276] 0709 13:02:12.203883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.204631 (+   748us) service_pool.cc:224] Handling call
0709 13:02:12.204952 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.205149 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:12.357751 (+152602us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.863645 (+505894us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.670251 (+806606us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b18001f2b80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa522 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:13.678835 (+  8584us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18001f2b80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe10374c0a 00007fbe19ab4219 00007fbe103fca40 00007fbe103f74e4 00007fbe103f7455 00007fbe134df060 00007fbe134f1716 00007fbe13502287 00007fbe13502208
0709 13:02:13.679161 (+   326us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.679274 (+   113us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:13.679358 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.679509 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.679755 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5671,"prepare.queue_time_us":3714,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":23698,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13898,"spinlock_wait_cycles":54016512,"thread_start_us":481698,"threads_started":1,"wal-append.queue_time_us":591673}
W20260709 13:02:13.810027  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 98071.2us
I20260709 13:02:13.709388 10684 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:13.806885 10672 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.841s	user 0.006s	sys 0.004s
I20260709 13:02:13.810766 10679 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:13.820667  8359 leader_election.cc:336] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.002s (SENT)
I20260709 13:02:13.822220 10487 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.809645 10369 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.843098  8539 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:13.788161 10691 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 5 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:13.844133 10487 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:13.822549  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 224167us
I20260709 13:02:13.844904 10691 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:13.824179  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 99710.9us
I20260709 13:02:13.847893 10369 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.848959 10497 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.855252 10497 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.855974 10497 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.859543 10497 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.833622 10661 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.877234  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:13.878618  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1407) took 1298 ms. Trace:
I20260709 13:02:13.879176  8466 rpcz_store.cc:276] 0709 13:02:12.590066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.590235 (+   169us) service_pool.cc:224] Handling call
0709 13:02:12.590601 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.963775 (+373174us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:13.006276 (+ 42501us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.762942 (+756666us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.763051 (+   109us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:13.763170 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.878082 (+114912us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400238554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:13.878139 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.878376 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459191,"prepare.queue_time_us":50083,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":539576,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":857823488,"thread_start_us":290041,"threads_started":2,"wal-append.queue_time_us":388765}
I20260709 13:02:13.882211  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:13.833778 10684 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.721707 10034 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.899933 10034 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:13.837081  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.904471  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:13.905333  8462 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:13.907088  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:13.836429  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.758944  8391 rpcz_store.cc:276] 0709 13:02:12.230121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.230487 (+   366us) service_pool.cc:224] Handling call
0709 13:02:12.236762 (+  6275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.236955 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:12.270917 (+ 33962us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.592678 (+1321761us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b18003e4b20. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a 00007fbe134f1a2a
0709 13:02:13.712239 (+119561us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.712441 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.712502 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:13.712560 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.712651 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.712801 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123438,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":11778,"raft.queue_time_us":5246,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":20643,"spinlock_wait_cycles":96251904,"thread_start_us":50810,"threads_started":1,"wal-append.queue_time_us":1391299}
I20260709 13:02:13.840847  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:13.912212  8461 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:13.800367 10616 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:13.914892 10616 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.850061 10705 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:13.852370  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.852792  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:13.916965  8387 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:13.847904  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:13.917349  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:13.918251 10063 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:13.918685  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 70939.7us
I20260709 13:02:13.918991 10063 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.919829 10705 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:13.920231  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:13.918267  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1406) took 1469 ms. Trace:
I20260709 13:02:13.920821 10705 consensus_queue.cc:1059] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:13.828586 10621 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.922219 10709 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.921007  8464 rpcz_store.cc:276] 0709 13:02:12.449316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.568144 (+118828us) service_pool.cc:224] Handling call
0709 13:02:12.606027 (+ 37883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.606216 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:12.661233 (+ 55017us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.801982 (+1140749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.862656 (+ 60674us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:13.917858 (+ 55202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.917955 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.918098 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":513692,"prepare.queue_time_us":72565,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":35,"raft.queue_time_us":576360,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"spinlock_wait_cycles":28032,"thread_start_us":621696,"threads_started":2,"wal-append.queue_time_us":680316}
I20260709 13:02:13.922174 10621 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.922936 10683 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.923448 10705 raft_consensus.cc:3055] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:13.923844 10705 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:13.924333 10549 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.829195 10704 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:13.924897 10621 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.925253 10704 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.927083  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:13.871147  8289 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 4 to 6, term changed from 3 to 5, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to <none>, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 5 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:13.921939  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1378) took 1774 ms. Trace:
I20260709 13:02:13.922825 10709 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:13.931310  9032 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:13.801570  8542 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:13.928995  8509 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.927824 10704 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:13.828058  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.933828  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 1006) took 1497 ms. Trace:
I20260709 13:02:13.934962 10369 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.935184  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.935488 10704 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.935949  8536 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:02:13.935402  8289 catalog_manager.cc:5697] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 2 to 4, term changed from 3 to 6, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.924870 10549 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.936748  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:13.937183  8539 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.938845 10549 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.939254 10034 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.933640 10709 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.937669  8289 catalog_manager.cc:5697] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 2 to 4, term changed from 4 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:13.942340  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:13.943339 10704 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:13.947356 10548 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.947583  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.948397  8536 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 3: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:13.949337  9032 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.949906  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:13.950464 10616 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:13.950870 10616 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:13.951229 10616 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.951396  8536 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:13.951702 10063 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.953925 10683 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:13.953730  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.955178  8536 raft_consensus.cc:2393] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:13.955052  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.956187  8540 raft_consensus.cc:2410] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:02:13.956254  8359 leader_election.cc:336] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.917s (SENT)
I20260709 13:02:13.954685 10704 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:13.956905  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.958283  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.933383  8469 rpcz_store.cc:276] 0709 13:02:12.035890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.037171 (+  1281us) service_pool.cc:224] Handling call
0709 13:02:12.037434 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.037604 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:12.863196 (+825592us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.765485 (+902289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.775300 (+  9815us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:13.778332 (+  3032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.787003 (+  8671us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.810155 (+ 23152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":560139,"prepare.queue_time_us":216775,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":648722,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":1134746,"threads_started":3,"wal-append.queue_time_us":370196}
I20260709 13:02:13.958889  8540 raft_consensus.cc:1813] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Handling vote request from an unknown peer d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:13.959028  8359 leader_election.cc:336] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.968s (SENT)
I20260709 13:02:13.959431  8540 raft_consensus.cc:2368] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:13.959470  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:13.924876 10705 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:13.960422 10487 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.960527 10609 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:13.960738 10705 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.934198  8542 rpcz_store.cc:276] 0709 13:02:12.434975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.671870 (+1236895us) service_pool.cc:224] Handling call
0709 13:02:13.932618 (+260748us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.962613  8544 raft_consensus.cc:2410] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:13.963979  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:13.957152  8539 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:13.970158  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.968719  8289 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 2 to 6, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 6 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.973127  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:13.974665  8536 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:13.973861  8466 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:13.977236  8542 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:13.988289  8544 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:02:13.990932  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:13.991731  8542 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:13.992395  8541 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
W20260709 13:02:13.995894  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 161141us
I20260709 13:02:13.999372 10383 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.999821 10383 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:14.000254 10383 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:14.004441  8293 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 158) took 19202 ms (client timeout 15000 ms). Trace:
I20260709 13:02:14.006889  8544 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:14.004901  8293 rpcz_store.cc:269] 0709 13:01:54.802201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.802442 (+   241us) service_pool.cc:224] Handling call
0709 13:02:14.004161 (+19201719us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:13.078726 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:13.115768 (+ 37042us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:13.115812 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:02:13.115836 (+    24us) tablet.cc:662] Decoding operations
0709 13:02:13.116589 (+   753us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:13.116661 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:13.116704 (+    43us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:13.117195 (+   491us) tablet.cc:701] Row locks acquired
0709 13:02:13.117216 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:13.117408 (+   192us) write_op.cc:270] Start()
0709 13:02:13.117547 (+   139us) write_op.cc:276] Timestamp: P: 1783602133117350 usec, L: 0
0709 13:02:13.117572 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:13.195601 (+ 78029us) log.cc:844] Serialized 1693 byte log entry
0709 13:02:13.411576 (+215975us) op_driver.cc:464] REPLICATION: finished
0709 13:02:13.626883 (+215307us) write_op.cc:301] APPLY: starting
0709 13:02:13.627062 (+   179us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:13.627311 (+   249us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:13.627469 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:13.692168 (+ 64699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:13.800159 (+107991us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:02:13.802382 (+  2223us) write_op.cc:312] APPLY: finished
0709 13:02:13.802864 (+   482us) log.cc:844] Serialized 40 byte log entry
0709 13:02:13.803102 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:13.803319 (+   217us) write_op.cc:454] Released schema lock
0709 13:02:13.803391 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:13.803909 (+   518us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:13.803936 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":168426,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":214883,"apply.run_cpu_time_us":4332,"apply.run_wall_time_us":177089,"num_ops":4,"prepare.queue_time_us":281721,"prepare.run_cpu_time_us":79672,"prepare.run_wall_time_us":346106,"raft.queue_time_us":922,"raft.run_cpu_time_us":9028,"raft.run_wall_time_us":220408,"replication_time_us":293862,"thread_start_us":437959,"threads_started":4,"wal-append.queue_time_us":200730}]]}
I20260709 13:02:13.995898  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:13.986332  8289 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 4 to 5, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 5 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:14.012362  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.015293  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.018579  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.020596  8539 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:02:14.021220  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 71543.2us
I20260709 13:02:13.997967 10683 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:14.025346  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.029518  8536 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.031327  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.040688  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:14.041363  8542 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.042006  8539 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:14.038887  8507 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:14.027283 10683 raft_consensus.cc:697] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.052742  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.058163  8544 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:14.059496 10684 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.072746  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.074366  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.081552  8539 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:14.096241 10683 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.097431  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.098282  8468 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:14.099943  8359 leader_election.cc:336] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.025s (SENT)
I20260709 13:02:14.100449  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:14.102101  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 63093.2us
W20260709 13:02:14.105355  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 74350.1us
I20260709 13:02:14.097684 10709 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.106226  8507 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:14.108692 10684 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:14.109030  8507 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:14.109176 10684 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:14.093144  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.103437  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:14.113607  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:14.169885  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 60976.4us
I20260709 13:02:14.153064  8542 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:14.159624  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:14.126086  8359 leader_election.cc:336] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.171s (SENT)
I20260709 13:02:14.148543 10609 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.123590  8544 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:14.135025  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.122517 10684 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:14.135666  8536 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:14.128358 10608 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:14.155952  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.128705  8358 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:14.126065 10548 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:14.159420  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.173183  8464 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.174753  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.155244 10709 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.173631  8539 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:14.176476  8542 raft_consensus.cc:1275] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:02:14.180907  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.180599  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:14.189919  8468 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:14.197062  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:14.197737  8542 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.200256  8462 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:14.203670 10616 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:14.206073 10548 raft_consensus.cc:697] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.207238 10548 consensus_queue.cc:237] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.209317  8462 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:14.209702  8542 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:14.210168  8465 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.214831 10608 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.214933  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.215659 10608 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.216296  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.218276  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.218967  8539 raft_consensus.cc:2393] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:02:14.226202  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 50214.9us
I20260709 13:02:14.228407  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.232894  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:14.234007  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 130716us
I20260709 13:02:14.235332  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:14.238759 10621 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.238909  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.239575  8469 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.239961  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:14.240538  8540 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:14.233579  8387 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.243062 10383 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:14.244876  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.246330  8465 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:14.191665 10705 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.247471  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.252607 10487 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.254433  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:14.254981  8540 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.256697  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.256578 10646 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:14.257341  8470 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:14.245535 10383 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.258322  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.258883  8466 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.239544 10621 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:02:14.263098  8507 leader_election.cc:400] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7.
I20260709 13:02:14.262789 10547 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:14.263444  8507 leader_election.cc:403] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.264869  8507 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:14.264971 10547 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7.
I20260709 13:02:14.266258  9064 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:14.269560 10621 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:14.270466 10621 raft_consensus.cc:3055] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:14.270783 10621 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:14.271749  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.271683 10621 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:14.272399  8467 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:14.272872 10621 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.274704  8462 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:14.274832  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.275185 10679 raft_consensus.cc:2764] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:14.261042  8387 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
I20260709 13:02:14.248127  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:14.284063  8540 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:14.284752  8544 raft_consensus.cc:2368] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.281486  8462 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:14.285459  9032 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:14.292550  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.293677  8462 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.293839  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.295291 10383 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:14.314855  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 186378us
I20260709 13:02:14.319244  8465 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:14.323351  8433 leader_election.cc:400] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:14.323750  8433 leader_election.cc:403] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.319458 10383 raft_consensus.cc:697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:14.322127  8358 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.339427  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:14.340764  8469 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:02:14.344063  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.338824 10487 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:14.328644 10616 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.352995  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.354007  8508 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.377250  8462 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
W20260709 13:02:14.359637  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 234175us
I20260709 13:02:14.353336 10487 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.388149  8387 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:14.389320  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:14.352954 10383 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:14.400050  8359 leader_election.cc:336] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.246s (SENT)
I20260709 13:02:14.385533 10609 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.389353 10487 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.405965 10609 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.411811  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.418042  8466 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:14.401449 10625 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.417918 10609 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.389249 10721 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:02:14.430667  8508 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.434542  9033 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.437354 10612 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.428248 10034 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:14.433320 10639 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.422487 10691 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:02:14.437868 10612 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.453681 10482 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:14.453121 10034 raft_consensus.cc:697] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:14.466190 10616 raft_consensus.cc:2804] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:14.474618  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.466979 10612 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.475492  8358 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.468451 10721 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:14.479637  8359 leader_election.cc:336] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.196s (SENT)
I20260709 13:02:14.474377 10482 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:14.496234  8359 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.442s (SENT)
I20260709 13:02:14.496958  8359 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:14.494444 10722 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.498586 10722 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.499104 10722 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.486069 10625 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:14.498612 10719 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.106s	user 0.003s	sys 0.000s
I20260709 13:02:14.502120 10625 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.503479 10625 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.506248 10034 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.511910  8358 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:14.514058 10608 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.516794  8358 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.518021 10608 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.518857 10608 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:14.519421 10608 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:14.520464 10608 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.522461  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.523686  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.524061  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.524274  8468 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:14.525424  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.525584  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.526265  8462 raft_consensus.cc:2410] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:14.526113  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.535709  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.492372 10482 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.485816 10616 raft_consensus.cc:697] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:14.543079  8469 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:14.544024  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.544646  8467 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:14.545120  8466 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.544169  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.546972  8468 raft_consensus.cc:1240] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:14.548808  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 52694.9us
W20260709 13:02:14.549135  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 170136us
I20260709 13:02:14.551151  8462 raft_consensus.cc:2368] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.552579  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.557165  8470 raft_consensus.cc:2368] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9.
I20260709 13:02:14.559849  8469 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:14.493299 10684 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.491392 10721 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:14.564221  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 109399us
I20260709 13:02:14.573076  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.573772  8468 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:14.580615  8469 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:14.585856  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.586472  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.586475  8469 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.590266 10722 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.591755  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.592404  8470 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:14.592758 10722 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.594252  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.594415  8466 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:14.595359  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.595505  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.595875  8462 raft_consensus.cc:2376] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7. Re-sending same reply.
I20260709 13:02:14.596714  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.597409  8466 raft_consensus.cc:2368] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:14.597564  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.597818  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.598278  8468 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.598119  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.598919  8465 raft_consensus.cc:2393] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:14.599851  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.602123  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.602913  8462 raft_consensus.cc:2393] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.593559  8470 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:14.614223 10694 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:02:14.615012 10684 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:14.615832  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.616577  8463 raft_consensus.cc:2368] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.603358 10721 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.625036 10616 consensus_queue.cc:237] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:14.626597  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.627822  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.628878  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.629583  8467 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:14.644585  8469 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:14.645536  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.653540  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.654124  8467 raft_consensus.cc:2410] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:14.654175  8466 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:14.608794 10625 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.647701 10487 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.649101 10482 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.650242 10639 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:14.650782  8508 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:14.652513  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 88624.3us
I20260709 13:02:14.662190  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.664047  8508 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.664326 10684 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:14.664932 10684 raft_consensus.cc:697] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.665223 10548 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:14.665875 10548 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.666285 10683 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:14.665993 10684 consensus_queue.cc:237] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.666782 10683 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.667061 10625 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.667763 10683 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.664350 10487 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.670259 10548 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.671537  8358 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.672410 10612 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.670735 10482 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:14.671627  8508 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.677019  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.678763  8508 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.679741  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:14.679958  8359 leader_election.cc:336] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.565s (SENT)
I20260709 13:02:14.679459 10549 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:14.681500 10549 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.681990 10727 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.682440 10727 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:14.682821 10727 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.682011 10549 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.687463  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.687717  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.688350  8468 raft_consensus.cc:2410] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:14.688457  8470 raft_consensus.cc:2368] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3.
I20260709 13:02:14.688694  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.688354  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.689709  8461 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.689998  8508 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.693648  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.694410  8465 raft_consensus.cc:2393] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.695617  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.696270  8466 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.697376  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.697675  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.699957  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:14.700124  8359 leader_election.cc:336] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.674s (SENT)
I20260709 13:02:14.702538  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.704005  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.707700  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.708024  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.708775  8461 raft_consensus.cc:2368] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.708884  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.709877 10063 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:14.710093  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.699716 10609 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.710541 10063 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.711501 10063 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.713773  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.695674 10608 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:14.714829  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:14.716456  9064 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:14.699862 10482 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:02:14.722335 10625 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.722872  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.698750 10547 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:14.726121  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.712718 10609 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.727147  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.728145  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.731628 10612 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:14.733923  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.734618  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.734676  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.735239  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.735445  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:14.739755  8359 leader_election.cc:336] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.529s (SENT)
I20260709 13:02:14.743598  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.769939  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.770820  8469 raft_consensus.cc:2410] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:14.767760  8464 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
W20260709 13:02:14.773553  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 74776.9us
I20260709 13:02:14.776185  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:14.776700  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.776937  8463 raft_consensus.cc:2393] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.778422  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.779352  8462 raft_consensus.cc:2368] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.742990 10608 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:14.774547  8358 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.782783  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.799674  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.782462  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.761139 10487 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.804557  8470 raft_consensus.cc:2368] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.804411  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.806602  8467 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:14.813287  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.780979 10547 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.760772 10625 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.807981 10609 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:14.801134 10608 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.818522 10732 consensus_queue.cc:1059] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:14.788046 10549 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:14.817176  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.826475  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 86782.4us
I20260709 13:02:14.838250  8466 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:14.824486  8467 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:14.828557  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.841317  8470 raft_consensus.cc:2368] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.842031  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:14.843389  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.533s (SENT) [suppressed 41 similar messages]
I20260709 13:02:14.854449  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.856346  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.856600  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.857606  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.857765  8468 raft_consensus.cc:1275] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:02:14.858687  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.859368  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.859903  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.860185  8463 raft_consensus.cc:2410] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:14.861361  8470 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:14.861400 10734 raft_consensus.cc:3055] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:14.862062 10734 raft_consensus.cc:740] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:14.862088  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:14.863188 10735 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:02:14.855717  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.863211 10734 consensus_queue.cc:260] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.865032 10734 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.867015 10625 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:14.846331 10740 consensus_queue.cc:1059] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:02:14.869310 10740 consensus_queue.cc:1243] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer 92314b14f5554885a80c3dc87f4beed4 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:14.869824  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.842248 10609 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:14.870764  8469 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:14.871253 10609 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.874519 10487 consensus_queue.cc:1059] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:14.875835 10487 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:14.876199 10487 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:14.892412 10612 raft_consensus.cc:3055] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:14.892990 10612 raft_consensus.cc:740] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.892746 10487 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.894181 10487 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.894414 10612 consensus_queue.cc:260] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:14.896612 10612 raft_consensus.cc:3060] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.898173  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.899029  8465 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:14.902119  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.913017  8358 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:02:14.911419  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 206287us
I20260709 13:02:14.919663  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:14.923745  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:14.925092  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:14.926874  8359 leader_election.cc:336] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.669s (SENT)
I20260709 13:02:14.927892  8465 raft_consensus.cc:2393] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:02:14.929476  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 54825.9us
I20260709 13:02:14.930919  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:14.934145  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.934798  8465 raft_consensus.cc:2368] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.935324 10730 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:14.935930 10730 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:14.910445 10727 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.939056  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.939903  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.940352  8466 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.941032  8465 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:14.946703 10549 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:14.947036  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.947682  8461 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.949422  8358 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.950037 10734 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.950595  8358 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.950739 10734 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:14.951843 10734 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:14.952167 10734 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.952208  8358 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:14.952930 10732 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:14.953292 10732 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:14.953631 10732 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.954002 10733 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:14.932315 10609 raft_consensus.cc:2764] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:02:14.954468 10733 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:14.955155 10609 consensus_queue.cc:1048] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:14.955541 10733 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.956499 10609 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.957059 10733 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.952553 10734 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.937014 10730 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.919667 10547 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.953720  8358 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.965128 10722 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:14.965672 10722 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:14.966334  8467 raft_consensus.cc:3055] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:14.966742  8467 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:14.966617 10722 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.967664  8467 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:14.968647  8467 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.972944  8466 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:14.979720  8358 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:14.983197  8469 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:14.989024  8358 leader_election.cc:400] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:14.989553  8358 leader_election.cc:403] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.987625  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:14.995358 10609 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.999993 10609 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.000726 10609 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.011847 10609 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.014822  8544 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:15.019919  8467 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:15.020349  8467 pending_rounds.cc:85] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 2
I20260709 13:02:15.020565  8467 pending_rounds.cc:107] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:15.020845  8467 raft_consensus.cc:2889] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.024893  8461 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:15.036468  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.038950  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.026974 10549 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.044884  8540 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:15.052542  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:15.053320  8461 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:15.061347  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:15.092048  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.115433  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.049710 10549 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.097919  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.098770  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.099328 10721 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.099687  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.100589  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.125321  8390 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.125326  8386 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:15.103644  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.103699  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:15.110822  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.126461  8469 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.111068  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:15.114524  8359 leader_election.cc:336] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 3.074s (SENT)
I20260709 13:02:15.114595  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:15.127036  8461 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.128242  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.063508  8387 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:15.117431  8388 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:15.118585  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 57853.2us
I20260709 13:02:15.120040  8463 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:02:15.120317 10756 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:15.120899 10727 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:15.121163 10549 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:15.122952  8464 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:15.100840  8470 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:15.131042  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:15.137872  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.147910  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.133392  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.118244 10679 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.164043  8392 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:02:15.174006  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.176558  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:15.136094 10746 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.182175  8387 raft_consensus.cc:1240] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:15.189117  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:15.192734 10760 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:02:15.194795 10732 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.196112  8386 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:15.196727 10746 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.197427 10732 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:15.169363 10679 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.199719 10746 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:15.201521 10679 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:15.134006 10369 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:02:15.203590  8393 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:15.204296  8461 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
W20260709 13:02:15.204893  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 69687.3us
W20260709 13:02:15.211635  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 77172.1us
I20260709 13:02:15.116511  8544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:15.229044 10609 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:15.230767  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.231681  8469 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:15.230470  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:15.230568  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 175227us
W20260709 13:02:15.237440  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.215690  8544 raft_consensus.cc:606] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:15.250064  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.251797 10732 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.253078  8540 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:15.254053 10608 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.256093 10608 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:15.258033  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 147571us
W20260709 13:02:15.259123 10757 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:15.258958 10763 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:15.259859  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.257915 10729 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:02:15.267421  8387 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:15.271750  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 31) took 1622 ms. Trace:
I20260709 13:02:15.274660  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.202718 10661 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:02:15.280408  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 144014us
I20260709 13:02:15.272145  8289 rpcz_store.cc:276] 0709 13:02:13.649649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.650059 (+   410us) service_pool.cc:224] Handling call
0709 13:02:15.271671 (+1621612us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:14.318373 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:14.333418 (+ 15045us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:14.351082 (+ 17664us) write_op.cc:435] Acquired schema lock
0709 13:02:14.354655 (+  3573us) tablet.cc:662] Decoding operations
0709 13:02:14.451811 (+ 97156us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:14.463438 (+ 11627us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:14.463484 (+    46us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:02:14.464244 (+   760us) tablet.cc:701] Row locks acquired
0709 13:02:14.464298 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:02:14.464480 (+   182us) write_op.cc:270] Start()
0709 13:02:14.464667 (+   187us) write_op.cc:276] Timestamp: P: 1783602134464416 usec, L: 0
0709 13:02:14.464696 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:02:14.484018 (+ 19322us) log.cc:844] Serialized 2205 byte log entry
0709 13:02:14.829092 (+345074us) op_driver.cc:464] REPLICATION: finished
0709 13:02:15.061922 (+232830us) write_op.cc:301] APPLY: starting
0709 13:02:15.062007 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:15.062155 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:15.062286 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:15.123540 (+ 61254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:15.123724 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:02:15.123772 (+    48us) write_op.cc:312] APPLY: finished
0709 13:02:15.124007 (+   235us) log.cc:844] Serialized 46 byte log entry
0709 13:02:15.130017 (+  6010us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:15.161239 (+ 31222us) write_op.cc:454] Released schema lock
0709 13:02:15.165567 (+  4328us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:15.174766 (+  9199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:15.179160 (+  4394us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26568,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":231909,"apply.run_cpu_time_us":3242,"apply.run_wall_time_us":104058,"num_ops":5,"prepare.queue_time_us":166771,"prepare.run_cpu_time_us":6073,"prepare.run_wall_time_us":193305,"replication_time_us":361307,"spinlock_wait_cycles":51968,"thread_start_us":162373,"threads_started":2}]]}
I20260709 13:02:15.283896  8508 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:15.290324  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.292591  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:15.293901  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.295812 10767 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.296345 10767 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:15.299337 10767 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:15.302765  8540 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:15.305092  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.307559  8393 raft_consensus.cc:2368] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
I20260709 13:02:15.304081  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.309746  8394 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:15.312831  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 96119.2us
W20260709 13:02:15.314441  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.313058  8508 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:15.275473 10691 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:02:15.317327  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.293234 10548 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:15.320230  8391 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.342856  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.344360  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.319350 10767 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.347061  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.284304 10734 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.351430  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:15.353847  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.353983 10730 consensus_queue.cc:1059] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.354766 10767 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.355521 10730 raft_consensus.cc:3055] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:15.355907 10730 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:15.356894 10767 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:15.356740 10730 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.319977 10740 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:02:15.359876  9064 consensus_queue.cc:237] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:15.362330 10755 log.cc:927] Time spent T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:02:15.367897  8540 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:15.369274  8536 raft_consensus.cc:1240] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:15.325371 10683 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:15.350363  8508 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:15.373988  8393 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.383055  8388 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:15.398425  8393 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
W20260709 13:02:15.399684  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49406.8us
I20260709 13:02:15.401059  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.401729  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.403468  8390 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:15.404304  8391 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:15.406467  8394 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:15.407727  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:15.408316  8465 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.408320  8466 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:15.408949  8462 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:15.410167  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.410925  8468 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:15.411847 10683 raft_consensus.cc:697] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:15.412999 10683 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.414183 10063 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:15.414701 10063 raft_consensus.cc:697] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:15.415606 10063 consensus_queue.cc:237] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.420028  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.420876  8542 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.426061  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.426764  8388 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:15.432950  8387 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:15.435220  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.436542  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.438233  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.451529  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.453464  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.457595  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.458457  8535 raft_consensus.cc:2410] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:15.459360  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.459811  8470 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:15.460388  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.454856  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.406073 10730 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.461758  8540 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:02:15.464084  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.464383  8463 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:15.468093  8542 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:15.469199  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.473011  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.476366  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.477186  8388 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:15.473096  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.490141  8541 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:15.492347  8465 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:02:15.502918  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.455857 10727 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.508301  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:15.509289  8467 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:15.451607 10548 raft_consensus.cc:697] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:15.490054 10733 consensus_meta.cc:287] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.002s
I20260709 13:02:15.516477  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.519201  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.522207  8393 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.525576  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.526461  8395 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:15.535787  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.536476  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.538151  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.538798  8541 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:15.539491  8538 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:15.543152  8391 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:15.546943  8394 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:15.550858  8290 catalog_manager.cc:5697] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.552986  8389 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:15.552599  8290 catalog_manager.cc:5697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.518482 10727 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.556310 10727 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:15.560524 10721 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:15.563208 10691 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:15.568166  8391 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:15.570729  8395 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:15.584724  8394 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:15.584836  8389 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: [5.3-8.4]
I20260709 13:02:15.586095  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.586793  8390 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:15.588212  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:15.571321  8386 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:15.582628  8388 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:15.596012  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:15.599798  8468 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:15.597625  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:15.591174  8433 connection.cc:256] RPC call timeout handler was delayed by -1.7368214980000403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 13:02:15.606313  8433 connection.cc:256] RPC call timeout handler was delayed by -1.6720214980000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:02:15.606873  8433 connection.cc:256] RPC call timeout handler was delayed by -1.6405214979999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:02:15.607185  8433 connection.cc:256] RPC call timeout handler was delayed by -1.5757214980000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 13:02:15.607569  8433 connection.cc:256] RPC call timeout handler was delayed by -1.5136214980000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 13:02:15.607949  8433 connection.cc:256] RPC call timeout handler was delayed by -1.083421498000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
I20260709 13:02:15.594146  8290 catalog_manager.cc:5697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 5, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 5 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:15.610445  8542 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:15.613371  8393 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:15.614585  8387 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:15.595419 10732 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.619464  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.621508  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:15.625959 10721 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.630302  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:15.639523  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 43595.8us
I20260709 13:02:15.620019 10763 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:02:15.684386  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:15.630055  8290 catalog_manager.cc:5697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 6, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:15.653986  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.607460 10625 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.572254 10767 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:02:15.646395  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:15.687803  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.589972 10487 consensus_queue.cc:1059] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:02:15.602646 10608 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:02:15.693056  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.689232 10748 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:02:15.694047  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.684338 10548 consensus_queue.cc:237] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.696765  8508 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:15.696566  8290 catalog_manager.cc:5697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.697844  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:15.698081  8290 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:15.699178 10727 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:15.699563  8290 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.700532 10727 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:15.702047  8387 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:15.702073 10482 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:15.703416 10482 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:15.704051  8389 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:15.704313 10482 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:15.705492 10781 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:02:15.702082  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 80707.9us
I20260709 13:02:15.700996  8290 catalog_manager.cc:5697] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.706499 10746 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:15.707108 10746 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.707553 10746 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.710640 10612 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:15.711095 10612 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.711444 10612 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.707542  8290 catalog_manager.cc:5697] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 4, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 4 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.730374  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.733206  8387 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:15.719882 10734 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:15.686844 10764 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:02:15.755442  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 49146.7us
W20260709 13:02:15.764710  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.729060 10733 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:02:15.766800  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 145658us
I20260709 13:02:15.768985  8387 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:15.766448  8290 catalog_manager.cc:5697] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 5, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.771198  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:15.780198 10746 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.748799 10748 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:15.824579 10612 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.850610 10748 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.851756  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.852530  8386 raft_consensus.cc:2393] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:02:15.785727  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.855770  9067 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:15.857468  8466 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:02:15.785140 10775 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 13:02:15.789868 10782 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:02:15.790302  8535 raft_consensus.cc:2410] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:15.791042  8390 raft_consensus.cc:1240] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:15.786741  8290 catalog_manager.cc:5697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 5 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:15.859889  8387 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:15.860687  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.860800  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.798405  8393 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:15.861302  8390 raft_consensus.cc:2376] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5. Re-sending same reply.
I20260709 13:02:15.861541  8387 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:15.862214  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.862385  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.863243  8393 raft_consensus.cc:2410] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:15.863682  8390 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:02:15.864513  8393 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:15.799089  8391 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:15.868347 10730 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.776115 10733 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:15.799124  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.862396  8388 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:15.871074  8535 raft_consensus.cc:1240] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:15.870981 10733 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.871735  8543 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:15.872062  8388 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:15.872319 10733 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:15.803897 10784 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:15.874264 10784 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:15.805707  8359 leader_election.cc:400] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:15.734279 10608 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.808198 10791 consensus_queue.cc:1059] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:15.843518  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:15.853518  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:15.879282  8386 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:15.897845  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.898622  8544 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:15.901731  8536 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:02:15.904232  8536 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:15.904948 10746 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:15.692845 10625 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.849474 10767 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:15.917649  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.868875 10730 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:15.799954  8395 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:15.880820 10763 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:15.878710  8392 raft_consensus.cc:2376] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8. Re-sending same reply.
W20260709 13:02:15.882294  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 77347.3us
I20260709 13:02:15.928550  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:15.883705 10791 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:15.853489 10748 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:15.888252  8388 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:15.930750  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.860872  8290 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.894258  8543 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:15.895368  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.935823  8535 raft_consensus.cc:2410] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:15.895627  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.896744  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.937000  8539 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.739166  8389 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
W20260709 13:02:15.907699  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 208912us
I20260709 13:02:15.913144  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.915393  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.939481  8542 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:15.916533  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.852416 10612 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:15.929569  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.931527  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:15.944422  8540 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.947213  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:15.925585 10767 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:15.954344  8290 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.955881  8290 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.965631  8542 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:15.930613 10791 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:15.987078  8507 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:15.998783  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 227663us
I20260709 13:02:16.000666  8290 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 5 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:16.011794  8539 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:15.949162 10608 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:16.029943  8540 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:16.032641  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:16.035104  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:16.039170  8544 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:15.994200 10748 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:02:16.048313  8507 leader_election.cc:400] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
W20260709 13:02:16.048285  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 84513.9us
I20260709 13:02:15.970265 10788 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.048882  8507 leader_election.cc:403] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:02:16.049402  8359 leader_election.cc:400] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:16.028307  8290 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.035898  8536 raft_consensus.cc:606] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.070082 10793 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:16.079569  8394 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:02:16.080020  8394 pending_rounds.cc:85] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 1
I20260709 13:02:16.080267  8394 pending_rounds.cc:107] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:16.080544  8394 raft_consensus.cc:2889] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:16.034279 10683 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:15.993973 10063 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:02:16.092636  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 60142.8us
W20260709 13:02:16.094352  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 46228.8us
I20260709 13:02:16.102958  8359 leader_election.cc:400] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:16.106031  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:16.106669  8464 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.106746  8461 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:16.108382 10608 consensus_queue.cc:1059] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.109200 10608 consensus_queue.cc:1243] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:16.109684 10608 raft_consensus.cc:3055] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:16.110126 10608 raft_consensus.cc:740] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:16.110981 10608 consensus_queue.cc:260] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.112288 10608 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.114517  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.120210  8539 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:16.122102  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:16.123611 10734 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:16.125020  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.129016  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:16.129611  8358 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:16.130152  8461 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.085322 10796 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:16.132187  8433 leader_election.cc:400] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
W20260709 13:02:16.192421  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.130689  8358 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:16.129980  8290 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 6 to 4, term changed from 5 to 3, leader changed from <none> to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196), VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) added, now has a pending config: VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193), VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195), VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 3 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:16.196628 10730 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:16.196866  8290 catalog_manager.cc:5697] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 4 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:16.200345  8290 catalog_manager.cc:5697] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:16.202421  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 77498.4us
I20260709 13:02:16.203161  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.131218 10487 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:16.232921 10487 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:16.100497 10684 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
I20260709 13:02:16.197799 10625 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:16.075704 10767 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.103188 10733 consensus_queue.cc:1059] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:02:16.093536 10791 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.219432  8507 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.220687  8290 catalog_manager.cc:5697] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 5 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:16.080977 10788 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.229516  8461 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:16.135383 10721 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:16.233486 10487 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:02:16.240656  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.263343  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 132743us
I20260709 13:02:16.262970  8290 catalog_manager.cc:5697] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.264950  8358 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:16.135229 10732 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:02:16.273578  8290 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.259904 10790 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.286031  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 158089us
I20260709 13:02:16.289417  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:16.288920  8290 catalog_manager.cc:5697] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.238215 10772 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:02:16.285526 10791 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.207469 10796 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.266203 10734 consensus_queue.cc:1059] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:02:16.271234 10740 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:16.301489 10548 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:16.394546  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 191463us
W20260709 13:02:16.398064  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.403836  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.393266 10798 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:02:16.410398  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:16.408434  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 143546us
I20260709 13:02:16.412930  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:16.423115  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:16.423743  8386 raft_consensus.cc:2376] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6. Re-sending same reply.
I20260709 13:02:16.278633 10790 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.427582  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:16.399052 10734 consensus_queue.cc:1243] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:16.428467  8393 raft_consensus.cc:2393] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:16.426011  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:16.429450  8386 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.430933  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:16.432250  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:16.433543  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:16.434126  8395 raft_consensus.cc:2376] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9. Re-sending same reply.
W20260709 13:02:16.440445  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 221199us
I20260709 13:02:16.422308 10732 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:16.424190 10793 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:16.446146  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:16.446976  8392 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.445115  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:16.441365  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.451952  8464 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:16.453217  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.421303 10625 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:02:16.440649 10733 consensus_queue.cc:1243] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:16.406200 10487 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.501698  8386 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:02:16.507342  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 230974us
I20260709 13:02:16.492756 10806 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:16.492244 10548 raft_consensus.cc:697] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:16.614653  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 173410us
W20260709 13:02:16.618517  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 99108.1us
I20260709 13:02:16.619019  8536 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:16.621019  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:16.639271  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:16.639941  8540 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:16.652848  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 199723us
I20260709 13:02:16.653993  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.611140 10625 consensus_queue.cc:1059] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:02:16.629930 10746 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:16.621227 10721 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:16.685315 10796 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:16.504567 10805 consensus_queue.cc:1059] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.232s
I20260709 13:02:16.628834 10806 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:16.617132 10816 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:16.644446 10817 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:16.689908  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 68982us
I20260709 13:02:16.703012  8540 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
W20260709 13:02:16.716389  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 73560.7us
W20260709 13:02:16.716741  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 64003.9us
I20260709 13:02:16.708314 10805 raft_consensus.cc:3055] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:16.776296  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:16.707297 10746 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:16.693770 10796 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:02:16.714430 10815 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:16.768261 10788 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:16.714586 10824 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:16.805218  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 134353us
I20260709 13:02:16.714357 10733 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 13:02:16.807909 10801 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:02:16.776569 10805 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:16.807797  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:16.814819  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.835690  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:16.790774 10625 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:16.712093 10817 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.809621 10796 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:16.771672 10816 consensus_queue.cc:1059] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:02:16.843250 10809 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 13:02:16.848362 10813 log.cc:927] Time spent T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:02:16.848676 10827 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.849192 10827 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.771111 10548 consensus_queue.cc:237] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.855485  8392 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:16.858042  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:16.861043  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 70711.1us
I20260709 13:02:16.863029  8358 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:16.864053 10822 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:16.857401 10625 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:16.864773 10818 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:16.864872 10827 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:16.865957 10819 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:02:16.842717 10796 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:16.846261 10815 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:16.861008 10816 consensus_queue.cc:1243] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:02:16.873461  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 97764.7us
W20260709 13:02:16.874679  8543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.011s
W20260709 13:02:16.866037 10812 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:02:16.811435 10721 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.877051  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.878654 10818 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.837718 10806 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.857216 10826 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:16.876014 10740 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:16.915066 10740 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:16.846488 10824 consensus_queue.cc:1059] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:02:16.888566  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 44853.6us
I20260709 13:02:16.919013  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:02:16.897918  8543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.004s	sys 0.012s
I20260709 13:02:16.879947 10822 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:16.894218 10816 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:16.927778  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 50811us
I20260709 13:02:16.928723  8359 leader_election.cc:400] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:16.901981 10815 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:16.879839 10805 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.926713 10826 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:16.930840 10820 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:02:16.931705 10740 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:16.935734  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:16.903208 10788 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.895167 10625 consensus_queue.cc:1059] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:02:16.974551  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 111517us
I20260709 13:02:16.976536  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:16.977092  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 48518.7us
I20260709 13:02:16.977367  8540 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:16.883787 10746 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.981725  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:16.962857 10733 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:16.987756 10608 consensus_meta.cc:287] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.004s
I20260709 13:02:16.942557 10796 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:16.990481 10796 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.991832  8394 raft_consensus.cc:1275] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:02:16.992230  8394 pending_rounds.cc:85] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 1
I20260709 13:02:16.992467  8394 pending_rounds.cc:107] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:02:16.992704  8394 raft_consensus.cc:2889] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:16.994364 10817 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.000967 10822 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:17.003602  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 107303us
W20260709 13:02:16.983608  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 62327.4us
I20260709 13:02:16.963572 10815 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:16.985409 10805 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.005538  8507 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.006633  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:17.006649  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:17.009086 10487 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.016256 10487 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.023483 10487 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.024756 10740 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.025682  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.026250 10740 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.028082 10814 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:17.028637 10814 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:17.032372 10834 raft_consensus.cc:3055] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:17.032876 10834 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:17.029628 10814 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.028999 10063 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:02:17.033772 10834 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.028645  8507 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.037545 10832 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.038652  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:17.038745  8507 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.039666 10832 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.041261 10832 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:17.042490 10826 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.043040 10826 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.043386 10826 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.043599 10832 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:17.043735  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:17.044190 10815 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.045753 10063 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.047727  8507 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.048656 10063 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:17.013572 10791 consensus_meta.cc:287] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 13:02:17.049540 10791 consensus_queue.cc:1059] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:17.014662 10816 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:16.982220 10842 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:17.052664 10842 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:17.053647 10842 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.057183 10767 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.058532  8507 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.059744 10832 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:17.060173 10804 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260709 13:02:17.060276 10832 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:16.965217 10788 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.063870 10788 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:17.061630 10832 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.067677 10818 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.057556 10063 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.070170  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:17.072279  8540 raft_consensus.cc:1240] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:17.043742 10826 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:17.073917  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 92276.6us
I20260709 13:02:17.074746  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:17.075402  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.084657  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.008852 10721 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:17.084029  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.086943 10721 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.090762 10721 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.092103  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.093984 10734 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.094820 10734 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:17.095306 10612 raft_consensus.cc:993] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:17.097128  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:17.035036 10834 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.098583  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1493) took 1001 ms. Trace:
I20260709 13:02:17.098806 10063 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.099002  8463 rpcz_store.cc:276] 0709 13:02:16.097430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.098533 (+  1103us) service_pool.cc:224] Handling call
0709 13:02:16.098886 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.403112 (+304226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.403155 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:16.403208 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:16.403254 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.098363 (+695109us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400237b54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:17.098407 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.098529 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699339904}
I20260709 13:02:17.101776  8359 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.102005  8395 raft_consensus.cc:3055] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:17.103946  8395 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:17.105564  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.083861 10818 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.041682 10796 consensus_queue.cc:1059] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:02:17.112183  8391 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:02:17.112888  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.114552  8507 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.115635  8391 pending_rounds.cc:85] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 3
I20260709 13:02:17.116331  8391 pending_rounds.cc:107] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:02:17.116690  8391 raft_consensus.cc:2889] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.122349 10625 raft_consensus.cc:3055] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:17.122978 10625 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:02:17.123090  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.112171 10721 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.088316 10806 consensus_queue.cc:1059] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:02:17.133133  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 127934us
I20260709 13:02:17.117189 10612 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:17.134537  8461 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:17.136590  8507 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:17.140995  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:17.141675  8386 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:17.142777  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:17.124979 10818 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.147727  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:17.148396  8392 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:17.132130 10767 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.145303  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:17.133967 10734 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.139489 10063 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:17.137595 10806 consensus_queue.cc:1243] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:17.156368  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:17.167196 10833 raft_consensus.cc:1081] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:17.172223  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:17.124146 10625 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.176754  8392 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
W20260709 13:02:17.185405 10799 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.986s	user 0.000s	sys 0.006s
I20260709 13:02:17.185508  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:17.186362  8392 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
W20260709 13:02:17.180579  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1606635470000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 13:02:17.192584  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:17.150012 10814 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:17.181378 10734 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.216951  8507 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:17.217336 10547 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.173624 10767 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.190701 10063 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:17.191143 10818 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:17.197749 10849 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:17.274096  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55104.3us
I20260709 13:02:17.257761 10854 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:17.289669  8507 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:17.213287 10625 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.214249 10814 raft_consensus.cc:697] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:17.291477 10854 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:17.299515 10854 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.300006 10679 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.300519 10679 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.300913 10679 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.306456  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:17.259869 10547 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.308765 10839 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.309159 10839 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.309477 10839 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.291878 10369 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.314517 10793 raft_consensus.cc:3055] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:17.315026 10793 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:17.315948 10793 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:17.318235 10856 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:02:17.318863 10063 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.278954  8466 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:17.281056 10482 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:17.342001  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 142452us
W20260709 13:02:17.349540  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.350371  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:17.348217  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:17.351140  8392 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:17.352142  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:17.351341  8542 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:17.353395  8507 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:17.355353  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:17.318300 10805 raft_consensus.cc:2764] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:02:17.288198 10818 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.329409 10482 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.313676 10369 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:17.410257  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 56975.8us
I20260709 13:02:17.415293  8392 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:17.409272  8543 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:17.417604  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:17.419406 10825 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.343297 10857 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:17.293597 10855 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:02:17.419862 10825 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.468056 10825 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.447131 10734 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.343825 10547 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:17.291898 10849 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:17.367007 10487 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:17.430727 10482 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.368574 10846 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:17.340586 10826 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.481427 10814 consensus_queue.cc:237] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.418954  8392 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:17.448421 10857 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:17.542676  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.582762  8544 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:02:17.591863  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 264624us
W20260709 13:02:17.593292  8359 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.852s (SENT)
I20260709 13:02:17.593842  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.583911 10733 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.582311 10857 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.611752 10825 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.571471 10487 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:17.615053  8359 leader_election.cc:336] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.933s (SENT)
I20260709 13:02:17.618108  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.606945 10817 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:17.620147 10859 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 13:02:17.621279  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1398) took 1789 ms. Trace:
I20260709 13:02:17.647666  8391 rpcz_store.cc:276] 0709 13:02:15.831824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.867841 (+ 36017us) service_pool.cc:224] Handling call
0709 13:02:15.868189 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.119562 (+1251373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.621015 (+501453us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400162454. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:17.621217 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2860267392}
W20260709 13:02:17.622839 10810 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.979s	user 0.002s	sys 0.000s
I20260709 13:02:17.614317 10733 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.653406  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:17.617883 10850 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:17.616647 10625 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:17.617820 10796 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:17.584481 10846 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:17.631522 10790 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:17.639011 10767 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.639571 10487 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:17.640936 10793 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.641355 10784 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:17.642426  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7219cc411cf6498f8f250f689007874f"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:17.642946 10839 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.644171 10827 raft_consensus.cc:3055] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:17.632030 10840 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.696857 10784 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:17.644163  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:17.645875  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.650692 10861 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:02:17.687343  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:17.651777 10849 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:17.619623 10826 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.697248  8543 raft_consensus.cc:606] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:17.717509  8543 raft_consensus.cc:614] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:17.654768 10854 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:17.655210 10855 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:17.619159 10369 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:17.683766 10727 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:17.695423 10834 consensus_meta.cc:287] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.000s
I20260709 13:02:17.719542 10855 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:17.716657  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56998 (request call id 113) took 1614 ms. Trace:
I20260709 13:02:17.707309 10866 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:17.705386 10840 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.707847 10858 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:17.709309  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.746333  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.746861  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.709883  8465 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:17.712553  8461 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:17.697187 10825 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:17.723270  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:17.752130  8466 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:17.725070  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:17.700351 10827 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:17.727329  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:17.729526 10878 raft_consensus.cc:2764] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:02:17.762632  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 65928.2us
I20260709 13:02:17.731194 10837 raft_consensus.cc:3055] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:17.731493 10846 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:17.730947 10661 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:17.766269 10837 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:17.733982 10840 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.693077 10850 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.760661 10858 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.728624 10849 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.692245 10796 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.727447 10854 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:17.735977 10864 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:02:17.727324 10727 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:17.736310 10866 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.722709  8538 rpcz_store.cc:276] 0709 13:02:16.094021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.120937 (+ 26916us) service_pool.cc:224] Handling call
0709 13:02:16.121226 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.198013 (+ 76787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.198046 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.235046 (+ 37000us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b2c001564c8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:02:16.235435 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.332013 (+ 96578us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:16.332798 (+   785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.332893 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.622041 (+1289148us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:17.708509 (+ 86468us) raft_consensus.cc:1685] finished
0709 13:02:17.708533 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.708668 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76390,"raft.queue_time_us":76837,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":28137728,"thread_start_us":96205,"threads_started":1,"wal-append.queue_time_us":200202}
W20260709 13:02:17.829514  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 117931us
I20260709 13:02:17.754555  8466 raft_consensus.cc:1275] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:02:17.773133  8395 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.830953  8395 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.761427  8463 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:17.730506 10818 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.693437 10625 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:17.841236  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 154502us
I20260709 13:02:17.725595 10679 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:17.769742 10872 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.143s	user 0.000s	sys 0.002s
I20260709 13:02:17.855077  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:17.858575  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:17.776062 10858 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.774847 10850 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.809849  8462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:17.882349  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:17.880918  8462 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:17.888991  8462 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:17.903359  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 148006us
I20260709 13:02:17.861723  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:02:17.916534  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 75063.2us
I20260709 13:02:17.908980 10549 raft_consensus.cc:993] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:17.774191 10827 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.895010 10849 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:17.941466  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 50438.1us
I20260709 13:02:17.907469 10858 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:17.920321 10859 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:17.946760  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:17.913359 10733 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:17.948912  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:17.951288  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 200840us
I20260709 13:02:17.784983 10784 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.985355  8395 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:17.987695  8395 pending_rounds.cc:85] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 3
I20260709 13:02:17.988862  8395 pending_rounds.cc:107] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:17.990022  8395 raft_consensus.cc:2889] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.992246  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1409) took 1554 ms. Trace:
I20260709 13:02:17.995364  8395 rpcz_store.cc:276] 0709 13:02:16.438137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.438277 (+   140us) service_pool.cc:224] Handling call
0709 13:02:16.440086 (+  1809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.101913 (+661827us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b54000fdfa0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe1345edc0 00007fbe134e91c0 00007fbe134ea231 00007fbe134e6d8f 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c
0709 13:02:17.772818 (+670905us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b54000fdfa0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe1346506f 00007fbe134ddf60 00007fbe134df7de 00007fbe134e9b49 00007fbe134ea416 00007fbe134e6d8f 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62
0709 13:02:17.991910 (+219092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.992181 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207883776}
W20260709 13:02:17.998879  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 50054.5us
I20260709 13:02:17.999832  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:17.772997 10837 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.004347  8462 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:17.954629 10827 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.954504 10855 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:18.001096 10878 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.009681 10858 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.010753 10784 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.024415  8462 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:18.098321  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 318775us
I20260709 13:02:18.010470 10549 raft_consensus.cc:1081] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:18.023128 10837 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:18.103255  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 198756us
I20260709 13:02:18.025177 10854 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.025030 10845 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.011176 10849 consensus_queue.cc:1059] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.121s
W20260709 13:02:18.162719  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.009027 10888 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:02:18.090603 10866 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.017647 10482 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.105583 10796 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.026146 10887 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:18.207852 10845 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:18.214428 10887 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:18.217671 10849 consensus_queue.cc:1243] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer 2122d8c723e84e3da22f81f7eeb4b1a9 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:18.218551 10866 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:18.218927 10866 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:18.220018 10866 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:18.221251  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.221757  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.222108  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.222566  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.222982  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.224553  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 216708us
W20260709 13:02:18.173079  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 72079.2us
I20260709 13:02:18.226001  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.229457  8540 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:18.233328  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:18.205751 10625 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.233978  8536 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.234324  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.234926  8535 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:18.210980 10727 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:18.225977 10854 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.241447  8542 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:18.241859  8543 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.222116 10679 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:18.239255  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.239811  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.244225  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.245673  8538 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:18.232401 10878 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:18.248847  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.232719 10835 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:18.272146  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:18.237526 10887 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:02:18.282487  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.315991  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.232864 10796 consensus_queue.cc:1059] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:02:18.267357 10884 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
W20260709 13:02:18.266525 10894 log.cc:927] Time spent T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:18.248106 10625 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.254282 10878 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:18.254802 10793 consensus_meta.cc:287] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.001s
W20260709 13:02:18.326535  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 77649.7us
W20260709 13:02:18.280716 10661 consensus_meta.cc:287] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 13:02:18.250901 10855 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.313159 10898 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:18.278688  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:18.279688 10482 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:18.371209  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 99168.3us
I20260709 13:02:18.372072  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:18.372289  8536 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:18.247273 10854 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.252013 10858 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:02:18.254005 10868 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:02:18.246707 10890 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.120s
I20260709 13:02:18.335014 10845 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:18.373956 10897 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.405776 10868 raft_consensus.cc:3055] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:18.367792 10878 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.406538  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.406817 10858 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:18.407163 10858 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:18.407614  8542 raft_consensus.cc:1240] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.408000 10858 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.408720  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.409135 10858 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.358421 10887 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.410041 10887 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.410576 10887 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.375164  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet ef4deccb7c274fec97786db5d6131514 with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47224
I20260709 13:02:18.376602  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.377965  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:18.378482  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.379513  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:18.379786  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.419258  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.380061  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:18.421502  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.423144  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.423955  8466 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:18.425114  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.380503  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:18.395601 10881 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.551s	user 0.001s	sys 0.000s
I20260709 13:02:18.426977  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.428483  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.380921  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.431445  8470 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:18.433315  8470 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:18.379771 10776 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:02:18.433983 10866 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.382441  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:18.323660 10835 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:18.396878  8536 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:18.436682  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.436805  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:18.437769 10835 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:18.397502  8535 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:02:18.439869  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.440601  8535 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
W20260709 13:02:18.406268 10871 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.787s	user 0.009s	sys 0.015s
I20260709 13:02:18.443303  8538 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:18.441566  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.445166  8539 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:18.403501  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1403) took 1983 ms. Trace:
I20260709 13:02:18.406251 10868 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:18.415153 10625 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.437754  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.446146  8394 rpcz_store.cc:276] 0709 13:02:16.420103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.420709 (+   606us) service_pool.cc:224] Handling call
0709 13:02:16.421031 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.993179 (+572148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.403174 (+1409995us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540036d8d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:18.403426 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311992704}
I20260709 13:02:18.402372  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 924) took 1051 ms. Trace:
I20260709 13:02:18.429725  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.450443  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:18.459213  8542 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:18.459669  8542 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:18.460129 10814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.011s	sys 0.082s
W20260709 13:02:18.460567 10814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.011s	sys 0.082s
I20260709 13:02:18.453651  8535 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.461644  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1431) took 1296 ms. Trace:
I20260709 13:02:18.458395  8544 rpcz_store.cc:276] 0709 13:02:17.350622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.351559 (+   937us) service_pool.cc:224] Handling call
0709 13:02:17.351930 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.585997 (+234067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.402026 (+816029us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54000b63d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:18.402297 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530099584}
I20260709 13:02:18.462112  8387 rpcz_store.cc:276] 0709 13:02:17.165175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.308990 (+143815us) service_pool.cc:224] Handling call
0709 13:02:17.309269 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.309616 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.309649 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.310127 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.360782 (+ 50655us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:17.360827 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.360906 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.370859 (+1009953us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b240011a728. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe102809c4 00007fbe1027eacb 00007fbe10439dc9 00007fbe10439a55 00007fbe1043909d 00007fbe1306b10e 00007fbe1308288c 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221
0709 13:02:18.443649 (+ 72790us) raft_consensus.cc:1685] finished
0709 13:02:18.443680 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.461581 (+ 17901us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":2837888,"thread_start_us":50223,"threads_started":1,"wal-append.queue_time_us":267007}
I20260709 13:02:18.466753  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.466614  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:18.467362  8535 raft_consensus.cc:1813] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Handling vote request from an unknown peer d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.467880  8535 raft_consensus.cc:2410] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:18.458598  8465 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:18.399415 10793 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:18.454502 10857 consensus_meta.cc:287] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.837s	user 0.013s	sys 0.000s
I20260709 13:02:18.495261  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.475987  8544 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.468192  8542 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.514185  8535 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:18.456291 10679 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.515681  8542 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.516655  8538 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:18.474848 10897 consensus_queue.cc:1059] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:02:18.371965 10855 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:18.443907 10796 consensus_queue.cc:1175] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c45599d1dc3b4823b857cf77f276dc7b" responder_term: 5 status { last_received { term: 4 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:18.521239 10855 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.516685  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.523949 10897 consensus_queue.cc:1243] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:18.475325 10858 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:18.525405 10858 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:18.525838 10858 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.461364 10625 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.528103 10887 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.528717 10625 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.483706 10793 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.516417 10857 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.462541 10684 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.531819  8469 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:18.534327  8470 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:18.533650 10887 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.537884  8542 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:18.455967 10835 consensus_queue.cc:1048] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:02:18.518016 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51684 (request call id 1) took 3171 ms. Trace:
I20260709 13:02:18.480029 10805 consensus_queue.cc:1059] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:02:18.533360 10793 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.534768 10684 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:18.545526 10808 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:02:18.546306  8470 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.547469 10857 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.555220 10854 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:18.556505  8540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 921) took 1208 ms (client timeout 1596 ms). Trace:
W20260709 13:02:18.559123  8467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.015s	sys 0.031s
W20260709 13:02:18.561439  8467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.015s	sys 0.031s
W20260709 13:02:18.561357  8540 rpcz_store.cc:269] 0709 13:02:17.348577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.348845 (+   268us) service_pool.cc:224] Handling call
0709 13:02:18.556280 (+1207435us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54002ca1d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:18.556418 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000840576}
I20260709 13:02:18.567975  8462 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:18.560580 10684 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.571029  8470 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:18.570252 10740 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.575831  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:18.576367  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:18.577946  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:18.580809  8470 raft_consensus.cc:1240] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:18.584992  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:02:18.591143 10827 consensus_meta.cc:287] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.003s
I20260709 13:02:18.542615 10661 rpcz_store.cc:276] 0709 13:02:15.342251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.350792 (+  8541us) service_pool.cc:224] Handling call
0709 13:02:15.476320 (+125528us) log.cc:844] Serialized 494 byte log entry
0709 13:02:15.803193 (+326873us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b180033cee0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13467b26 00007fbe1346149a 00007fbe13460714
0709 13:02:15.803714 (+   521us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b54004487a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13467b26 00007fbe1346149a 00007fbe13460714 00007fbe13440eaa 00007fbe13447d53 00007fbe13447cd9 00007fbe13447c69 00007fbe13447c31 00007fbe13446dfd 000000000038f354
0709 13:02:15.819308 (+ 15594us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54004487a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13460142 00007fbe13440eaa 00007fbe13447d53 00007fbe13447cd9 00007fbe13447c69 00007fbe13447c31 00007fbe13446dfd 000000000038f354 000000000038f199 00007fbe103fa475
0709 13:02:18.494853 (+2675545us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4577,"raft.run_cpu_time_us":6917,"raft.run_wall_time_us":346589,"spinlock_wait_cycles":145057664,"thread_start_us":116544,"threads_started":1,"wal-append.queue_time_us":169944,"wal-append.run_cpu_time_us":1699,"wal-append.run_wall_time_us":1023344}
I20260709 13:02:18.569599  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:18.592837  8279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13811dee93af4290bdcf7d73b527d0f4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:18.594156 10868 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:18.594678  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 979767us
I20260709 13:02:18.595395 10868 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.595824 10817 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.596531 10817 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:18.595932 10842 raft_consensus.cc:3055] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:18.597214 10842 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:18.597044 10817 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:18.598100  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.599229  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.599905  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.602914  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.603332  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.604583 10867 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.833s	user 0.001s	sys 0.000s
I20260709 13:02:18.604919  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.605851  8394 raft_consensus.cc:2410] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:18.606292  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1432) took 1389 ms. Trace:
I20260709 13:02:18.606662  8390 rpcz_store.cc:276] 0709 13:02:17.216877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.484546 (+267669us) service_pool.cc:224] Handling call
0709 13:02:17.484925 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.485178 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:17.714609 (+229431us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.605974 (+891365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.606024 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.606063 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.606125 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.606234 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":885419,"prepare.queue_time_us":137817,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"thread_start_us":234576,"threads_started":2,"wal-append.queue_time_us":5894}
I20260709 13:02:18.610718 10834 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.611265 10834 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.612725 10842 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.613404 10834 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.561138 10878 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.615252  8468 raft_consensus.cc:2410] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:02:18.622689  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.625531  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.626297  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.627063  8541 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:18.628273 10811 consensus_queue.cc:1048] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:02:18.628360  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.618947 10548 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:02:18.631251 10791 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.631821 10791 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.632979  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.633476  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.633035 10734 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.634056  8390 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:18.634441 10734 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.634779  8387 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:18.635067  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.636256  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.636489 10734 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.636854  8395 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:18.636981 10734 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.637434 10734 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.638265 10767 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.638834  8358 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:18.638769 10767 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.640868  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:18.641038  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.641932  8393 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:18.643392  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.643708  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.644245  8387 raft_consensus.cc:1813] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Handling vote request from an unknown peer d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.645000  8387 raft_consensus.cc:2410] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:18.645376  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.646373  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.646533  8393 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:18.647884  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:18.648414  8391 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.644188  8394 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:18.614198 10842 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.654327  8390 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:18.654572 10806 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.655198 10767 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.655707 10767 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:18.646003 10854 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.656234 10854 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:18.659632 10684 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.645298 10866 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.662637 10866 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.662902  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:18.656234 10767 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:18.664173 10826 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:18.664264 10767 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.664842 10866 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.647471 10827 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.665603 10878 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.665652 10826 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.667608  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.668756  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.627086 10817 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:18.671586 10734 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.674001  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:18.675653  8391 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:18.677179  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.677740  8390 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:18.634002 10791 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.674062 10911 tablet_replica.cc:333] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:02:18.677253  8360 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.682075  8540 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.613766 10858 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:18.681594  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1413) took 1541 ms. Trace:
I20260709 13:02:18.652962 10808 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:18.685606 10808 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:18.686300 10858 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:18.686496 10808 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.687208  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.687702  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:18.678732 10817 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:18.687817  8542 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:18.689229 10817 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.689625 10817 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.666213 10721 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.690059  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.690505 10721 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.691179  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.693136 10882 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.693770 10882 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.694099  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.685400  8388 rpcz_store.cc:276] 0709 13:02:17.140196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.140927 (+   731us) service_pool.cc:224] Handling call
0709 13:02:17.141320 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:17.149818 (+  8498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.149850 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:17.175386 (+ 25536us) log.cc:844] Serialized 52 byte log entry
0709 13:02:17.212517 (+ 37131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:17.280305 (+ 67788us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.280723 (+   418us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.280911 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.280978 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.771267 (+490289us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b18002cdee0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:18.429947 (+658680us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18002cdee0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe18410aa1 00007fbe18407b37 00007fbe184079ca 00007fbe184ff26f
0709 13:02:18.430540 (+   593us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b48000030d8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe18410aa1 00007fbe18407b37 00007fbe184079ca 00007fbe184ff26f 00007fbe184fef37 00007fbe1851355c 00007fbe18513508 00007fbe18513488 00007fbe18513443 00007fbe185126ec 00007fbe1743ca96
0709 13:02:18.551122 (+120582us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18002cdee0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:18.604031 (+ 52909us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:18.681395 (+ 77364us) raft_consensus.cc:1685] finished
0709 13:02:18.681415 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.681541 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247140,"prepare.queue_time_us":71915,"prepare.run_wall_time_us":44,"raft.queue_time_us":17775,"raft.run_cpu_time_us":7863,"raft.run_wall_time_us":1146265,"spinlock_wait_cycles":123954304,"thread_start_us":14791,"threads_started":1,"wal-append.queue_time_us":103416}
I20260709 13:02:18.696058 10882 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.665663 10827 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.678772 10734 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.698617 10827 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.702135  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.678102 10806 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.678794 10826 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.712077 10826 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.716006  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 1044) took 2097 ms. Trace:
I20260709 13:02:18.716418 10854 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.716401  8537 rpcz_store.cc:276] 0709 13:02:16.622764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.622924 (+   160us) service_pool.cc:224] Handling call
0709 13:02:16.651216 (+ 28292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:16.774170 (+122954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.774201 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:18.532131 (+1757930us) spinlock_profiling.cc:243] Waited 933 us on lock 0x7b2c001564c8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:02:18.537192 (+  5061us) log.cc:844] Serialized 52 byte log entry
0709 13:02:18.568658 (+ 31466us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:18.568696 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.568815 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.715703 (+146888us) raft_consensus.cc:1685] finished
0709 13:02:18.715734 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.715945 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133237,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":420,"spinlock_wait_cycles":2145536,"thread_start_us":134555,"threads_started":2,"wal-append.queue_time_us":133078}
W20260709 13:02:18.719697  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 43652.6us
I20260709 13:02:18.720507  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.721503  8358 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:18.717555 10834 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.722528 10834 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.725199  8537 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:18.726524  8469 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.729233 10684 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:18.717420 10817 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.731033 10887 raft_consensus.cc:3055] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:18.731602 10887 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:18.731774 10854 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.732400 10854 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.734578 10854 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.737995 10806 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.738725 10806 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.740952  8358 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.742148 10882 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.742508 10882 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.742849 10882 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:18.745146  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.745780 10849 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.746282 10849 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.747298  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:18.748322 10839 leader_election.cc:290] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:18.748522  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.748951 10849 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.749402  8393 raft_consensus.cc:2410] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:18.749749  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.750204  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:18.750526 10826 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.750555  8392 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:18.751390  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.748522  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.751955  8394 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:18.752043  8386 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:18.698151 10734 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.753754  8359 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.749500 10849 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.754253  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:18.774089  8391 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.774405 10911 raft_consensus.cc:2243] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.775240 10911 raft_consensus.cc:2272] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.731626 10817 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.755718  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.778327 10732 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.778623 10911 ts_tablet_manager.cc:1916] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:18.778918  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:18.778875 10732 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.779651  8541 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.781126 10732 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.781678  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:18.781752 10842 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.782449  8462 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:18.782694 10842 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.782959  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:18.756367  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.783452  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:18.784147  8462 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:18.756659  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.756960  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.693445 10721 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.732774 10887 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.783885  8390 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:18.757892  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.758035  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.793479  8392 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:18.758569  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:18.756664  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.759915  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:18.762166  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 85042.8us
I20260709 13:02:18.762956 10733 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.763722 10806 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.764508 10734 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.765358 10816 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.765937 10487 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.773208 10849 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.753546 10834 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.769734  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.770083  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:18.772017  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.772106 10808 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:18.777650 10868 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.784932  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:18.836043  8462 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.786998 10827 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.796631  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.767307  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:18.841153  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 73927us
I20260709 13:02:18.810721  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:18.811764  8394 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:18.812331  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:18.815537  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:18.843250  8393 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.843410  8386 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.817811  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:18.820310  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 50671.6us
I20260709 13:02:18.820511  8508 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.805696 10887 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.845577  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.826287  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:18.828497  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.834581 10850 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.790987  8391 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:18.751178 10826 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.838506  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.844488  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:18.845309  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.899912  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:18.899305  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51452.9us
W20260709 13:02:18.900259  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55042.6us
I20260709 13:02:18.901059  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:18.865725  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.909935  8393 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:18.910770  8462 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:18.913363  8541 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:18.870187  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:18.924010  8394 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:18.870651  8387 raft_consensus.cc:1240] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:18.927996  8393 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:18.870797  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.929945  8540 raft_consensus.cc:2410] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:18.931416  8540 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:18.871403  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.871625  8469 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:18.935758  8469 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:18.936486  8469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:18.936934  8469 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.872311  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1523) took 1159 ms. Trace:
I20260709 13:02:18.835976 10868 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.803226 10828 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:02:18.938865 10828 raft_consensus.cc:3055] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:18.939388 10828 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:18.937304  8535 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.937382 10889 consensus_queue.cc:1059] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:18.940830 10889 raft_consensus.cc:3055] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:18.941162 10889 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:18.941846 10868 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.890580  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:18.891338 10849 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.914870  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:18.889017  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:18.899909  8465 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:18.797427 10793 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:18.847229 10487 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.944482  8461 raft_consensus.cc:2393] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:18.945657  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:18.922706  8544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:18.946460  8390 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:18.887910  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:18.946583  8544 raft_consensus.cc:606] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:18.947058  8544 raft_consensus.cc:614] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:18.937662  8467 rpcz_store.cc:276] 0709 13:02:17.712812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.712970 (+   158us) service_pool.cc:224] Handling call
0709 13:02:17.713294 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.776265 (+ 62971us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:18.005302 (+229037us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.563076 (+557774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.563128 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.563200 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.849970 (+286770us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54003cffd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:18.865647 (+ 15677us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.872237 (+  6590us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772,"prepare.queue_time_us":315510,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":3511,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":2001,"spinlock_wait_cycles":144348544,"thread_start_us":785056,"threads_started":2,"wal-append.queue_time_us":572225}
I20260709 13:02:18.841355 10821 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:02:18.953220  8543 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:18.942068 10889 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:18.943652 10893 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.870244 10796 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
W20260709 13:02:18.960578  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 45789us
I20260709 13:02:18.961498  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:18.937258  8469 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.868891  8386 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:18.951234  8541 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:18.959437  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 92451.8us
I20260709 13:02:18.965516  8386 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:18.978328  8386 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:18.921253 10733 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.920723 10854 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:18.946532 10845 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:18.982173  8433 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:18.979889  8464 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:18.983222  8469 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:19.000474  8359 connection.cc:256] RPC call timeout handler was delayed by -1.0825316319999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2926s for a response
I20260709 13:02:18.914322 10834 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:02:19.028569  8386 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:19.011091  8433 raft_consensus.cc:2686] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:18.978251 10849 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:19.032541  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 50459.6us
I20260709 13:02:18.970008 10793 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:18.971846 10842 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:19.034612  8469 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:19.042291  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:19.001081 10868 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:19.001530 10889 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.995811 10845 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.968945 10904 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:02:19.056226  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:19.068253  8469 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.005386 10916 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.062979  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:19.024505 10816 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:18.980537 10661 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:02:19.055976  8507 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
W20260709 13:02:19.088886  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.088968  8507 leader_election.cc:304] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:19.088505  8469 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:18.998821 10733 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.084313 10063 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.083556  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:19.090664 10063 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.032228 10487 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.054329 10868 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:19.033347 10827 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:19.082338  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:19.039598 10849 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.049194 10817 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.092706  8507 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:19.067261 10842 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:19.064275 10732 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.068534 10845 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.100379  8543 raft_consensus.cc:606] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:19.101559  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:19.158694  8543 raft_consensus.cc:614] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:19.160174  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58682.8us
I20260709 13:02:19.161067  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:19.162109  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:19.157634  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49417.9us
I20260709 13:02:19.163196  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:19.163708  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:19.164217  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:19.071758 10846 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:19.106352 10063 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:19.099817 10868 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.083355 10721 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:02:19.179584  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 88283.9us
I20260709 13:02:19.170969  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:19.184521  8464 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:19.109882 10849 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.190977 10063 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.111794 10836 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:19.111569 10838 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:19.120136 10796 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:19.111719 10854 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.092324 10816 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.122869 10842 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.101186 10833 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:02:19.210708 10063 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:19.182849 10791 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.179430 10858 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.181077 10732 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.180408 10878 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.169523 10808 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:19.112486 10827 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:19.231679  8508 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:19.099674 10487 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.179767 10866 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:19.087874 10916 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.119813 10817 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.208458 10612 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:19.205976 10839 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:19.218572 10771 consensus_queue.cc:1175] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c45599d1dc3b4823b857cf77f276dc7b" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:02:19.230182 10878 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:19.285567  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 46178.6us
I20260709 13:02:19.226203 10858 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.228319 10746 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:02:19.222422 10842 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.282774 10811 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.235663 10792 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 13:02:19.236667 10866 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.222721 10791 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.310256 10791 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.310647 10487 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:19.223377 10836 raft_consensus.cc:697] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:19.314370 10828 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:19.294516  8388 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:19.235898 10885 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:02:19.309504 10919 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:02:19.309619 10866 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.283707 10788 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:19.281724  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:19.290656 10878 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:19.334172 10918 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:02:19.318670 10547 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:02:19.345494 10792 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:19.346277 10792 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:19.292155 10612 raft_consensus.cc:697] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:19.347453 10792 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:19.355890  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 69368.5us
I20260709 13:02:19.292295 10858 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.239913 10748 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:02:19.222365 10854 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:19.342446  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 60829.8us
W20260709 13:02:19.338984 10921 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 13:02:19.349473 10882 consensus_meta.cc:287] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 13:02:19.305044 10811 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:19.340397 10828 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.355983 10612 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.357260 10816 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:19.368276  8508 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:19.369439 10934 log.cc:927] Time spent T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:02:19.443054 10923 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:19.363011 10733 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:19.593623  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 225446us
I20260709 13:02:19.594324 10063 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.601866 10063 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.602365 10063 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.292703 10839 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:19.379518 10811 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:19.616650 10922 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:02:19.651335 10063 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.622673  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:19.596858 10746 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.398216 10882 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.684870 10063 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:19.315623 10836 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.706550  8395 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:19.710812  8540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.025s	sys 0.055s
W20260709 13:02:19.711375  8540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.025s	sys 0.055s
W20260709 13:02:19.713992  8462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.032s	sys 0.043s
W20260709 13:02:19.714502  8462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.032s	sys 0.043s
I20260709 13:02:19.619787 10791 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:19.721863 10729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.007s	sys 0.068s
I20260709 13:02:19.687767 10746 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:19.830515 10887 consensus_meta.cc:287] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.982s	user 0.010s	sys 0.000s
I20260709 13:02:19.831709 10887 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.832365 10887 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.745970 10816 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.834347 10816 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.836091 10887 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:19.836558 10816 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:19.741254 10733 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.837252 10887 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:19.837616 10733 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:19.725309 10729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.007s	sys 0.068s
I20260709 13:02:19.843521  8463 raft_consensus.cc:2410] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:02:19.726440 10868 consensus_meta.cc:287] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:02:19.849395 10887 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.718133 10817 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:19.840255 10733 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:19.862447 10878 consensus_meta.cc:287] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.004s
W20260709 13:02:19.873741  8386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.002s	sys 0.054s
W20260709 13:02:19.874264  8386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.002s	sys 0.054s
W20260709 13:02:19.697876  9035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.010s	sys 0.062s
W20260709 13:02:19.885886  8470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.027s	sys 0.051s
W20260709 13:02:19.890756  8470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.027s	sys 0.051s
W20260709 13:02:19.917953  8461 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.032s	sys 0.067s
W20260709 13:02:19.926090  8461 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.032s	sys 0.068s
I20260709 13:02:19.871021 10868 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:19.880513 10767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.005s	sys 0.073s
W20260709 13:02:19.940171  8390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.039s	sys 0.020s
W20260709 13:02:19.972405  8390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.039s	sys 0.020s
W20260709 13:02:19.940799  8392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.017s	sys 0.042s
I20260709 13:02:19.918859 10854 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:19.974023  8392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.017s	sys 0.043s
I20260709 13:02:19.881464 10878 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:19.918534 10827 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:02:19.962834  8467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.008s	sys 0.008s
W20260709 13:02:19.984445  8467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.009s	sys 0.008s
W20260709 13:02:19.887418  9035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.011s	sys 0.062s
W20260709 13:02:19.970852 10767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.006s	sys 0.073s
W20260709 13:02:20.004304  8393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.024s	sys 0.039s
W20260709 13:02:20.004871  8393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.025s	sys 0.039s
W20260709 13:02:20.022850  8436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.029s	sys 0.033s
W20260709 13:02:20.023422  8436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.029s	sys 0.033s
I20260709 13:02:19.973855  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1453) took 1151 ms. Trace:
I20260709 13:02:19.937952 10838 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:19.975385  8544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.018s	sys 0.045s
W20260709 13:02:20.027297  8544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.018s	sys 0.045s
I20260709 13:02:19.997577  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1549) took 1216 ms. Trace:
I20260709 13:02:20.001565  8469 raft_consensus.cc:1240] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:20.028432  8433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.044s	sys 0.119s
W20260709 13:02:20.028743  8433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.044s	sys 0.119s
W20260709 13:02:20.029059  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 864913us
I20260709 13:02:20.030062  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:20.029238  8467 rpcz_store.cc:276] 0709 13:02:18.781226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.948450 (+167224us) service_pool.cc:224] Handling call
0709 13:02:18.948715 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.948897 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:19.118085 (+169188us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.997037 (+878952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.997125 (+    88us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:19.997195 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.997298 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.997481 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25351,"prepare.queue_time_us":234862,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"thread_start_us":957095,"threads_started":2}
I20260709 13:02:20.024423  8390 rpcz_store.cc:276] 0709 13:02:18.822485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.955470 (+132985us) service_pool.cc:224] Handling call
0709 13:02:18.955837 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.956077 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:19.138878 (+182801us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.973485 (+834607us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.973540 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:19.973582 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.973649 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.973776 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107785,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":479,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":12040,"thread_start_us":1015953,"threads_started":2}
W20260709 13:02:20.026206  8466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.000s	sys 0.013s
W20260709 13:02:20.032814  8466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.000s	sys 0.013s
I20260709 13:02:20.037779  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:20.038766  8390 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:20.041155  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1450) took 1227 ms. Trace:
W20260709 13:02:20.045836  8359 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.016s	sys 0.046s
W20260709 13:02:20.046346  8359 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.016s	sys 0.046s
W20260709 13:02:20.058302  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 932317us
W20260709 13:02:20.059092  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.926s (SENT) [suppressed 18 similar messages]
I20260709 13:02:20.035152 10854 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.039090 10882 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:20.070480  8465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.000s	sys 0.018s
W20260709 13:02:20.070889  8465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.000s	sys 0.018s
I20260709 13:02:20.071796  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1547) took 1291 ms. Trace:
W20260709 13:02:20.064904 10924 log.cc:927] Time spent T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:02:20.032884 10838 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:20.086140  9032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.018s	sys 0.037s
W20260709 13:02:20.105605  9032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.018s	sys 0.041s
I20260709 13:02:20.069983 10746 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:20.068053 10929 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:02:20.072227  8465 rpcz_store.cc:276] 0709 13:02:18.780755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.943401 (+162646us) service_pool.cc:224] Handling call
0709 13:02:18.943682 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.943845 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:19.117915 (+174070us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.071387 (+953472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.071447 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.071497 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.071577 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.071730 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10727,"prepare.queue_time_us":106660,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":2981,"thread_start_us":1093914,"threads_started":2}
W20260709 13:02:20.076347 10925 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.186s	user 0.000s	sys 0.002s
I20260709 13:02:20.073812  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:20.067157 10791 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:20.104446  8468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.001s	sys 0.025s
I20260709 13:02:20.068881 10854 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:20.080982  8391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.009s	sys 0.013s
I20260709 13:02:20.112164  8390 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:20.135435  8468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.001s	sys 0.025s
I20260709 13:02:20.072100 10850 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:20.138990  8391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.009s	sys 0.016s
I20260709 13:02:20.140908  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1449) took 1327 ms. Trace:
I20260709 13:02:20.111027 10882 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:20.159789 10930 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:02:20.141924 10796 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.002s	sys 0.023s
W20260709 13:02:20.181365  8434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.005s	sys 0.030s
W20260709 13:02:20.196236  8434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.005s	sys 0.032s
W20260709 13:02:20.194832 10796 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.003s	sys 0.024s
W20260709 13:02:20.206944  8508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.023s	sys 0.015s
I20260709 13:02:20.197577 10767 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.197535 10746 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:20.215088  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:20.215296 10958 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:20.215624  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1448) took 1402 ms. Trace:
I20260709 13:02:20.209216 10796 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:20.217268 10854 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:20.220368 10811 consensus_meta.cc:287] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.574s	user 0.004s	sys 0.004s
I20260709 13:02:20.221922 10868 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:20.217041  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1462) took 1392 ms. Trace:
W20260709 13:02:20.227684  8508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.023s	sys 0.015s
I20260709 13:02:20.252104  8392 rpcz_store.cc:276] 0709 13:02:18.825073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.054571 (+229498us) service_pool.cc:224] Handling call
0709 13:02:19.055198 (+   627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.059761 (+  4563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.059839 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.064934 (+  5095us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.975149 (+910215us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:19.975191 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.975270 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.216852 (+241582us) raft_consensus.cc:1685] finished
0709 13:02:20.216871 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.216984 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10272,"raft.queue_time_us":5691,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":18372,"thread_start_us":875494,"threads_started":1,"wal-append.queue_time_us":1048686}
W20260709 13:02:20.228365  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.225540 10849 consensus_meta.cc:287] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 1.011s	user 0.008s	sys 0.002s
I20260709 13:02:20.181350 10882 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:20.209388 10828 consensus_meta.cc:287] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.001s
I20260709 13:02:20.231065  8390 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:20.234596  8394 rpcz_store.cc:276] 0709 13:02:18.813247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.924819 (+111572us) service_pool.cc:224] Handling call
0709 13:02:18.925220 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.925455 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.925490 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.926051 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.104598 (+178547us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.169662 (+ 65064us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.184026 (+ 14364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.184114 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.215357 (+1031243us) raft_consensus.cc:1685] finished
0709 13:02:20.215379 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.215566 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14094,"prepare.queue_time_us":51572,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":16196,"raft.run_wall_time_us":17868,"spinlock_wait_cycles":22438144,"thread_start_us":178171,"threads_started":1,"wal-append.queue_time_us":937768}
I20260709 13:02:20.211149 10878 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:20.266203 10943 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:02:20.267699  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1551) took 1486 ms. Trace:
W20260709 13:02:20.267987 10920 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 1.170s	user 0.008s	sys 0.011s
I20260709 13:02:20.261880 10849 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.268111  8470 rpcz_store.cc:276] 0709 13:02:18.781710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.973609 (+191899us) service_pool.cc:224] Handling call
0709 13:02:19.003144 (+ 29535us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:19.003606 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.003645 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:19.039183 (+ 35538us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.892897 (+853714us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.941254 (+ 48357us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.966184 (+ 24930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.966301 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.267457 (+301156us) raft_consensus.cc:1685] finished
0709 13:02:20.267480 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.267638 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2891,"prepare.queue_time_us":49322,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":54,"raft.queue_time_us":202882,"raft.run_cpu_time_us":2103,"raft.run_wall_time_us":49634,"thread_start_us":800642,"threads_started":1,"wal-append.queue_time_us":1044743}
I20260709 13:02:20.270546 10849 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.271966  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1469) took 1352 ms. Trace:
I20260709 13:02:20.272954  8467 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:20.273447 10941 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.006s
I20260709 13:02:20.274204  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 1068) took 1592 ms. Trace:
I20260709 13:02:20.274643  8542 rpcz_store.cc:276] 0709 13:02:18.681990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.692232 (+ 10242us) service_pool.cc:224] Handling call
0709 13:02:18.692554 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.699132 (+  6578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.699165 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.699616 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.962756 (+263140us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.962802 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.962878 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.267465 (+1304587us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:20.273864 (+  6399us) raft_consensus.cc:1685] finished
0709 13:02:20.273891 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.274140 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":778,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":143374080,"thread_start_us":262745,"threads_started":1,"wal-append.queue_time_us":350647}
I20260709 13:02:20.275791  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1555) took 1428 ms. Trace:
I20260709 13:02:20.276198  8467 rpcz_store.cc:276] 0709 13:02:18.848136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.038347 (+1190211us) service_pool.cc:224] Handling call
0709 13:02:20.038735 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.273490 (+234755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.275536 (+  2046us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400236c54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:20.275733 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538177280}
I20260709 13:02:20.245337 10958 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.283522  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 1082) took 1199 ms. Trace:
I20260709 13:02:20.285548  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1558) took 1337 ms. Trace:
I20260709 13:02:20.284107  8544 rpcz_store.cc:276] 0709 13:02:19.083662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.085889 (+  2227us) service_pool.cc:224] Handling call
0709 13:02:19.086303 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.103900 (+ 17597us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:19.103931 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.104364 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.027904 (+923540us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.027975 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.028083 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.283194 (+255111us) raft_consensus.cc:1685] finished
0709 13:02:20.283233 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.283439 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33316,"raft.queue_time_us":12295,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9369,"thread_start_us":923181,"threads_started":1,"wal-append.queue_time_us":1104629}
I20260709 13:02:20.286046  8467 rpcz_store.cc:276] 0709 13:02:18.948127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.277261 (+1329134us) service_pool.cc:224] Handling call
0709 13:02:20.277610 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.285154 (+  7544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.285192 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.285241 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.285273 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.285340 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.285483 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:20.251657  9033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.013s	sys 0.062s
W20260709 13:02:20.293535  9033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.013s	sys 0.062s
I20260709 13:02:20.262765  8390 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:20.294425  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1468) took 1375 ms. Trace:
I20260709 13:02:20.294836  8390 rpcz_store.cc:276] 0709 13:02:18.919366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.262143 (+1342777us) service_pool.cc:224] Handling call
0709 13:02:20.262405 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.294161 (+ 31756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.294370 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.252209 10854 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.298777  8390 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:02:20.265434 10944 log.cc:927] Time spent T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:02:20.234356 10767 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.234637 10746 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.260933 10733 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:20.212042 10792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.021s	sys 0.014s
I20260709 13:02:20.288051  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56998 (request call id 116) took 1525 ms. Trace:
I20260709 13:02:20.290194 10868 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:20.313876  8540 rpcz_store.cc:276] 0709 13:02:18.762957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.932284 (+169327us) service_pool.cc:224] Handling call
0709 13:02:18.932899 (+   615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.933291 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.933323 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.938945 (+  5622us) log.cc:844] Serialized 494 byte log entry
0709 13:02:19.711866 (+772921us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:19.711925 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.712018 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.287835 (+575817us) raft_consensus.cc:1685] finished
0709 13:02:20.287859 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.287992 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":772456,"threads_started":1,"wal-append.queue_time_us":929919}
I20260709 13:02:20.290882 10850 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:20.291038 10878 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:20.289422  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1559) took 1331 ms. Trace:
I20260709 13:02:20.258697  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1467) took 1339 ms. Trace:
W20260709 13:02:20.264698 10942 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:20.300168  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1470) took 1380 ms. Trace:
I20260709 13:02:20.321836  8390 rpcz_store.cc:276] 0709 13:02:18.919941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.295693 (+1375752us) service_pool.cc:224] Handling call
0709 13:02:20.296006 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.299897 (+  3891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.300114 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.322708  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1550) took 1541 ms. Trace:
I20260709 13:02:20.272504  8394 rpcz_store.cc:276] 0709 13:02:18.919655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.262269 (+1342614us) service_pool.cc:224] Handling call
0709 13:02:20.271373 (+  9104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.271575 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.271611 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.271667 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:20.271706 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.271774 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.271897 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.323958  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1471) took 1403 ms. Trace:
I20260709 13:02:20.324518  8390 rpcz_store.cc:276] 0709 13:02:18.920243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.323105 (+1402862us) service_pool.cc:224] Handling call
0709 13:02:20.323452 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.323647 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.323674 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.323714 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:20.323743 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.323796 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.323908 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.326987  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1473) took 1330 ms. Trace:
I20260709 13:02:20.327942  8390 rpcz_store.cc:276] 0709 13:02:18.996632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.325765 (+1329133us) service_pool.cc:224] Handling call
0709 13:02:20.326437 (+   672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.326608 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.326635 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.326690 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.326728 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.326784 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.326915 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.254640 10811 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.330287  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1474) took 1328 ms. Trace:
W20260709 13:02:20.318420 10889 consensus_meta.cc:287] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 1.250s	user 0.013s	sys 0.000s
I20260709 13:02:20.338733  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1472) took 1380 ms. Trace:
I20260709 13:02:20.340621  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1463) took 1515 ms. Trace:
I20260709 13:02:20.327571 10793 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:20.341118  8386 rpcz_store.cc:276] 0709 13:02:18.825370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.057406 (+232036us) service_pool.cc:224] Handling call
0709 13:02:19.057680 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.062036 (+  4356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.062081 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.062603 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.874740 (+812137us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.874822 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.874927 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.340371 (+465444us) raft_consensus.cc:1685] finished
0709 13:02:20.340393 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.340557 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3102,"raft.queue_time_us":3463,"spinlock_wait_cycles":16358656,"thread_start_us":774896,"threads_started":1,"wal-append.queue_time_us":988078}
I20260709 13:02:20.342355 10793 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:20.342792 10793 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.343115  8386 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:20.343745  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1475) took 1300 ms. Trace:
I20260709 13:02:20.288981 10947 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:20.312093  8462 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.011s	sys 0.030s
W20260709 13:02:20.344960  8462 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.012s	sys 0.030s
I20260709 13:02:20.345930 10939 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.322510 10838 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:20.346509 10939 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.347698  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:20.351310 10887 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.354168 10817 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:20.354737 10817 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.291493 10849 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.356972 10817 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:20.356870 10849 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.357483 10817 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:20.358541 10827 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:20.358964 10849 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.358613 10817 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.319594  8467 rpcz_store.cc:276] 0709 13:02:18.957826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.288583 (+1330757us) service_pool.cc:224] Handling call
0709 13:02:20.288895 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.289082 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.289106 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.289154 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:20.289187 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.289253 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.289367 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.359287 10827 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.360260  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 203) took 1577 ms. Trace:
I20260709 13:02:20.360399  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:20.360668  8469 rpcz_store.cc:276] 0709 13:02:18.782939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.095514 (+312575us) service_pool.cc:224] Handling call
0709 13:02:19.095878 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.028576 (+932698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.359998 (+331422us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54001cb6d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:20.360197 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082389376}
I20260709 13:02:20.361308  8467 raft_consensus.cc:2410] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:20.319758  8392 rpcz_store.cc:276] 0709 13:02:18.919057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.255262 (+1336205us) service_pool.cc:224] Handling call
0709 13:02:20.258069 (+  2807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.258286 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.258326 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.258385 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.258427 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.258498 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.258630 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:20.326372 10806 consensus_meta.cc:287] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 1.520s	user 0.018s	sys 0.003s
W20260709 13:02:20.313697 10792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.022s	sys 0.014s
I20260709 13:02:20.362370  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:20.383251  8469 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.369393  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1560) took 1403 ms. Trace:
I20260709 13:02:20.384507  8467 rpcz_store.cc:276] 0709 13:02:18.966369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.362022 (+1395653us) service_pool.cc:224] Handling call
0709 13:02:20.362401 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.362566 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.362590 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.362632 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.362676 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.369044 (+  6368us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.369183 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45952}
I20260709 13:02:20.339257  8394 rpcz_store.cc:276] 0709 13:02:18.958157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.324451 (+1366294us) service_pool.cc:224] Handling call
0709 13:02:20.338139 (+ 13688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.338377 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.338409 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.338464 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.338507 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.338577 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.338681 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.344014  8386 rpcz_store.cc:276] 0709 13:02:19.043749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.342674 (+1298925us) service_pool.cc:224] Handling call
0709 13:02:20.342966 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.343515 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.343696 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:20.305883  8387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.087s	user 0.017s	sys 0.037s
I20260709 13:02:20.363684  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1466) took 1445 ms. Trace:
I20260709 13:02:20.388820  8388 rpcz_store.cc:276] 0709 13:02:18.918731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.195759 (+277028us) service_pool.cc:224] Handling call
0709 13:02:19.196202 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.316412 (+120210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.363460 (+1047048us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b54003070d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:20.363628 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219712896}
I20260709 13:02:20.310186 10733 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.364322  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 955) took 1616 ms. Trace:
W20260709 13:02:20.378494  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 348507us
I20260709 13:02:20.391444  8395 rpcz_store.cc:276] 0709 13:02:18.747524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.749038 (+  1514us) service_pool.cc:224] Handling call
0709 13:02:18.749322 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.707099 (+957777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.364109 (+657010us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54003f93d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:20.364267 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2201073920}
I20260709 13:02:20.306538 10854 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.142270  8391 rpcz_store.cc:276] 0709 13:02:18.813570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.926521 (+112951us) service_pool.cc:224] Handling call
0709 13:02:18.926785 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.926951 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:19.180582 (+253631us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.140464 (+959882us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.140600 (+   136us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.140647 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.140716 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.140851 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":656,"prepare.queue_time_us":53497,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":1358,"thread_start_us":1212203,"threads_started":2}
W20260709 13:02:20.390087  8387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.017s	sys 0.037s
I20260709 13:02:20.390159  8507 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:20.344964 10947 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:20.321627 10850 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.364740 10916 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.361748 10827 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:20.360854 10817 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:02:20.388033 10946 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
W20260709 13:02:20.398864 10858 consensus_meta.cc:287] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 1.030s	user 0.013s	sys 0.001s
I20260709 13:02:20.353259 10793 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.325534 10878 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.498499 10793 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.498782 10767 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:20.499326  8359 leader_election.cc:336] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.501s (SENT)
I20260709 13:02:20.500097 10878 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:20.501652 10850 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.503512 10811 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:20.505074 10854 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.506803 10939 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.403605  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:20.381003 10806 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.324806 10868 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.392510 10826 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.406242  8469 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:20.330893  8390 rpcz_store.cc:276] 0709 13:02:19.002173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.329445 (+1327272us) service_pool.cc:224] Handling call
0709 13:02:20.329770 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.329960 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.329987 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.330028 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.330061 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.330114 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.330235 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.410663  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:20.399789  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1561) took 1418 ms. Trace:
I20260709 13:02:20.395955 10958 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.399101 10740 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:20.322867 10796 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.387990 10889 consensus_queue.cc:1059] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:02:20.497606 10733 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.403813 10792 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:02:20.498167 10882 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:20.500247 10866 consensus_meta.cc:287] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 1.162s	user 0.004s	sys 0.008s
W20260709 13:02:20.512600  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 105672us
W20260709 13:02:20.388253 10952 log.cc:927] Time spent T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:02:20.522408  8467 rpcz_store.cc:276] 0709 13:02:18.980123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.393135 (+1413012us) service_pool.cc:224] Handling call
0709 13:02:20.393442 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.393616 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.393639 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.393679 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.393710 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.393762 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.398434 (+  4672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.555928  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1564) took 1531 ms. Trace:
I20260709 13:02:20.556321  8467 rpcz_store.cc:276] 0709 13:02:19.024973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.555155 (+1530182us) service_pool.cc:224] Handling call
0709 13:02:20.555446 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.555608 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.555631 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.555673 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.555702 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.555753 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.555873 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.528834  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:20.529518  8469 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:20.557488  8390 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:20.557761  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1563) took 1553 ms. Trace:
I20260709 13:02:20.558287  8469 rpcz_store.cc:276] 0709 13:02:19.004557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.528708 (+1524151us) service_pool.cc:224] Handling call
0709 13:02:20.529091 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.557465 (+ 28374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.557701 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.560041  8469 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:20.560860  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1566) took 1510 ms. Trace:
W20260709 13:02:20.531450  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 124469us
I20260709 13:02:20.564073  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
W20260709 13:02:20.545174  8359 leader_election.cc:336] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.569s (SENT)
I20260709 13:02:20.566046  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:20.561292  8469 rpcz_store.cc:276] 0709 13:02:19.050813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.559281 (+1508468us) service_pool.cc:224] Handling call
0709 13:02:20.559646 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.560575 (+   929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.560799 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.569587  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1567) took 1508 ms. Trace:
I20260709 13:02:20.570377  8469 rpcz_store.cc:276] 0709 13:02:19.060769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.568583 (+1507814us) service_pool.cc:224] Handling call
0709 13:02:20.568956 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.569171 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.569218 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.569274 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:20.569318 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.569388 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.569522 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.534849 10958 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:20.526331  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:20.576292  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:20.578717 10845 consensus_meta.cc:287] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 1.392s	user 0.013s	sys 0.000s
I20260709 13:02:20.581854 10845 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.533668 10878 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.533942 10793 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:20.584043 10845 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.534224 10817 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.526263 10893 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:02:20.589098  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1565) took 1549 ms. Trace:
I20260709 13:02:20.532225 10964 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.548659  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:20.549141 10826 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:20.548839 10811 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:20.574574 10946 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:20.518785 10858 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.597887  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:20.557152  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1556) took 1670 ms. Trace:
I20260709 13:02:20.637935  8465 rpcz_store.cc:276] 0709 13:02:18.903281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.136478 (+1233197us) service_pool.cc:224] Handling call
0709 13:02:20.182068 (+ 45590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.182285 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:20.210229 (+ 27944us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.556737 (+346508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.556805 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.556864 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.556947 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.557087 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37967,"prepare.queue_time_us":27708,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":663,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":11491,"thread_start_us":345382,"threads_started":1}
I20260709 13:02:20.592619 10955 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.497459 10947 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.629556  8467 rpcz_store.cc:276] 0709 13:02:19.040183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.557173 (+1516990us) service_pool.cc:224] Handling call
0709 13:02:20.588629 (+ 31456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.588794 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.588827 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.588868 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.588896 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.588947 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.589044 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.573642 10960 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.600041 10612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.026s	sys 0.011s
I20260709 13:02:20.587915 10887 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:20.574509  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:20.577082 10882 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.561625 10854 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:02:20.626750  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:20.626535  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 363509us
W20260709 13:02:20.667860  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 70109.5us
I20260709 13:02:20.676133  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:20.678085  8390 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
I20260709 13:02:20.679275  8464 raft_consensus.cc:1240] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:20.677605  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:20.627763  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1540) took 1848 ms. Trace:
I20260709 13:02:20.577137 10849 consensus_queue.cc:1059] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:02:20.574417 10866 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:20.630916 10836 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:20.625128 10733 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:20.650939  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1553) took 1852 ms. Trace:
I20260709 13:02:20.603332 10958 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.627063 10916 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:20.650568 10612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.027s	sys 0.011s
I20260709 13:02:20.635452 10746 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:20.692282  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:20.684613  8468 rpcz_store.cc:276] 0709 13:02:18.779135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.856127 (+ 76992us) service_pool.cc:224] Handling call
0709 13:02:18.945351 (+ 89224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.945553 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:19.118515 (+172962us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.627242 (+1508727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.627399 (+   157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.627464 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.627553 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.627699 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9425,"prepare.queue_time_us":146678,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":151429,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":1622683,"threads_started":3,"wal-append.queue_time_us":1257714}
I20260709 13:02:20.701982  8466 rpcz_store.cc:276] 0709 13:02:18.798878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.174053 (+375175us) service_pool.cc:224] Handling call
0709 13:02:19.175018 (+   965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.176055 (+  1037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.176160 (+   105us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.177439 (+  1279us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.037279 (+859840us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.037339 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.037437 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.650726 (+613289us) raft_consensus.cc:1685] finished
0709 13:02:20.650749 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.650870 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":655749,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":855128,"threads_started":1,"wal-append.queue_time_us":1114593}
I20260709 13:02:20.630995 10817 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.629199 10793 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:20.666790 10951 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:02:20.727909  8469 raft_consensus.cc:1240] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:20.673296 10842 consensus_meta.cc:287] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 1.356s	user 0.013s	sys 0.000s
I20260709 13:02:20.710671  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:20.713136  8465 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:20.737035  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1569) took 1669 ms. Trace:
I20260709 13:02:20.647696 10806 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:20.625622 10878 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.708863 10955 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:20.668165 10845 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:20.692932 10940 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.634567 10964 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.737494  8465 rpcz_store.cc:276] 0709 13:02:19.067874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.679290 (+1611416us) service_pool.cc:224] Handling call
0709 13:02:20.712972 (+ 33682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.736708 (+ 23736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.736961 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.725345 10882 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.762444  8465 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:20.742285  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:20.763108  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1572) took 1660 ms. Trace:
I20260709 13:02:20.742776  8466 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:20.763623  8465 rpcz_store.cc:276] 0709 13:02:19.103182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.760106 (+1656924us) service_pool.cc:224] Handling call
0709 13:02:20.760436 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.762854 (+  2418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.763058 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.764356  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1571) took 1668 ms. Trace:
I20260709 13:02:20.765120  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 204) took 1656 ms. Trace:
I20260709 13:02:20.764842  8466 rpcz_store.cc:276] 0709 13:02:19.096126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.716088 (+1619962us) service_pool.cc:224] Handling call
0709 13:02:20.742568 (+ 26480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.764033 (+ 21465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.764287 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.703507 10850 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.688429 10968 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.649590 10811 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.749379  8468 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:20.726053 10849 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.643136 10826 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.653440 10887 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:20.653159 10960 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.765524  8465 rpcz_store.cc:276] 0709 13:02:19.108427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.764344 (+1655917us) service_pool.cc:224] Handling call
0709 13:02:20.764642 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.764812 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.764843 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.764889 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:20.764918 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.764971 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.765073 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.722692 10733 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:20.770498  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 215801us
W20260709 13:02:20.774556  8359 leader_election.cc:336] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.797s (SENT)
I20260709 13:02:20.799793  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:20.708515 10836 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.713312 10916 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.746531 10955 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:20.786317  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1573) took 1676 ms. Trace:
I20260709 13:02:20.801913  8465 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:02:20.802313  8465 pending_rounds.cc:85] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:20.802560  8465 pending_rounds.cc:107] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:02:20.768772  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1570) took 1694 ms. Trace:
I20260709 13:02:20.802735 10740 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:20.802945  8468 rpcz_store.cc:276] 0709 13:02:19.074888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.714457 (+1639569us) service_pool.cc:224] Handling call
0709 13:02:20.742113 (+ 27656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.768518 (+ 26405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.768721 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.784556 10845 raft_consensus.cc:697] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:20.801946  8466 rpcz_store.cc:276] 0709 13:02:19.109579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.765949 (+1656370us) service_pool.cc:224] Handling call
0709 13:02:20.785837 (+ 19888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.786008 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.786030 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.786069 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.786099 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.786155 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.786267 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.802827  8465 raft_consensus.cc:2889] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:20.744941 10806 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.761404 10911 ts_tablet_manager.cc:1929] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:02:20.780627 10684 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.796591 10887 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.824466  8389 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:20.747929 10842 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.823736  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:20.837865  8390 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.797691 10976 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:20.768052 10882 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.847633  8466 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:20.762848 10940 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.828531 10981 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:20.839601 10965 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:02:20.856582  8465 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:20.857407 10911 log.cc:1199] T ef4deccb7c274fec97786db5d6131514 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/wals/ef4deccb7c274fec97786db5d6131514
I20260709 13:02:20.860270 10608 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:20.889906  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 202378us
I20260709 13:02:20.890056  8390 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:20.839516 10684 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.814728 10845 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.944852  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.945596  8544 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:20.949412  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:20.951885  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.952526  8542 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 4.
I20260709 13:02:20.956305  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:20.957504  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:20.958070  8390 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:20.890827  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
W20260709 13:02:20.971552  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 169270us
I20260709 13:02:20.893169 10608 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:02:20.946595 10965 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:20.887801 10858 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.968186  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.968390  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:20.983299  8535 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:20.968556  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.983579  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.969236  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.969353  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:20.323125  8461 rpcz_store.cc:276] 0709 13:02:18.781472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.958915 (+177443us) service_pool.cc:224] Handling call
0709 13:02:18.959122 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.959253 (+   131us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:19.927583 (+968330us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.322088 (+394505us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.322281 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.322335 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.322391 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.322506 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.322652 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40208,"prepare.queue_time_us":264561,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"thread_start_us":1282119,"threads_started":2}
I20260709 13:02:20.856024 10740 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.969964  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:20.894548 10972 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.960855 10975 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.958863  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:20.854147 10976 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:20.892071 10868 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:20.949730 10838 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.961575 10959 log.cc:927] Time spent T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:21.010856  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:21.011884  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.960063  8536 raft_consensus.cc:2955] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:20.981209  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:20.952534 10866 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.958272 10958 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:20.987129  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.987829  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:21.027997  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:20.989728  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.983603  8535 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:20.992447 10973 log.cc:927] Time spent T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:02:20.993935 10878 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:20.996799 10983 log.cc:927] Time spent T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:02:21.043074  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.043798 10684 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:21.044370  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.999643  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1481) took 1419 ms. Trace:
I20260709 13:02:20.999552 10793 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:02:20.988744 10971 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:02:21.014513 10811 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:21.015123 10960 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.016454 10608 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.017520  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:21.096879  8538 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.018517  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.020044  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1479) took 1440 ms. Trace:
I20260709 13:02:21.098508  8388 rpcz_store.cc:276] 0709 13:02:19.579461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.393920 (+814459us) service_pool.cc:224] Handling call
0709 13:02:20.394261 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.758208 (+363947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.758236 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.759935 (+  1699us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.953212 (+193277us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.953260 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.953326 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.019822 (+ 66496us) raft_consensus.cc:1685] finished
0709 13:02:21.019843 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.019991 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1129,"raft.queue_time_us":10951,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":107470,"thread_start_us":495794,"threads_started":2,"wal-append.queue_time_us":235465}
I20260709 13:02:21.021872 10993 consensus_queue.cc:1059] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:20.881397 10955 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.030216  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:20.872458 10981 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.000397  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.045351  8395 rpcz_store.cc:276] 0709 13:02:19.580114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.395511 (+815397us) service_pool.cc:224] Handling call
0709 13:02:20.396266 (+   755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.742166 (+345900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.742207 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.755114 (+ 12907us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.903546 (+148432us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.903602 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.903703 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.999422 (+ 95719us) raft_consensus.cc:1685] finished
0709 13:02:20.999440 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.999582 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125769,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4198,"thread_start_us":457049,"threads_started":2,"wal-append.queue_time_us":228647}
I20260709 13:02:21.046034  8535 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:21.049157  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 86147.4us
W20260709 13:02:21.050367  9067 consensus_meta.cc:287] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.000s
I20260709 13:02:21.051120  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.055488  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.056820  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.074681  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.104740  8537 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:21.108381  8535 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.110687  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:21.114283  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 339774us
I20260709 13:02:21.109211 10608 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.025426 10838 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:21.123798  8359 leader_election.cc:336] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.924s (SENT)
I20260709 13:02:21.104743 10817 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.124581  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.126989  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1557) took 2204 ms. Trace:
I20260709 13:02:21.106848 10911 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47224 (request call id 61) took 2722 ms. Trace:
I20260709 13:02:21.128046  8470 rpcz_store.cc:276] 0709 13:02:18.922427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.270425 (+1347998us) service_pool.cc:224] Handling call
0709 13:02:20.270795 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.291629 (+ 20834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.291672 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.292248 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.700184 (+407936us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:20.700244 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.700344 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.126663 (+426319us) raft_consensus.cc:1685] finished
0709 13:02:21.126695 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.126908 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20424,"raft.queue_time_us":27081,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":7617,"thread_start_us":385552,"threads_started":1,"wal-append.queue_time_us":492476}
I20260709 13:02:21.003139 10972 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.113125 10806 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.112286  9067 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:21.112769 10842 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.125562 10955 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.142232  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:21.143357  8537 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:21.149016  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.149992  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.150512  8537 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:21.151111  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.143965  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.144611  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.146358  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.158493  8538 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:21.128400 10975 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.125247 10836 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:21.166195  8539 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.172441  8540 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:21.157800 10821 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:21.175341  8360 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:21.184623 10732 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.168782 10940 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.195932  8539 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
W20260709 13:02:21.203095  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 92974.1us
I20260709 13:02:21.197139 10882 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.209374 10976 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.190596 10998 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:21.225032  8535 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:21.228989  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1579) took 1202 ms. Trace:
I20260709 13:02:21.229516  8465 rpcz_store.cc:276] 0709 13:02:20.026098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.826203 (+800105us) service_pool.cc:224] Handling call
0709 13:02:20.826483 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.872983 (+ 46500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.228773 (+355790us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b540040c254. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:21.228934 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68820736}
I20260709 13:02:21.233660 10979 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:21.235433  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1554) took 2435 ms. Trace:
I20260709 13:02:21.235985  8464 rpcz_store.cc:276] 0709 13:02:18.799956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.185597 (+385641us) service_pool.cc:224] Handling call
0709 13:02:19.185978 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.679818 (+1493840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.235127 (+555309us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540039fb54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:21.235355 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3434079616}
I20260709 13:02:21.194332 10999 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:21.211789 10988 log.cc:927] Time spent T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
W20260709 13:02:21.218055 10990 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:02:21.170686 10975 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:21.269922  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 242752us
I20260709 13:02:21.131817 10911 rpcz_store.cc:276] 0709 13:02:18.374579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.374853 (+   274us) service_pool.cc:224] Handling call
0709 13:02:18.614882 (+240029us) ts_tablet_manager.cc:1151] Deleting tablet ef4deccb7c274fec97786db5d6131514
0709 13:02:18.645332 (+ 30450us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:19.745145 (+1099813us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:20.748369 (+1003224us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:21.073326 (+324957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77086,"tablet-delete.queue_time_us":168168,"thread_start_us":103330,"threads_started":1}
I20260709 13:02:21.236896 11005 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:02:21.274706 11002 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:21.267307 10999 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:21.279322 11003 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:02:21.268875 10998 raft_consensus.cc:697] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
W20260709 13:02:21.288810 11007 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:21.288930  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1478) took 1842 ms. Trace:
W20260709 13:02:21.289839 11000 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:02:21.291136  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:21.291378  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1580) took 1002 ms. Trace:
I20260709 13:02:21.291756  8394 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.291711  8466 rpcz_store.cc:276] 0709 13:02:20.288760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.854322 (+565562us) service_pool.cc:224] Handling call
0709 13:02:20.880004 (+ 25682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.880474 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.880518 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.881088 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.080134 (+199046us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:21.080212 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.080329 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.291164 (+210835us) raft_consensus.cc:1685] finished
0709 13:02:21.291188 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.291323 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1189,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":5754,"thread_start_us":137082,"threads_started":1,"wal-append.queue_time_us":251326}
I20260709 13:02:21.295500  8507 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:21.289556  8392 rpcz_store.cc:276] 0709 13:02:19.446695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.365869 (+919174us) service_pool.cc:224] Handling call
0709 13:02:20.366286 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:20.757296 (+391010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.757326 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:20.757966 (+   640us) log.cc:844] Serialized 52 byte log entry
0709 13:02:20.885863 (+127897us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:20.885903 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.885982 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.288606 (+402624us) raft_consensus.cc:1685] finished
0709 13:02:21.288637 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.288852 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37391,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6138,"thread_start_us":479215,"threads_started":2,"wal-append.queue_time_us":199010}
W20260709 13:02:21.300586 10996 log.cc:927] Time spent T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:02:21.303689  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.305543  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1568) took 2239 ms. Trace:
I20260709 13:02:21.306056  8469 rpcz_store.cc:276] 0709 13:02:19.066068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.572040 (+1505972us) service_pool.cc:224] Handling call
0709 13:02:20.572697 (+   657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.728547 (+155850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.305279 (+576732us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400389fd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:21.305470 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356559232}
I20260709 13:02:21.307703  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:21.308960 10838 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:21.310149  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:21.310747  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.311332  8386 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:21.312335  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.312528 11005 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.312964 11005 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.313282 11005 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.315430  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1577) took 1290 ms. Trace:
I20260709 13:02:21.315845  8468 rpcz_store.cc:276] 0709 13:02:20.025352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.803784 (+778432us) service_pool.cc:224] Handling call
0709 13:02:20.804166 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.804541 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.804578 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.805056 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.950934 (+145878us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.950994 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.951207 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.315213 (+364006us) raft_consensus.cc:1685] finished
0709 13:02:21.315235 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.315369 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1550,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":145432,"threads_started":1,"wal-append.queue_time_us":289512}
I20260709 13:02:21.317866 11008 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.318627 10972 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:21.318413 11008 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.295202 10992 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:21.320619 11008 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:21.322187 10975 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.324299  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1451) took 2502 ms. Trace:
I20260709 13:02:21.323979 10998 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:21.324553 10981 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:21.324776  8387 rpcz_store.cc:276] 0709 13:02:18.821808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.928763 (+106955us) service_pool.cc:224] Handling call
0709 13:02:18.929154 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.929473 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:19.185084 (+255611us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.728947 (+1543863us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.729488 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.731154 (+  1666us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.825003 (+ 93849us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.323797 (+498794us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b540019dd20. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13462733 00007fbe134e7dbf 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c
0709 13:02:21.323852 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.323946 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.324079 (+   133us) raft_consensus.cc:1685] finished
0709 13:02:21.324094 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.324220 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35919,"prepare.queue_time_us":268981,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":76089,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":52665,"spinlock_wait_cycles":280670464,"thread_start_us":1856685,"threads_started":4,"wal-append.queue_time_us":1290459}
I20260709 13:02:21.327234  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:21.327785  8387 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.327664 10887 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:21.329241  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.329855  8392 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:21.330402  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1543) took 2550 ms. Trace:
I20260709 13:02:21.330765  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.331765  8392 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:21.332744  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.283330 10811 consensus_queue.cc:1059] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:02:21.327783 10999 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.335777 10999 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.330801  8462 rpcz_store.cc:276] 0709 13:02:18.779863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.949853 (+169990us) service_pool.cc:224] Handling call
0709 13:02:18.950249 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.010348 (+ 60099us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:19.070982 (+ 60634us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.345702 (+1274720us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.347769 (+  2067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.347825 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:20.347874 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.330133 (+982259us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b5400237154. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:21.330184 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.330312 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41960,"prepare.queue_time_us":248713,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":274453,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":18353,"spinlock_wait_cycles":137542528,"thread_start_us":1273944,"threads_started":2,"wal-append.queue_time_us":995300}
I20260709 13:02:21.337137  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:21.337980  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:21.313439  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.339067  8386 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:21.351709  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.352537  8386 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:21.338617  8392 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.355405  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.356072  8386 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:02:21.357278  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:21.357826  8386 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.362847  8387 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:21.365273  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:21.366653  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.366822  8387 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.353971  8288 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 4 to 6, term changed from 3 to 5, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted, no longer has a pending config: VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193), VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195), VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 5 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.388312 11005 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.389670  8392 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:21.390858  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.373920  8394 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:21.392833  8387 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:21.393002  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.393633  8394 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:21.396019  8386 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:21.397859  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1482) took 1779 ms. Trace:
I20260709 13:02:21.398854  8386 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:21.398319  8387 rpcz_store.cc:276] 0709 13:02:19.618873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.397052 (+1778179us) service_pool.cc:224] Handling call
0709 13:02:21.397404 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.397548 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.397562 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.397590 (+    28us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:21.397607 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.397666 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.397779 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.389503 10839 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:21.400211  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.400738  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1486) took 1656 ms. Trace:
I20260709 13:02:21.399770  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1485) took 1701 ms. Trace:
I20260709 13:02:21.401248  8387 rpcz_store.cc:276] 0709 13:02:19.744563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.399846 (+1655283us) service_pool.cc:224] Handling call
0709 13:02:21.400192 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.400377 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.400400 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.400441 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:21.400467 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.400528 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.400682 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.403258  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 220) took 1294 ms. Trace:
I20260709 13:02:21.403534  8387 rpcz_store.cc:276] 0709 13:02:20.108745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.402645 (+1293900us) service_pool.cc:224] Handling call
0709 13:02:21.402857 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.403050 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.403068 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.403097 (+    29us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:21.403114 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.403146 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.403221 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.400851  8392 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:21.405295  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:21.401695  8386 rpcz_store.cc:276] 0709 13:02:19.698108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.397940 (+1699832us) service_pool.cc:224] Handling call
0709 13:02:21.398235 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.399516 (+  1281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.399712 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.407447  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 221) took 1210 ms. Trace:
I20260709 13:02:21.407799  8387 rpcz_store.cc:276] 0709 13:02:20.197237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.404249 (+1207012us) service_pool.cc:224] Handling call
0709 13:02:21.407063 (+  2814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.407237 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.407260 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.407289 (+    29us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:21.407306 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.407340 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.407407 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.408840  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 223) took 1033 ms. Trace:
I20260709 13:02:21.409106  8387 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:21.410549  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1487) took 1023 ms. Trace:
I20260709 13:02:21.410938  8387 rpcz_store.cc:276] 0709 13:02:20.387200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.408676 (+1021476us) service_pool.cc:224] Handling call
0709 13:02:21.408951 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.410301 (+  1350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.410493 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.412536  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1488) took 1025 ms. Trace:
I20260709 13:02:21.410166  8386 rpcz_store.cc:276] 0709 13:02:20.375957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.407406 (+1031449us) service_pool.cc:224] Handling call
0709 13:02:21.408364 (+   958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.408520 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.408543 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.408583 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:21.408617 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.408674 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.408775 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.414511  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1489) took 1026 ms. Trace:
I20260709 13:02:21.413380  8387 rpcz_store.cc:276] 0709 13:02:20.387493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.411880 (+1024387us) service_pool.cc:224] Handling call
0709 13:02:21.412166 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.412316 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.412341 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.412381 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:21.412398 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.412432 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.412499 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.415140  8386 rpcz_store.cc:276] 0709 13:02:20.387749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.413693 (+1025944us) service_pool.cc:224] Handling call
0709 13:02:21.413984 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.414179 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.414215 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.414255 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:21.414282 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.414363 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.414462 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:21.416019  8387 raft_consensus.cc:1240] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:21.418133  8462 raft_consensus.cc:1240] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:21.422019  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.423089  8462 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:21.424425  8464 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:21.422642  8461 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:21.425596  8465 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:21.425859  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.426455  8469 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:21.426723  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.424463  8462 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:21.410794 10887 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:21.433957  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.434513  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.434903  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.437153  8467 raft_consensus.cc:2410] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:21.423605 10842 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.442248  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.442418 10842 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.443254  8470 raft_consensus.cc:2410] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:21.444793 10842 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.436375 10828 consensus_queue.cc:1059] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:02:21.446213 10904 consensus_queue.cc:1059] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:21.446539  8466 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.450542 10939 raft_consensus.cc:3055] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:21.451025 10939 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:21.451956 10939 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:21.453220 10939 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.453965 10608 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:21.454516 10608 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.456869 10608 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:21.458302  8463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 1545) took 2678 ms (client timeout 1593 ms). Trace:
W20260709 13:02:21.458717  8463 rpcz_store.cc:269] 0709 13:02:18.780324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.782740 (+  2416us) service_pool.cc:224] Handling call
0709 13:02:21.438089 (+2655349us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540040d154. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:21.458205 (+ 20116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436849920}
I20260709 13:02:21.463304 10821 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.463862 10821 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.465905 10612 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:21.466538 10612 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.468767 10612 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:21.474867  8389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1439) took 2664 ms (client timeout 1993 ms). Trace:
I20260709 13:02:21.476082  8386 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:02:21.475312  8389 rpcz_store.cc:269] 0709 13:02:18.810368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.810493 (+   125us) service_pool.cc:224] Handling call
0709 13:02:21.474640 (+2664147us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54003c8054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:21.474780 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3868167040}
I20260709 13:02:21.465111 11005 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:21.483765 10821 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:20.041642  8393 rpcz_store.cc:276] 0709 13:02:18.821422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.928731 (+107309us) service_pool.cc:224] Handling call
0709 13:02:18.930457 (+  1726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.930621 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:19.159170 (+228549us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.033753 (+874583us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.040850 (+  7097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.040901 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.040942 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.041001 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.041104 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5813,"prepare.queue_time_us":140068,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":93,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7138,"spinlock_wait_cycles":9610496,"thread_start_us":1074042,"threads_started":2}
I20260709 13:02:21.487809  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:21.488188 10821 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.491829  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:21.498716  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:21.501446  9064 raft_consensus.cc:2368] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
I20260709 13:02:21.501817  9067 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:21.503520  8509 leader_election.cc:400] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
I20260709 13:02:21.503863  8509 leader_election.cc:403] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:21.506899  8509 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:21.508327  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.509009  8539 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:21.509267  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.509577  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.510347  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.510471 10962 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.511058 11008 raft_consensus.cc:3055] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:21.511431 11008 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:21.512250 11008 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.512938 10826 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:21.513482 11008 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.515913  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:21.531605  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:21.536921  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.538424  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.501573  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:21.518378 10733 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.518406  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.522850  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:21.553323  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.553632  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.555495  8388 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:21.524284  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.528708  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.529105  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.530460  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.556339  8544 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:21.530840  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:21.542999  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.558195  8389 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:21.551440  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 222) took 1206 ms. Trace:
I20260709 13:02:21.559458  8392 rpcz_store.cc:276] 0709 13:02:20.344607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.405036 (+1060429us) service_pool.cc:224] Handling call
0709 13:02:21.405511 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.405940 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.405970 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.406826 (+   856us) log.cc:844] Serialized 494 byte log entry
0709 13:02:21.493471 (+ 86645us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:21.493495 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.493542 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.551238 (+ 57696us) raft_consensus.cc:1685] finished
0709 13:02:21.551257 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.551384 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":78243,"threads_started":1,"wal-append.queue_time_us":87613}
I20260709 13:02:21.532820 11005 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.572382  8507 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:21.579500  8542 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:21.580477  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:21.582693  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.589962  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:21.590204  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.592202  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.593027  8465 raft_consensus.cc:2368] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10.
I20260709 13:02:21.568459 11005 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.595925  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:21.596544  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.597561  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.598065  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.598517  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.599221  8462 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.599673  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.600386  8464 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.601063  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.601718  8464 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.603439  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.604526  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.608291  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.608943  8461 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:21.605571  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.611414  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.611979  8464 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.612498  8468 raft_consensus.cc:2368] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:21.612753  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.578763 11006 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:21.613881  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.613559  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.624464  8470 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:21.629773  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.631712  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.568041 10993 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:02:21.602488 11005 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.627375  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.646018  8466 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.601305 10887 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.602245 10793 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.648187 10964 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.648602 10793 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:21.594874 11022 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:21.583461 10842 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.650352 10842 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.651060 10793 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.652554 10842 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.569224 10999 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:02:21.653467 11021 log.cc:927] Time spent T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:21.653828 10999 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:21.654237 10999 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:21.654650  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1483) took 1968 ms. Trace:
I20260709 13:02:21.655009  8394 rpcz_store.cc:276] 0709 13:02:19.685908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.397669 (+1711761us) service_pool.cc:224] Handling call
0709 13:02:21.411260 (+ 13591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.411607 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.411639 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.412278 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.492100 (+ 79822us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:21.492143 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.492211 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.654399 (+162188us) raft_consensus.cc:1685] finished
0709 13:02:21.654426 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.654589 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":28792,"threads_started":1,"wal-append.queue_time_us":97702}
I20260709 13:02:21.632966  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.631717  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.626013  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.658057  8467 raft_consensus.cc:2376] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6. Re-sending same reply.
I20260709 13:02:21.634393  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.635895  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.636765  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.659185  8464 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.659541  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.639370 10962 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6.
I20260709 13:02:21.592015 10791 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.655210 10999 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.666935 10999 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.670672  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.671540  8462 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:21.672436 10791 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.688216  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.688769  8466 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:21.689412  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.692032  8462 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.692385  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:21.693147  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.690626  8537 raft_consensus.cc:2368] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6.
I20260709 13:02:21.694556  8464 raft_consensus.cc:2410] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:21.689742  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.702302  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.705263  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.700933  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.709291  8463 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:21.709837  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.710089  8462 raft_consensus.cc:2410] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 10 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:21.711270  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.711822  8468 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:21.714991  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.716104  8464 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:21.648191 10887 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.674988 11006 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:21.718662  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.674468 10661 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:21.721653 10962 consensus_queue.cc:1059] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:21.720153  8386 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:21.724107  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.724634  8464 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:02:21.724690  8395 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:21.725455  8464 pending_rounds.cc:85] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 4
I20260709 13:02:21.725935  8464 pending_rounds.cc:107] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:21.726294  8464 raft_consensus.cc:2889] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.727772  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.742288  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.745517  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.746562  8388 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:21.748983 11014 raft_consensus.cc:3055] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:21.749454 11014 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:21.750260 11014 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.751418 11014 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.752671 10791 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.756543 10887 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.757004 10482 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:21.723009  9064 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:21.758162  8462 raft_consensus.cc:2410] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:21.758669  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.722710 10962 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:02:21.760471 10612 consensus_queue.cc:1059] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:21.762068  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:21.762959 11020 log.cc:927] Time spent T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:02:21.763228  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.762072 10612 consensus_queue.cc:1059] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:02:21.764217 10547 consensus_queue.cc:1059] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:21.765964 10979 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:21.766320 10979 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:21.767141 10979 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.768452 10979 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.768565  8469 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:02:21.770388  9064 raft_consensus.cc:1240] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:21.771649 10893 raft_consensus.cc:3055] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:21.772025 10893 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:21.772281 10826 consensus_queue.cc:1059] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:21.773164 10826 raft_consensus.cc:3055] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:21.772837 10893 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:21.773561 10826 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:21.773973 10980 raft_consensus.cc:3055] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:21.774318 10980 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:21.774430 10826 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:21.775259 10980 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:21.775846 10826 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.776630 10980 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.763998  8466 raft_consensus.cc:2393] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.779390 10972 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:21.783689  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:21.793524  8464 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:02:21.794775  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.796692  8395 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:21.799855  8464 pending_rounds.cc:85] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:21.800384  8464 pending_rounds.cc:107] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:02:21.800770  8464 raft_consensus.cc:2889] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.802847  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:21.782145 10836 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:21.803133  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.804312  8467 raft_consensus.cc:2393] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.807331  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:21.812394  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:21.813333  8466 raft_consensus.cc:2410] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:02:21.812479 11016 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.401s	user 0.003s	sys 0.002s
I20260709 13:02:21.816953  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.817780  8466 raft_consensus.cc:2393] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.818674  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.820398  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.821240  8467 raft_consensus.cc:2410] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:21.823467  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.824759  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.826328  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.744269 10916 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.833195  8388 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:02:21.854985  8359 leader_election.cc:336] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.504s (SENT)
I20260709 13:02:21.855435  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:21.857478  8394 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:02:21.858115  8394 pending_rounds.cc:85] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 4
I20260709 13:02:21.858420  8394 pending_rounds.cc:107] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:21.858716  8394 raft_consensus.cc:2889] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.864107  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:21.864244  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.874953  8508 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:21.875456  8467 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:21.863721  8386 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:21.825716 10679 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:21.876403  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.876646  8388 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.876726  8508 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:21.798097 11005 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:21.827911 10893 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.797950 10791 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:02:21.831511 11004 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:21.900995  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.862959 11018 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:02:21.878510 11024 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:02:21.954237  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.961355  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:21.971647  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:21.927201  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.021899  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1480) took 2442 ms. Trace:
I20260709 13:02:22.022475  8391 rpcz_store.cc:276] 0709 13:02:19.579814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.394721 (+814907us) service_pool.cc:224] Handling call
0709 13:02:20.395027 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.714407 (+319380us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:20.821678 (+107271us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.103499 (+281821us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.292976 (+189477us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b48000030d8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe18410aa1 00007fbe18407b37 00007fbe184079ca 00007fbe184ff26f 00007fbe184fef37 00007fbe1851355c 00007fbe18513508 00007fbe18513488 00007fbe18513443 00007fbe185126ec 00007fbe1743ca96
0709 13:02:22.019648 (+726672us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b2c00000c88. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:02:22.020074 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.021530 (+  1456us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:22.021572 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.021646 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.021690 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:22.021703 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.021838 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5147,"prepare.queue_time_us":141984,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":104155,"raft.run_cpu_time_us":2245,"raft.run_wall_time_us":798445,"spinlock_wait_cycles":52459648,"thread_start_us":670734,"threads_started":3,"wal-append.queue_time_us":290988}
I20260709 13:02:21.861881 10916 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:22.025882 10916 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.029533  8539 raft_consensus.cc:2393] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:22.033280 11005 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:22.034408  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:22.035171  9064 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.863394 10999 consensus_queue.cc:1059] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.179s
I20260709 13:02:22.043216 11008 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:22.043637 11008 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:22.044523 11008 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.045758 11008 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.046792 11006 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:22.002935 11025 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:21.879829 10679 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:22.058321 10679 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.066720  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.067473  8461 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:22.066542  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.068440  8464 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:21.996025 10962 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.879000 10547 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.073354  8288 catalog_manager.cc:5697] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 6 to 7, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 7 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.075802  9064 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:22.076996  8509 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:22.077625  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.077942 10547 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:22.075551  8288 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 5 to 6, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 6 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.078433  8464 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:22.078514 10547 raft_consensus.cc:697] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:22.079466 10547 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:22.080211  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.083627  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.084278  8464 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:22.088199  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.089221  8465 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:22.098989  8391 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:21.881287 10827 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.108771  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:22.109424  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.103664 10988 log.cc:927] Time spent T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.065s	user 0.011s	sys 0.009s
I20260709 13:02:22.111356  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.005240 11004 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:22.028864 10916 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:21.865365 10482 consensus_queue.cc:1059] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.247s
W20260709 13:02:22.122159  8359 leader_election.cc:336] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.509s (SENT)
I20260709 13:02:22.122802  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:22.133109  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.147004  8358 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:22.118005 11004 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:22.165341 10836 raft_consensus.cc:3055] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:22.184325 10988 log.cc:927] Time spent T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:02:22.212605  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 65756.4us
I20260709 13:02:22.217207  8388 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:22.224738  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:22.244786  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.245923  8465 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:02:22.252050  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 129925us
I20260709 13:02:22.207898 10836 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:22.281447  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:22.282130  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 57471.9us
I20260709 13:02:22.282538  8465 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:02:22.254287 11028 log.cc:927] Time spent T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:02:22.247079 10826 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.294842  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:22.304189  9064 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:02:22.284061 10791 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.306548  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.286254 10733 raft_consensus.cc:2764] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:22.251044 10827 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:02:22.309612  8465 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
W20260709 13:02:22.308949 10979 consensus_meta.cc:287] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.001s
I20260709 13:02:22.320984  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.328858  8465 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:22.312455 10791 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:22.322625 11026 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.715s	user 0.002s	sys 0.000s
I20260709 13:02:22.325219 10679 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.310072 10916 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:22.342484  8358 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:22.346685  8358 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:22.348014  8358 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:22.349535  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.350414  8465 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:22.354729  8358 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:22.311793 10793 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:02:22.363444  8469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.014s	sys 0.042s
W20260709 13:02:22.366528  8469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.014s	sys 0.042s
I20260709 13:02:22.351681 10733 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:22.354398 10840 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.368551  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.371801  8465 raft_consensus.cc:2410] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:22.320523 10836 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.382375  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.368477 10826 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:22.406641  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.412276  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 456012us
I20260709 13:02:22.413241  8508 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:22.418538  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.370823 10840 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.373353 10793 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.373155 10733 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:22.434302  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.435129  8508 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:22.435178  8465 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:22.468451 10826 raft_consensus.cc:2764] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:02:22.499519  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.426723 10840 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.437635 10836 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:22.524948  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 170322us
I20260709 13:02:22.525609  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.532666  8465 raft_consensus.cc:2410] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:22.473143 11006 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.473398 10893 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:22.517055 10977 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.425586 10839 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:22.533810  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.437772 10793 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:22.522428 10980 consensus_meta.cc:287] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.004s
W20260709 13:02:22.575547 11037 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:02:22.586186  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:22.586565  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.587566  8465 raft_consensus.cc:2393] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:22.533936 11006 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:22.582401 11035 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:02:22.589128 11006 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:22.598915 11030 log.cc:927] Time spent T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.391s	user 0.008s	sys 0.000s
I20260709 13:02:22.609406  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.610471  8465 raft_consensus.cc:2410] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:22.612198 10793 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:22.581723 10733 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.615168  8358 leader_election.cc:400] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6.
I20260709 13:02:22.578111 10893 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:22.615100  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.589627 10679 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:22.596560  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 61477.7us
I20260709 13:02:22.621156  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:22.589253 10791 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:22.624395  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.630075 11039 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:22.633267  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.634076  8462 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:22.627255 10791 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.643893 10791 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.646176 10791 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:22.647457  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:22.648380 10839 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.648641  8507 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:22.644595 10828 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:22.650112  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:22.650300 10893 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:22.650810 11039 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.651180  8507 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:22.651484 10893 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:22.648806 10839 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.652326 10839 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.654039 11039 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:22.654707 10999 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:22.656369 11014 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:22.662915 10964 raft_consensus.cc:3055] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:22.663448 10964 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:22.664292  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:22.651911 10792 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.664994 10792 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.665434 10792 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.664321 10964 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:22.666808 11032 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.444s	user 0.000s	sys 0.008s
I20260709 13:02:22.667616 11014 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:22.671036  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1496) took 1143 ms. Trace:
I20260709 13:02:22.671542  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:22.671468  8387 rpcz_store.cc:276] 0709 13:02:21.527332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.527447 (+   115us) service_pool.cc:224] Handling call
0709 13:02:21.527746 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.541376 (+ 13630us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:21.584084 (+ 42708us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.000275 (+416191us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.040493 (+ 40218us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b180037e100. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:22.252131 (+211638us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b180037e100. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f7455 00007fbe134df060 00007fbe134f1716 00007fbe13502287 00007fbe13502208
0709 13:02:22.471158 (+219027us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.471736 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.471890 (+   154us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:22.471936 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.472015 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.471662 (+  -353us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b180037e100. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:22.666254 (+194592us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:22.670822 (+  4568us) raft_consensus.cc:1685] finished
0709 13:02:22.670847 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.670980 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36015,"prepare.queue_time_us":47425,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":55466,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":174655,"spinlock_wait_cycles":58201856,"thread_start_us":423220,"threads_started":2,"wal-append.queue_time_us":498863}
I20260709 13:02:22.673609  8536 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:22.675050 11044 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:02:22.675292  8507 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:22.675830  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:22.676151 11039 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:22.676676 11039 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:22.678037 11040 log.cc:927] Time spent T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:22.677613 11039 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.688128  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.688835  8462 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:22.692564  8394 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:02:22.699379 11042 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:02:22.700726 10998 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:22.702165 11047 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:22.702549 11047 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:22.703451 11047 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.640224 11049 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.738354  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 54290.6us
I20260709 13:02:22.687088 10916 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.752303  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.753063  8464 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:22.760998  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:22.765419 10964 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.765009 11006 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.766193  9064 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:22.769702  9032 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:22.751366 11004 consensus_meta.cc:287] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.002s
W20260709 13:02:22.819479  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 49895.1us
I20260709 13:02:22.828713  8543 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:22.749518 10793 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:22.771955 10889 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:22.842041 11002 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:22.835556 10821 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.750963 11049 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.767647 10916 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.835268 11004 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:22.894384  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 209416us
I20260709 13:02:22.898658  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1598) took 1300 ms. Trace:
I20260709 13:02:22.899904  8468 rpcz_store.cc:276] 0709 13:02:21.598296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.712399 (+114103us) service_pool.cc:224] Handling call
0709 13:02:22.045870 (+333471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.046200 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.046228 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.046682 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.372593 (+325911us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:22.372635 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.372719 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.677483 (+304764us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:22.679553 (+  2070us) raft_consensus.cc:1685] finished
0709 13:02:22.679574 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.898441 (+218867us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54000d7850. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:22.898586 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":959,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":714914560,"thread_start_us":325616,"threads_started":1,"wal-append.queue_time_us":479163}
W20260709 13:02:22.894405  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.845839 10840 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:22.851162 10793 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:22.941763  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.945719  8537 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:22.958961  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.892409 10684 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:22.959213  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:22.964360  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:22.965533  8468 raft_consensus.cc:2410] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:22.912767  9065 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:02:22.909904 10828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51684 (request call id 2) took 7495 ms. Trace:
W20260709 13:02:22.961541 11002 log.cc:927] Time spent T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:02:22.968634 10827 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.027s	sys 0.027s
I20260709 13:02:22.991525  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:22.945474 11006 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:22.908974 10679 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:02:22.984117 10547 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.983523 10791 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:23.147535  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 326180us
I20260709 13:02:23.011775  8468 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
W20260709 13:02:23.029042  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.977561  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:23.149633  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 172167us
I20260709 13:02:23.149765 11051 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:23.150417 11051 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:23.150878  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:22.981369 11052 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:23.011358 10827 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.027s	sys 0.028s
I20260709 13:02:23.160357  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:23.163004 11006 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.156666 10836 consensus_meta.cc:287] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.001s
I20260709 13:02:23.150877 11051 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.983574 10684 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:23.151964 10791 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:22.984900 11053 consensus_queue.cc:1059] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.209s
I20260709 13:02:23.029356 10792 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:23.249764  8359 leader_election.cc:336] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.560s (SENT)
I20260709 13:02:23.294629  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:23.295172  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45460.1us
I20260709 13:02:23.295600  8468 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
W20260709 13:02:23.232110  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.151684 10547 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:23.310009  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.310181  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 161330us
W20260709 13:02:23.367772  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.204656 10791 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:23.225175 11045 log.cc:927] Time spent T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.830s	user 0.009s	sys 0.000s
W20260709 13:02:23.303694 10839 consensus_meta.cc:287] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.005s
I20260709 13:02:23.187481 11006 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:23.281809 11047 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:23.262187 11041 log.cc:927] Time spent T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.726s	user 0.011s	sys 0.007s
I20260709 13:02:23.225629 10811 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.275799 10998 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:23.223862 10904 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.421674  8359 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.622s (SENT)
W20260709 13:02:23.423023  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 219801us
W20260709 13:02:23.422665  8387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.005s	sys 0.006s
I20260709 13:02:23.429136  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:23.472294  8468 raft_consensus.cc:2410] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:23.438293 10998 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:23.447463 10684 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:23.451526 10840 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:23.453552 10792 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:23.454413 10793 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:23.459858 11036 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 1.084s	user 0.005s	sys 0.015s
W20260709 13:02:23.460882 11054 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:02:23.462162 11062 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:02:23.422075 10679 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.467024 11004 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:23.472976  8387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.006s	sys 0.006s
I20260709 13:02:23.416260 10916 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:23.519485 10547 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:23.477172  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 55462.4us
I20260709 13:02:23.520557  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:23.420805 11069 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:02:23.313122 10826 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.181s
I20260709 13:02:23.525050  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:23.266130 11038 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.683s	user 0.000s	sys 0.003s
W20260709 13:02:23.528272  8359 leader_election.cc:336] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.641s (SENT)
W20260709 13:02:23.543843  8359 leader_election.cc:336] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.670s (SENT)
I20260709 13:02:23.544458  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:23.419186 10839 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:23.513281 10840 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.574169  8507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.024s	sys 0.059s
W20260709 13:02:23.576792  8507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.024s	sys 0.059s
W20260709 13:02:23.578958  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 749862us
I20260709 13:02:23.502637 10679 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:23.584532 10679 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:23.589002  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:23.528743 11056 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:23.475876 10811 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
W20260709 13:02:23.594244  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.571468 11062 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:02:23.602735  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 58950.3us
W20260709 13:02:23.609110  8359 leader_election.cc:336] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.784s (SENT)
I20260709 13:02:23.613689  8359 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:23.614180 11006 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:23.615391 10998 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:23.599083 11004 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.479980 10904 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:23.623262  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1515) took 1824 ms. Trace:
I20260709 13:02:23.640962  8395 rpcz_store.cc:276] 0709 13:02:21.798151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.799393 (+  1242us) service_pool.cc:224] Handling call
0709 13:02:21.799881 (+   488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:21.800578 (+   697us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:02:21.800621 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:21.852381 (+ 51760us) log.cc:844] Serialized 52 byte log entry
0709 13:02:22.343523 (+491142us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:22.343576 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.343643 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.261432 (+917789us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:23.612194 (+350762us) raft_consensus.cc:1685] finished
0709 13:02:23.612217 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.622547 (+ 10330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2634,"raft.queue_time_us":259,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4747,"spinlock_wait_cycles":126318336,"thread_start_us":337934,"threads_started":1,"wal-append.queue_time_us":591102}
W20260709 13:02:23.607074  8463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.009s	sys 0.028s
W20260709 13:02:23.658898  8359 leader_election.cc:336] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.812s (SENT)
I20260709 13:02:23.672125  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:23.660503  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 1149) took 2029 ms. Trace:
W20260709 13:02:23.674172  8466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.034s	sys 0.055s
I20260709 13:02:23.600457 10840 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:23.674746  8466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.034s	sys 0.056s
I20260709 13:02:23.673113  8469 rpcz_store.cc:276] 0709 13:02:21.630673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.769334 (+138661us) service_pool.cc:224] Handling call
0709 13:02:21.769606 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.781811 (+ 12205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.781844 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.782327 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.367535 (+585208us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:22.530138 (+162603us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.639311 (+109173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.639384 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.704219 (+ 64835us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b18002d7360. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:23.265359 (+561140us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:23.660185 (+394826us) raft_consensus.cc:1685] finished
0709 13:02:23.660217 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.660406 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":573,"prepare.queue_time_us":249972,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":99746,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":33162,"spinlock_wait_cycles":33190912,"thread_start_us":854760,"threads_started":3,"wal-append.queue_time_us":741699}
W20260709 13:02:23.673905  8463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.009s	sys 0.029s
W20260709 13:02:23.676251  8359 leader_election.cc:336] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.865s (SENT)
I20260709 13:02:23.676734  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:23.677997  8359 leader_election.cc:336] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.876s (SENT)
I20260709 13:02:23.650952 11053 consensus_queue.cc:1243] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer 2122d8c723e84e3da22f81f7eeb4b1a9 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:23.607954 11056 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:22.991371 10828 rpcz_store.cc:276] 0709 13:02:15.404194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.439949 (+ 35755us) service_pool.cc:224] Handling call
0709 13:02:15.561102 (+121153us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b540058f320. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13464520 00007fbe134edb42 00007fbe134ec800 00007fbe134e59fa 00007fbe184ad4c9 00007fbe11a29c54 00007fbe11a29be2 00007fbe11a29b11 00007fbe11a29a8c 00007fbe11a28d42
0709 13:02:15.854307 (+293205us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b1800069180. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe1352273d 00007fbe134edf3f 00007fbe134ed6b3 00007fbe134e59fa 00007fbe184ad4c9 00007fbe11a29c54 00007fbe11a29be2 00007fbe11a29b11 00007fbe11a29a8c 00007fbe11a28d42
0709 13:02:15.874188 (+ 19881us) log.cc:844] Serialized 494 byte log entry
0709 13:02:17.096920 (+1222732us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b1800389f20. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe117b3a20 00007fbe117c4a29 00007fbe117c513f 00007fbe117892ab
0709 13:02:17.097501 (+   581us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4c0018a140. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe117b3a20 00007fbe117c4a29 00007fbe117c513f 00007fbe117892ab 00007fbe117b6f3c 00007fbe117b73fe 00007fbe11a4450b 00007fbe13443381 00007fbe1344126b 00007fbe13447d53 00007fbe13447cd9
0709 13:02:17.130662 (+ 33161us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:22.899525 (+5768863us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37116,"raft.queue_time_us":71260,"raft.run_cpu_time_us":5074,"raft.run_wall_time_us":988484,"spinlock_wait_cycles":99536768,"thread_start_us":564332,"threads_started":2,"wal-append.queue_time_us":324570,"wal-append.run_cpu_time_us":7846,"wal-append.run_wall_time_us":1995920}
I20260709 13:02:23.621114 11072 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.677897  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:23.729887  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:23.742748  8462 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.029s
I20260709 13:02:23.645473 11080 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:23.643924 10746 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.740248 11085 raft_consensus.cc:3055] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:23.740741 11006 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.666867 10998 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.672938 11077 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:23.679754 10827 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.646517 11004 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:23.626745 11081 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.120s
W20260709 13:02:23.756291 11078 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:02:23.745618 10793 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:23.747457 11049 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:23.766245 10964 consensus_meta.cc:287] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.947s	user 0.015s	sys 0.000s
I20260709 13:02:23.756570 11085 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:23.764094 11072 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:23.746125 11080 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:23.759763 10746 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:23.783077 11066 log.cc:927] Time spent T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:02:23.765168 11006 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:23.767720 10998 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:23.784618 10828 raft_consensus.cc:3055] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:23.810364 11071 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:02:23.814487 10839 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:23.891937 11052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.014s	sys 0.020s
W20260709 13:02:23.892506 11052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.014s	sys 0.020s
I20260709 13:02:23.892990 11052 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:23.894033 11052 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:23.824154 11085 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:23.897588 11051 consensus_meta.cc:287] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.000s
I20260709 13:02:23.826743 11080 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:23.903328 11056 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:23.914228 11057 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.710s	user 0.006s	sys 0.005s
W20260709 13:02:23.905824 11082 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:02:23.916266 11080 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.914961 11051 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:23.918509 11051 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:23.951354  8279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7219cc411cf6498f8f250f689007874f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:02:23.731920  8391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.008s	sys 0.020s
W20260709 13:02:23.955305  8391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.276s	user 0.008s	sys 0.020s
I20260709 13:02:23.957396  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1533) took 1283 ms. Trace:
W20260709 13:02:23.673535  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 400281us
I20260709 13:02:23.957965  8391 rpcz_store.cc:276] 0709 13:02:22.674211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.678482 (+  4271us) service_pool.cc:224] Handling call
0709 13:02:22.678760 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.678947 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:22.679223 (+   276us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.956408 (+1277185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.956561 (+   153us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:23.956690 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.956863 (+   173us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.957210 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":467,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":1276360,"threads_started":1,"wal-append.queue_time_us":1219723}
I20260709 13:02:23.682235  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:23.964002  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 285849us
I20260709 13:02:23.966087  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1534) took 1286 ms. Trace:
W20260709 13:02:23.966512  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.966761  8387 rpcz_store.cc:276] 0709 13:02:22.679820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.680646 (+   826us) service_pool.cc:224] Handling call
0709 13:02:22.680920 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.687207 (+  6287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.687240 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.691815 (+  4575us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.498281 (+806466us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:23.498343 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.498450 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.905049 (+406599us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:23.965246 (+ 60197us) raft_consensus.cc:1685] finished
0709 13:02:23.965299 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.965843 (+   544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5932,"raft.queue_time_us":6465,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":11241,"spinlock_wait_cycles":12753792,"thread_start_us":729827,"threads_started":1,"wal-append.queue_time_us":911064}
W20260709 13:02:23.973553  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.974277  8433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.009s	sys 0.012s
W20260709 13:02:24.000234  8433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.010s	sys 0.012s
W20260709 13:02:24.000909  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 850153us
W20260709 13:02:23.974834  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.751534  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:23.751760  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.004184  8461 raft_consensus.cc:2393] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:24.004904  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 1206) took 1117 ms. Trace:
I20260709 13:02:24.005302  8461 rpcz_store.cc:276] 0709 13:02:22.887426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.751506 (+864080us) service_pool.cc:224] Handling call
0709 13:02:24.004758 (+253252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.007591  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:24.008685  8461 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:23.743752  8462 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.005s	sys 0.029s
I20260709 13:02:24.010933  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.011245  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1611) took 1264 ms. Trace:
I20260709 13:02:23.976249  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1613) took 1224 ms. Trace:
I20260709 13:02:23.976917  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1617) took 1203 ms. Trace:
I20260709 13:02:23.977519  8468 raft_consensus.cc:2410] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:23.743772  8469 raft_consensus.cc:2393] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:24.014115  8470 rpcz_store.cc:276] 0709 13:02:22.751137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.751953 (+   816us) service_pool.cc:224] Handling call
0709 13:02:22.817372 (+ 65419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.817819 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.817860 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.827217 (+  9357us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.153003 (+325786us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:23.153048 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.153117 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.975513 (+822396us) raft_consensus.cc:1685] finished
0709 13:02:23.975562 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.975934 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6460,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11928,"thread_start_us":315254,"threads_started":1,"wal-append.queue_time_us":706103}
I20260709 13:02:24.016222  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 1203) took 1131 ms. Trace:
I20260709 13:02:24.016753  8469 rpcz_store.cc:276] 0709 13:02:22.884689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.675943 (+791254us) service_pool.cc:224] Handling call
0709 13:02:24.016004 (+340061us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:23.978060  8465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.007s	sys 0.017s
W20260709 13:02:23.965627  8359 leader_election.cc:336] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.882s (SENT)
I20260709 13:02:24.011822  8462 rpcz_store.cc:276] 0709 13:02:22.746449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.747186 (+   737us) service_pool.cc:224] Handling call
0709 13:02:22.747498 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.747673 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:22.771443 (+ 23770us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.010414 (+1238971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.010555 (+   141us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.010690 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.010795 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.011058 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105617,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":529812,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":11029,"thread_start_us":1238238,"threads_started":2,"wal-append.queue_time_us":749994}
W20260709 13:02:24.018024  8465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.008s	sys 0.017s
I20260709 13:02:24.018205  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.019575  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1612) took 1271 ms. Trace:
I20260709 13:02:24.019431  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.002146  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.020562  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:24.020759  8462 raft_consensus.cc:1813] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Handling vote request from an unknown peer 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:24.021456  8469 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.021878  8462 raft_consensus.cc:2410] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:02:24.022208  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.023562  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.024914  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:24.020124  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54738us
I20260709 13:02:24.026499  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.014190  8467 rpcz_store.cc:276] 0709 13:02:22.773425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.773944 (+   519us) service_pool.cc:224] Handling call
0709 13:02:22.838515 (+ 64571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:22.838997 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.839036 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:22.848479 (+  9443us) log.cc:844] Serialized 52 byte log entry
0709 13:02:23.176433 (+327954us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:23.204075 (+ 27642us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.543329 (+339254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.543416 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.976239 (+432823us) raft_consensus.cc:1685] finished
0709 13:02:23.976288 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.976696 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12683,"prepare.queue_time_us":134252,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2570,"raft.queue_time_us":535933,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":5874,"thread_start_us":631026,"threads_started":2,"wal-append.queue_time_us":631946}
I20260709 13:02:24.027654  8470 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:24.028607  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 1196) took 1191 ms. Trace:
I20260709 13:02:24.029016  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.029184  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.029887  8467 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:24.030484  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 1208) took 1142 ms. Trace:
I20260709 13:02:24.030866  8467 rpcz_store.cc:276] 0709 13:02:22.887987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.028615 (+1140628us) service_pool.cc:224] Handling call
0709 13:02:24.030398 (+  1783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.032186  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.032907  8467 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:24.020136  8465 rpcz_store.cc:276] 0709 13:02:22.748114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.748846 (+   732us) service_pool.cc:224] Handling call
0709 13:02:22.749141 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.749818 (+   677us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:02:22.749844 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.750305 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.018978 (+1268673us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:24.019054 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.019173 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.019232 (+    59us) raft_consensus.cc:1685] finished
0709 13:02:24.019250 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.019501 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279,"raft.queue_time_us":1285,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":17083,"thread_start_us":1180678,"threads_started":1,"wal-append.queue_time_us":1044907}
I20260709 13:02:24.035704  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.037416  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:24.037954  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 1207) took 1134 ms. Trace:
I20260709 13:02:24.029163  8470 rpcz_store.cc:276] 0709 13:02:22.837047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.017638 (+1180591us) service_pool.cc:224] Handling call
0709 13:02:24.028469 (+ 10831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.038854  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:24.039815  8465 raft_consensus.cc:2376] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8. Re-sending same reply.
I20260709 13:02:24.039850  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:24.040446  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 1195) took 1210 ms. Trace:
I20260709 13:02:24.040807  8465 rpcz_store.cc:276] 0709 13:02:22.829691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.038506 (+1208815us) service_pool.cc:224] Handling call
0709 13:02:24.040399 (+  1893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.030838  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.044188  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.045095  8535 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:24.047204  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.047412  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 1119) took 1377 ms. Trace:
I20260709 13:02:24.047847  8537 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:24.050210  8538 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:24.047981  8539 rpcz_store.cc:276] 0709 13:02:22.670019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.670130 (+   111us) service_pool.cc:224] Handling call
0709 13:02:22.670455 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:22.675548 (+  5093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.675578 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:22.676123 (+   545us) log.cc:844] Serialized 52 byte log entry
0709 13:02:22.906891 (+230768us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:22.906954 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.907051 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.906106 (+999055us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:24.046590 (+140484us) raft_consensus.cc:1685] finished
0709 13:02:24.046635 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.047122 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4684,"raft.queue_time_us":5019,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":3517696,"thread_start_us":217170,"threads_started":1,"wal-append.queue_time_us":475264}
I20260709 13:02:24.051165  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.052222  8540 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:24.052526  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:24.054016  8542 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:02:24.061012  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.052449  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.062805  8541 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:24.067813 10840 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:24.068401 10746 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.069108 10840 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.070188 10904 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.071012 11006 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.070185 10998 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.072917 10998 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.822481 10811 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:23.811225 10828 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:23.830056 11004 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.041927  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.033555  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 1635) took 1052 ms. Trace:
I20260709 13:02:24.038563  8462 rpcz_store.cc:276] 0709 13:02:22.887714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.018906 (+1131192us) service_pool.cc:224] Handling call
0709 13:02:24.022508 (+  3602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.092798  8467 rpcz_store.cc:276] 0709 13:02:22.981266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.031802 (+1050536us) service_pool.cc:224] Handling call
0709 13:02:24.033488 (+  1686us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:24.028228  8359 leader_election.cc:336] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.926s (SENT)
I20260709 13:02:24.053633  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.098171 11094 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:24.098534 11092 raft_consensus.cc:2764] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:24.098713 11094 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:24.099196 11094 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.099581 11092 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:24.100061 11092 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:24.103569 11056 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:24.104910 11081 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.105666  8470 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:24.105878 11081 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.105412 11051 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:24.108471 11014 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.109246 11014 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.111735 11014 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.112119  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.112462 10992 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.112826 10547 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.113030  8462 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
I20260709 13:02:24.108521 11051 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:24.100553 11092 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:24.122437  8469 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
W20260709 13:02:24.125921  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 82734.2us
I20260709 13:02:24.073766 10998 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.153677  8543 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:24.154718 10998 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:24.076725 10828 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.156493 10828 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.113111 10992 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.130590 11047 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.162381 11047 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.137409 11098 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:24.166287 11098 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:24.167877 11098 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.177000 11047 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:24.177309 10793 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:24.178011 10793 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:24.146668  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 118560us
I20260709 13:02:24.113634 11088 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:24.173496  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.161655 10992 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.182680  9033 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.184274  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 69) took 1405 ms. Trace:
I20260709 13:02:24.184778  9065 rpcz_store.cc:276] 0709 13:02:22.778700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.835272 (+ 56572us) service_pool.cc:224] Handling call
0709 13:02:22.882568 (+ 47296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.994052 (+111484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.183471 (+1189419us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b5400163354. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:24.184012 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6010752}
I20260709 13:02:24.186779 11083 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:24.185267 11051 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.187467 11083 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.188057 11083 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.181404 11088 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:24.190421 11088 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:24.192293  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.195749  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.113705 10547 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.196687  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 1199) took 1338 ms. Trace:
W20260709 13:02:24.197275 11055 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.998s	user 0.000s	sys 0.017s
I20260709 13:02:24.194180  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:24.198278  9067 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:24.198622 11081 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.199980 11085 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.198647  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.201095 10547 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.201218  8391 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
I20260709 13:02:24.197108  8462 rpcz_store.cc:276] 0709 13:02:22.857896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.195408 (+1337512us) service_pool.cc:224] Handling call
0709 13:02:24.196605 (+  1197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.205351  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.205878  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.206773  8469 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:24.207894  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:24.209681  8469 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:24.210369  8465 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:24.211565  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1535) took 1531 ms. Trace:
W20260709 13:02:24.222112  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.223248  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1620) took 1396 ms. Trace:
I20260709 13:02:24.225966  8469 rpcz_store.cc:276] 0709 13:02:22.818626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.209012 (+1390386us) service_pool.cc:224] Handling call
0709 13:02:24.209428 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.214782 (+  5354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.214992 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.230072  8461 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:24.228947  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1623) took 1381 ms. Trace:
I20260709 13:02:24.231662  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 1629) took 1347 ms. Trace:
I20260709 13:02:24.231882  8469 rpcz_store.cc:276] 0709 13:02:22.847765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.227636 (+1379871us) service_pool.cc:224] Handling call
0709 13:02:24.228138 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.228456 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.228493 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.228573 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.228617 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.228692 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.228850 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.234234  8461 rpcz_store.cc:276] 0709 13:02:22.884242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.007015 (+1122773us) service_pool.cc:224] Handling call
0709 13:02:24.231598 (+224583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.238656  8360 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:24.247908 10827 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:24.248857 10827 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.124814 11094 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.251915 11094 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:24.253456  8359 leader_election.cc:336] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.081s (SENT)
I20260709 13:02:24.254019  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.255913  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.257128  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.258201  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.258740  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1622) took 1422 ms. Trace:
I20260709 13:02:24.259447 11052 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:24.259981 11052 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:24.261134 11089 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:24.260990 11052 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.261669 11089 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:24.262187 11101 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.262658 11101 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:24.263064 11101 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.262790 11089 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.259135  8465 rpcz_store.cc:276] 0709 13:02:22.836073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.213734 (+1377661us) service_pool.cc:224] Handling call
0709 13:02:24.258041 (+ 44307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.258409 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.258435 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.258475 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.258502 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.258554 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.258663 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.266914  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.215091  8393 rpcz_store.cc:276] 0709 13:02:22.680437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.683406 (+  2969us) service_pool.cc:224] Handling call
0709 13:02:22.707290 (+ 23884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.212950 (+505660us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:23.350972 (+138022us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.962277 (+611305us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.962596 (+   319us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.963842 (+  1246us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.964014 (+   172us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:23.964070 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.210994 (+246924us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400049554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:24.211049 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.211197 (+   148us) raft_consensus.cc:1685] finished
0709 13:02:24.211213 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.211386 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":274221,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":96,"raft.queue_time_us":190578,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":25079,"spinlock_wait_cycles":431414656,"thread_start_us":927379,"threads_started":3,"wal-append.queue_time_us":467119}
W20260709 13:02:24.299101 11039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.016s	sys 0.027s
W20260709 13:02:24.299556 11039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.016s	sys 0.027s
I20260709 13:02:24.289165 10992 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:24.312628  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45096.6us
I20260709 13:02:24.312814  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:24.313706  9065 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:24.314833  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:24.315822 10733 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.316313 10733 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.316721 10733 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:24.318185  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 64784.9us
W20260709 13:02:24.319523  8359 leader_election.cc:336] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.081s (SENT)
I20260709 13:02:24.320025  8359 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.322373  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1627) took 1447 ms. Trace:
I20260709 13:02:24.322948  8462 rpcz_store.cc:276] 0709 13:02:22.875318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.295899 (+1420581us) service_pool.cc:224] Handling call
0709 13:02:24.321424 (+ 25525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.321776 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.321836 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.321923 (+    87us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.321967 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.322054 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.322262 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.325172  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1628) took 1447 ms. Trace:
I20260709 13:02:24.326099 11058 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.382639  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:24.329685 10964 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.330370 10964 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.333153 10964 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.334671  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:02:24.335134  8359 leader_election.cc:336] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.082s (SENT)
I20260709 13:02:24.335523  8467 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:24.335952  8470 rpcz_store.cc:276] 0709 13:02:22.877358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.323645 (+1446287us) service_pool.cc:224] Handling call
0709 13:02:24.324206 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.324684 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.324725 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.324786 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.324853 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.324944 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.325096 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.325205  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1630) took 1434 ms. Trace:
I20260709 13:02:24.337600  8462 rpcz_store.cc:276] 0709 13:02:22.891371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.324041 (+1432670us) service_pool.cc:224] Handling call
0709 13:02:24.324553 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.324863 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.324891 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.324954 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.324987 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.325043 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.325150 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.339320  8359 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.349596  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1621) took 1512 ms. Trace:
I20260709 13:02:24.350075  8467 rpcz_store.cc:276] 0709 13:02:22.828036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.213038 (+1385002us) service_pool.cc:224] Handling call
0709 13:02:24.266818 (+ 53780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.340172 (+ 73354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.340347 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:24.343736  8468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 1619) took 1567 ms (client timeout 1785 ms). Trace:
W20260709 13:02:24.361147  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46541.2us
I20260709 13:02:24.379851  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:24.353736  8468 rpcz_store.cc:269] 0709 13:02:22.777142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.540611 (+763469us) service_pool.cc:224] Handling call
0709 13:02:24.343483 (+802872us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540039f654. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:24.343654 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888563456}
I20260709 13:02:24.381628  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:24.310853 11092 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.360368 11004 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:24.392732  8509 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:24.395758  8386 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:24.397953  9035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.398074  8470 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:24.399850  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1632) took 1493 ms. Trace:
I20260709 13:02:24.400215  8470 rpcz_store.cc:276] 0709 13:02:22.906433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.398811 (+1492378us) service_pool.cc:224] Handling call
0709 13:02:24.399187 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.399502 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.399530 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.399588 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.399635 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.399690 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.399796 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.360924 10836 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.402048 10836 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:24.402565 10836 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.414454 11092 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:24.354243 11049 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.418080  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.358017 10916 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.417297  8465 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:24.353996 11088 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.429062 11081 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.429878 11081 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.430341  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:02:24.430651 10791 consensus_meta.cc:287] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.995s	user 0.018s	sys 0.002s
I20260709 13:02:24.430843 11092 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:24.431200 10791 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.433164 11081 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.382736 10992 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:24.444419  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 56488.7us
I20260709 13:02:24.425859 11006 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.417694 10827 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.421015 10836 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.448114 11105 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:24.449808 10992 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.450033  8461 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:24.449832 11088 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:24.452072  8508 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.437325 10791 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.454377  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:24.475078  9067 raft_consensus.cc:2410] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:02:24.458417  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
W20260709 13:02:24.475885  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.479707 10733 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.481639  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1539) took 1799 ms. Trace:
I20260709 13:02:24.462934 10793 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.482108  8388 rpcz_store.cc:276] 0709 13:02:22.682287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.682394 (+   107us) service_pool.cc:224] Handling call
0709 13:02:22.682666 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.357531 (+674865us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:23.395016 (+ 37485us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.120103 (+725087us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.137016 (+ 16913us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.137336 (+   320us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.137396 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.481097 (+343701us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54002670d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:24.481145 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.481190 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:24.481291 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.481443 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36262,"prepare.queue_time_us":40282,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":169940,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":26004,"spinlock_wait_cycles":489852672,"thread_start_us":1031572,"threads_started":3,"wal-append.queue_time_us":367797}
I20260709 13:02:24.483952 10793 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:24.484988  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1618) took 1711 ms. Trace:
I20260709 13:02:24.486042  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1624) took 1633 ms. Trace:
I20260709 13:02:24.486588  8469 rpcz_store.cc:276] 0709 13:02:22.852381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.234857 (+1382476us) service_pool.cc:224] Handling call
0709 13:02:24.297837 (+ 62980us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:24.334119 (+ 36282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.334151 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:24.334847 (+   696us) log.cc:844] Serialized 52 byte log entry
0709 13:02:24.420737 (+ 85890us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.420808 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.420902 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.485716 (+ 64814us) raft_consensus.cc:1685] finished
0709 13:02:24.485744 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.485947 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4461,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":37692,"thread_start_us":84650,"threads_started":1,"wal-append.queue_time_us":148402}
I20260709 13:02:24.488845  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.490438  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1626) took 1619 ms. Trace:
I20260709 13:02:24.485419  8466 rpcz_store.cc:276] 0709 13:02:22.773756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.776135 (+  2379us) service_pool.cc:224] Handling call
0709 13:02:22.776486 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.980387 (+203901us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:22.994909 (+ 14522us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.978757 (+983848us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.978875 (+   118us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:23.979047 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.484596 (+505549us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54000c9754. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:24.484646 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.484821 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":226286,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":41223,"raft.queue_time_us":106620,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":468334976,"thread_start_us":983215,"threads_started":2,"wal-append.queue_time_us":674795}
I20260709 13:02:24.490846  8465 rpcz_store.cc:276] 0709 13:02:22.870722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.266147 (+1395425us) service_pool.cc:224] Handling call
0709 13:02:24.307935 (+ 41788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.422451 (+114516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.490211 (+ 67760us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54000d6e54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:24.490380 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251009408}
I20260709 13:02:24.491649  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.492026  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:24.492378  8466 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:24.492920  8465 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:24.489670  8469 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:24.434412 11092 raft_consensus.cc:697] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:02:24.499272  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 191922us
I20260709 13:02:24.414917 11083 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.500229  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.467957 11105 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.502090 11105 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.496315 10684 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:24.498907 11092 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.463299 11101 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:24.495960  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 44048.2us
I20260709 13:02:24.463233 11006 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.538636 11006 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.540088  8543 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:24.540307 11101 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:24.541334 10893 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.005s	sys 0.007s
W20260709 13:02:24.541770 10893 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.006s	sys 0.007s
I20260709 13:02:24.544339  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.545162  8395 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:24.509913  8466 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:02:24.545944  8466 pending_rounds.cc:85] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:24.546204  8466 pending_rounds.cc:107] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:02:24.546481  8466 raft_consensus.cc:2889] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.546790 11083 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.547168  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1634) took 1600 ms. Trace:
W20260709 13:02:24.547377  8359 leader_election.cc:336] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.115s (SENT)
I20260709 13:02:24.547533  8466 rpcz_store.cc:276] 0709 13:02:22.946928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.493367 (+1546439us) service_pool.cc:224] Handling call
0709 13:02:24.494712 (+  1345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.546947 (+ 52235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.547120 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.547832  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.548228 10684 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:24.548638  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:24.510077  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.549377 10684 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:24.550752  8359 leader_election.cc:336] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.544s (SENT)
I20260709 13:02:24.551273  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.508174 11051 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.553637 10836 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.553941 11051 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:24.554557 11051 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.524438  8464 raft_consensus.cc:2410] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:24.524784  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.555809  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1636) took 1570 ms. Trace:
I20260709 13:02:24.556037  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1614) took 1803 ms. Trace:
I20260709 13:02:24.556676  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.557483  8391 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:02:24.557561  8464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 1205) took 1670 ms (client timeout 1900 ms). Trace:
W20260709 13:02:24.558059  8464 rpcz_store.cc:269] 0709 13:02:22.887129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.751196 (+864067us) service_pool.cc:224] Handling call
0709 13:02:24.557336 (+806140us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b5400238054. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:24.557497 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198288256}
I20260709 13:02:24.558440  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.559198  8391 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:24.559839  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1642) took 1032 ms. Trace:
I20260709 13:02:24.560150  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.560227  8464 rpcz_store.cc:276] 0709 13:02:23.527267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.558868 (+1031601us) service_pool.cc:224] Handling call
0709 13:02:24.559264 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.559512 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.559536 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.559611 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.559637 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.559697 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.559791 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.561249  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:24.561915  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.525173  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.562141  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.562542  8393 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:24.565294  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.565598  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.566180  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:24.569345  8541 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:24.569630  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.569979  8391 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.570140  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:24.520524  8467 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:24.571061  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1638) took 1364 ms. Trace:
I20260709 13:02:24.571194  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.527701  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.528388  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.572415  8387 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:24.572584  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.528856  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.573237  8395 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:24.573735  8389 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:24.530901  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1625) took 1665 ms. Trace:
I20260709 13:02:24.527421  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1639) took 1234 ms. Trace:
I20260709 13:02:24.575613  8461 rpcz_store.cc:276] 0709 13:02:22.865750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.239549 (+1373799us) service_pool.cc:224] Handling call
0709 13:02:24.259809 (+ 20260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.468666 (+208857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.530632 (+ 61966us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400120554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:24.530810 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437015296}
I20260709 13:02:24.532002  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.537396  9064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58874 (request call id 109) took 1017 ms. Trace:
I20260709 13:02:24.531738  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.548758 10977 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.575668  8462 rpcz_store.cc:276] 0709 13:02:23.293381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.526445 (+1233064us) service_pool.cc:224] Handling call
0709 13:02:24.526824 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.527084 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.527112 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.527164 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:24.527192 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.527249 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.527348 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.582827  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.534170  8288 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 32) took 8669 ms. Trace:
I20260709 13:02:24.463418 11004 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.583003  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1643) took 1053 ms. Trace:
I20260709 13:02:24.585583  8464 rpcz_store.cc:276] 0709 13:02:23.529290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.561400 (+1032110us) service_pool.cc:224] Handling call
0709 13:02:24.561709 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.582386 (+ 20677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.582412 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.582453 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.582480 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.582539 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.582653 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.556216  8465 rpcz_store.cc:276] 0709 13:02:22.985193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.493629 (+1508436us) service_pool.cc:224] Handling call
0709 13:02:24.507343 (+ 13714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.555440 (+ 48097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.555471 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.555535 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.555585 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.555652 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.555754 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.571477  8467 rpcz_store.cc:276] 0709 13:02:23.206386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.519690 (+1313304us) service_pool.cc:224] Handling call
0709 13:02:24.520081 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.570748 (+ 50667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.570998 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.583072  8391 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:24.583439  8388 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.589308  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.583901  8288 rpcz_store.cc:276] 0709 13:02:15.865005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.865233 (+   228us) service_pool.cc:224] Handling call
0709 13:02:24.533938 (+8668705us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:22.585055 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:22.755333 (+170278us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:22.757585 (+  2252us) write_op.cc:435] Acquired schema lock
0709 13:02:22.757608 (+    23us) tablet.cc:662] Decoding operations
0709 13:02:22.758209 (+   601us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:22.758266 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:22.758296 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:22.758634 (+   338us) tablet.cc:701] Row locks acquired
0709 13:02:22.758652 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:22.758790 (+   138us) write_op.cc:270] Start()
0709 13:02:22.758900 (+   110us) write_op.cc:276] Timestamp: P: 1783602142758749 usec, L: 0
0709 13:02:22.758925 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:22.759579 (+   654us) log.cc:844] Serialized 1354 byte log entry
0709 13:02:23.827010 (+1067431us) op_driver.cc:464] REPLICATION: finished
0709 13:02:23.919470 (+ 92460us) write_op.cc:301] APPLY: starting
0709 13:02:23.919575 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:23.919745 (+   170us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:23.919847 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:23.920238 (+   391us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:23.920404 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:02:23.920445 (+    41us) write_op.cc:312] APPLY: finished
0709 13:02:23.920673 (+   228us) log.cc:844] Serialized 34 byte log entry
0709 13:02:23.920846 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:23.920935 (+    89us) write_op.cc:454] Released schema lock
0709 13:02:23.920976 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:23.921297 (+   321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:23.921325 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3641089,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":88804,"apply.run_cpu_time_us":1833,"apply.run_wall_time_us":2000,"num_ops":3,"prepare.queue_time_us":451936,"prepare.run_cpu_time_us":13462,"prepare.run_wall_time_us":574843,"raft.queue_time_us":369648,"raft.run_cpu_time_us":34801,"raft.run_wall_time_us":91945,"replication_time_us":1061659,"spinlock_wait_cycles":14080,"thread_start_us":1032310,"threads_started":4,"wal-append.queue_time_us":655696}]]}
I20260709 13:02:24.595796 11004 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.595999  8394 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:24.596378 10826 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.597308  8392 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:24.598104  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.582403  9064 rpcz_store.cc:276] 0709 13:02:23.519587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.519762 (+   175us) service_pool.cc:224] Handling call
0709 13:02:24.183945 (+664183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.184666 (+   721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.184711 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.185270 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.297749 (+112479us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:24.302396 (+  4647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.305083 (+  2687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.535825 (+230742us) raft_consensus.cc:1685] finished
0709 13:02:24.535862 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.536980 (+  1118us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400163350. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:24.537208 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18267,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":171,"spinlock_wait_cycles":1526435072,"thread_start_us":105151,"threads_started":1,"wal-append.queue_time_us":236982}
I20260709 13:02:24.597885  8390 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:24.604835  8388 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:24.605818  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.608990  8469 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:24.609813  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1637) took 1408 ms. Trace:
I20260709 13:02:24.610222  8469 rpcz_store.cc:276] 0709 13:02:23.201491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.507385 (+1305894us) service_pool.cc:224] Handling call
0709 13:02:24.608728 (+101343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.609508 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.609728 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.605903  8393 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:24.556433  8463 rpcz_store.cc:276] 0709 13:02:22.752237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.753003 (+   766us) service_pool.cc:224] Handling call
0709 13:02:22.753250 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.753420 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:23.015813 (+262393us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.473547 (+1457734us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b180001be20. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe1308f4bc 00007fbe103dd48b 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a
0709 13:02:24.555476 (+ 81929us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.555562 (+    86us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:24.555649 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.555714 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.555857 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17824,"prepare.queue_time_us":139594,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":23060,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":95,"spinlock_wait_cycles":13069696,"thread_start_us":841157,"threads_started":2,"wal-append.queue_time_us":656410}
I20260709 13:02:24.613301  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1641) took 1255 ms. Trace:
I20260709 13:02:24.613634  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.615792  8390 raft_consensus.cc:2410] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:24.613610  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 214) took 1049 ms. Trace:
I20260709 13:02:24.613857  8466 rpcz_store.cc:276] 0709 13:02:23.357731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.577815 (+1220084us) service_pool.cc:224] Handling call
0709 13:02:24.612602 (+ 34787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.612909 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.612944 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.613014 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:24.613049 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.613118 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.613235 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.616691  8461 rpcz_store.cc:276] 0709 13:02:23.563910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.576750 (+1012840us) service_pool.cc:224] Handling call
0709 13:02:24.613096 (+ 36346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.613299 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.613321 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.613381 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:24.613409 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.613459 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.613559 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.623576  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.641566  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:24.628154 10733 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.645689  8465 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:24.648197  8462 raft_consensus.cc:1240] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:24.651911  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 215) took 1078 ms. Trace:
I20260709 13:02:24.652315  8462 rpcz_store.cc:276] 0709 13:02:23.574006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.616111 (+1042105us) service_pool.cc:224] Handling call
0709 13:02:24.646334 (+ 30223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.651682 (+  5348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.651859 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.662705  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:24.662916  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.664865  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.647712  9065 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:24.667747  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 117068us
I20260709 13:02:24.668506  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.671458  8387 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:24.673102  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.648625 11004 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:24.669561 10684 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.675060  9032 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.676222 11083 consensus_queue.cc:1059] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:24.677112  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:24.681860  8290 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50744 (request call id 158) took 16965 ms (client timeout 15000 ms). Trace:
W20260709 13:02:24.688792  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.673422  8508 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.693470  8463 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:02:24.695636  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:24.697765 11105 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:24.699023  8543 raft_consensus.cc:2368] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:02:24.700582  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.707047  8394 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:24.705500 10684 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.708726  8541 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:24.710029 10684 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.711977 11105 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:24.714747  8395 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:24.693912  8463 pending_rounds.cc:85] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 8
I20260709 13:02:24.718030  8463 pending_rounds.cc:107] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:02:24.718276  8463 raft_consensus.cc:2889] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:24.727723  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 91833.5us
I20260709 13:02:24.684947 11004 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.730311 10729 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:24.730589  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet ef4deccb7c274fec97786db5d6131514 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
W20260709 13:02:24.730737  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 57399.4us
I20260709 13:02:24.663630 11006 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:24.736586  8359 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.599s (SENT)
I20260709 13:02:24.737510 10729 raft_consensus.cc:697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:24.738116  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.750361  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.732191 11105 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:24.734040 11004 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.759611  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1631) took 1859 ms. Trace:
I20260709 13:02:24.764382  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.759080 11105 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.773291  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.775390  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.776114  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.778025  8394 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.776455  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:24.780220 11121 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:02:24.780369 11051 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.781667  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.782456  8543 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:24.782593 11051 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:24.785887 11105 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.789955  8289 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:24.791728  8289 catalog_manager.cc:5697] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:24.763510 10733 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:24.795166  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.798725  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.797763  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.794785  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1633) took 1885 ms. Trace:
I20260709 13:02:24.799945  8470 rpcz_store.cc:276] 0709 13:02:22.909250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.401130 (+1491880us) service_pool.cc:224] Handling call
0709 13:02:24.401535 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.410457 (+  8922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.410493 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.410958 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.447591 (+ 36633us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.447636 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.447709 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.794503 (+346794us) raft_consensus.cc:1685] finished
0709 13:02:24.794524 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.794722 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":36190,"threads_started":1,"wal-append.queue_time_us":96874}
I20260709 13:02:24.798187  8388 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:24.805225  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.793471  8289 catalog_manager.cc:5697] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } }
I20260709 13:02:24.807053  8541 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
W20260709 13:02:24.690101  8290 rpcz_store.cc:269] 0709 13:02:07.718755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.740210 (+ 21455us) service_pool.cc:224] Handling call
0709 13:02:24.681611 (+16941401us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:17.002356 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:17.002988 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:17.003051 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:02:17.003075 (+    24us) tablet.cc:662] Decoding operations
0709 13:02:17.087999 (+ 84924us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:17.098131 (+ 10132us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:17.098186 (+    55us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:02:17.100570 (+  2384us) tablet.cc:701] Row locks acquired
0709 13:02:17.100594 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:02:17.100773 (+   179us) write_op.cc:270] Start()
0709 13:02:17.100930 (+   157us) write_op.cc:276] Timestamp: P: 1783602137100701 usec, L: 0
0709 13:02:17.100965 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:02:17.149804 (+ 48839us) log.cc:844] Serialized 9250 byte log entry
0709 13:02:18.280923 (+1131119us) op_driver.cc:464] REPLICATION: finished
0709 13:02:18.559453 (+278530us) write_op.cc:301] APPLY: starting
0709 13:02:18.562952 (+  3499us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:18.675856 (+112904us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:18.683214 (+  7358us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:18.697598 (+ 14384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:18.697917 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:02:18.697963 (+    46us) write_op.cc:312] APPLY: finished
0709 13:02:18.698331 (+   368us) log.cc:844] Serialized 157 byte log entry
0709 13:02:18.701956 (+  3625us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:18.702135 (+   179us) write_op.cc:454] Released schema lock
0709 13:02:18.702202 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:18.718502 (+ 16300us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:18.718534 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":825072,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":222380,"apply.run_cpu_time_us":5361,"apply.run_wall_time_us":174468,"num_ops":23,"prepare.queue_time_us":482183,"prepare.run_cpu_time_us":52946,"prepare.run_wall_time_us":516477,"raft.queue_time_us":279830,"raft.run_cpu_time_us":20644,"raft.run_wall_time_us":289846,"replication_time_us":1136919,"thread_start_us":805612,"threads_started":4,"wal-append.queue_time_us":463834,"wal-append.run_cpu_time_us":22724,"wal-append.run_wall_time_us":2082980}]]}
I20260709 13:02:24.813449  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:24.814445  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.815402  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:24.817920  8543 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:02:24.818764  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 93029.1us
I20260709 13:02:24.819494  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:02:24.819705  8359 leader_election.cc:336] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.180s (SENT)
I20260709 13:02:24.820221  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.820631 10972 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:24.821273 10972 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:24.820942 10729 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:24.822060 11127 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:02:24.822408 11128 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:02:24.822523 10977 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.822089 10826 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:24.822629 10972 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.834529  9065 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:24.842140  8289 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 6, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:24.848575  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:24.855580  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.855693 10792 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:24.868744  8394 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:24.823239 10977 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.882359  8360 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:24.884752 10904 raft_consensus.cc:3055] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:24.885298 10904 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:24.886394 10904 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:24.887518 10733 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.888047 10733 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:24.888486 10733 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.892756 11004 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.894603 11075 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:24.896180 10979 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:24.896595 10979 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:24.897541 10979 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.898350 11006 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:24.899580  8508 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.900918  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.870096 11039 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:24.906571  8508 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.827808 10684 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:24.935609 10684 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:24.936055 10684 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:24.939371  8508 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:24.908777  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:24.912441 11124 log.cc:927] Time spent T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.192s	user 0.003s	sys 0.000s
I20260709 13:02:24.918953 10827 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:24.762699  8468 rpcz_store.cc:276] 0709 13:02:22.899915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.385418 (+1485503us) service_pool.cc:224] Handling call
0709 13:02:24.435888 (+ 50470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.464091 (+ 28203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:24.635004 (+170913us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.754648 (+119644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.754708 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.759346 (+  4638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.759422 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.759560 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7136,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4472,"thread_start_us":177272,"threads_started":2}
I20260709 13:02:24.924129 10979 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:24.933591  8359 leader_election.cc:336] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.503s (SENT)
I20260709 13:02:24.927261  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:24.928176 11073 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:02:24.933557 10547 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:24.906383 10826 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:24.934337 11006 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:24.962013  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.906785 11039 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.963644  8289 catalog_manager.cc:5697] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:24.941342  8543 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:24.888453 10904 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.980227  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.985829  8387 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:24.984951  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.976557  8289 catalog_manager.cc:5697] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:24.981554  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:24.937201 10684 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:24.989392  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 55870.1us
W20260709 13:02:24.990329  8359 leader_election.cc:336] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.532s (SENT)
I20260709 13:02:24.990871  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:24.965497 10547 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.963781 11070 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:25.001601  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.968890 11006 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.002632  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:24.969142 11039 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.013649  8542 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:24.989274  8289 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 4 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.983237 10826 raft_consensus.cc:697] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:24.997030  9065 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:24.968456 11105 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.002267 11049 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.031965  8358 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:25.003616 10547 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.982707 10827 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:25.017911 11006 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.003428 11070 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:25.045890  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 46895.3us
I20260709 13:02:25.046391 10679 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:25.070906 11106 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:25.070245 11039 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:24.974057 10916 consensus_queue.cc:1059] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:02:25.084203 10733 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.086666 11004 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.092536  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:25.001646 10836 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:02:25.021493 10977 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:25.097968  8289 catalog_manager.cc:5697] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 6, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 6 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:25.093070  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 75439.5us
I20260709 13:02:25.093811 11070 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.113317  8289 catalog_manager.cc:5697] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:25.115356  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:25.116773  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.115069 10977 raft_consensus.cc:2764] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:25.096078 11106 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:25.122705  8358 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:25.123976  8358 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:25.135545  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.142429 11101 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:25.143044 11101 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.144882 11073 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.145206 11101 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:25.149297 10916 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:25.158347  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.171957  8289 catalog_manager.cc:5697] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 4 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.148509 11073 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.185667 10839 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:02:25.190474  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:25.191349 10733 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:25.177929 11073 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:25.200037  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 209764us
I20260709 13:02:25.153546 11065 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:02:25.201159 11105 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.210278 10827 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:25.211941  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:25.212656  9065 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:25.214017  8360 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:25.218504 11049 raft_consensus.cc:3055] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.218935 11049 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:25.219774 11049 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.221005 11049 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.228451  8507 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:25.230129 10836 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.233584 11039 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.230891 10811 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:25.188732 11106 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.235883 10811 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.236416 10811 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:25.236511 11106 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.231763 10992 consensus_queue.cc:1059] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:25.242619 10827 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:25.243155 10827 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:25.243578 10827 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.237969 10811 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.202389  8289 catalog_manager.cc:5697] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 7, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:25.251263 10839 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:25.269270 10839 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:25.270232 10839 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.271492 10839 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.251333 10827 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:25.275779 10827 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:25.251896 10811 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.233517 10836 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:02:25.283860  8395 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:25.284400 11070 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.284956  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:25.239317  8507 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.285952 10684 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:25.286418  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 47195.4us
I20260709 13:02:25.288749  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.290853 11083 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:25.298108  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.297580  9065 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:25.299847  8360 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:25.300376  8391 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.300848 10977 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:25.301402 10977 raft_consensus.cc:697] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:25.302507 10977 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:25.305585  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:25.316320 10547 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.318972 10547 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.253446  8289 catalog_manager.cc:5697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 4 to 5, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 5 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.249341 11006 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.255647  8541 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.259979 10992 raft_consensus.cc:3055] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:25.260783 11092 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.139564 10826 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:25.322505 10979 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.323421 10836 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.331053  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:25.338671  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 105575us
W20260709 13:02:25.345244  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 221372us
I20260709 13:02:25.358973  8289 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 6, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
W20260709 13:02:25.349040  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.337822 11073 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:25.365212  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.346135 10992 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:25.369472  8359 leader_election.cc:336] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.599s (SENT)
I20260709 13:02:25.331053 11070 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.357949 10979 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.376284  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.377246  8466 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:25.378216 10992 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.379356  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:25.380052  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:25.381264 10811 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.360059 10836 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.393810 10836 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.395380  8465 raft_consensus.cc:3055] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:25.387053  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 56086.2us
I20260709 13:02:25.395848  8465 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:25.398420  8468 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:25.400722  8289 catalog_manager.cc:5697] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 2 to 5, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 5 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.351920 11092 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.404552  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:25.406545  8461 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.404120  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:25.407563  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:25.387652 10979 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.408119  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.404039  8465 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:25.412238  8541 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:25.412314  8465 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.410034  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:25.410634  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:25.410764  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:25.410931 11073 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:25.414340  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:25.395121 10811 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.414743  8469 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:25.416774  8544 raft_consensus.cc:2368] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:25.418556  8391 raft_consensus.cc:2410] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:25.416141 10811 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.422533  8462 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:25.423159  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:25.424876  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.426045  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.426141  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.427635  8538 raft_consensus.cc:1240] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.428364 10992 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.429432 11083 consensus_queue.cc:1059] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:25.429639 10811 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:25.431440  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.430483 10904 raft_consensus.cc:3055] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.434551  8467 raft_consensus.cc:2410] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:02:25.432394  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.434652  8289 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:25.435314  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:25.432900  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 69762.4us
I20260709 13:02:25.429816  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:25.436532  8387 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:25.439882  8358 leader_election.cc:400] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:25.440196  8358 leader_election.cc:403] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:25.440887 10811 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.441383 11049 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.453478  8461 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:25.457509  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.458575  8541 raft_consensus.cc:2393] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:25.462400  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:25.464432  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:25.465147  8469 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.465289  8461 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.463617  8289 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 7, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 7 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.434381 10904 raft_consensus.cc:740] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
W20260709 13:02:25.462354  8359 leader_election.cc:336] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.695s (SENT)
I20260709 13:02:25.482077  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:25.483497  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58709us
I20260709 13:02:25.489434  8462 pending_rounds.cc:85] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 4
I20260709 13:02:25.489926  8462 pending_rounds.cc:107] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:02:25.489858  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.490334  8462 raft_consensus.cc:2889] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.502202  8461 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:25.503907  8289 catalog_manager.cc:5697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 1 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 8 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.490666 11104 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:25.512580  8461 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.501281 11073 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:25.517408  8469 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:25.527204  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.529556  8391 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:25.530689  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:25.531505 11148 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:25.512441 11105 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.535388 11049 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:25.544615  8289 catalog_manager.cc:5697] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 2 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.528463 10904 consensus_queue.cc:260] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:25.548902 10904 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.549810  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.550117  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.551035  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.551164  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.553938  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.555063  8507 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.527050 11006 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.563997 10979 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.557734 11049 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.565474 11092 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:25.565379 10836 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.568421  8467 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:25.574059  8289 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 7, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 7 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:25.576257  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 116799us
I20260709 13:02:25.586266  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:25.624788  8464 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:25.625065  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.591761  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:25.574133  8465 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:02:25.626452  8465 pending_rounds.cc:85] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 6
I20260709 13:02:25.592869  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:25.626945  8465 pending_rounds.cc:107] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:02:25.627233  8465 raft_consensus.cc:2889] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.590441  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:25.613210  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58264us
I20260709 13:02:25.599179  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:25.625846  8469 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.588848  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:25.587705  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:25.595041  8535 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.630138  8289 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 6, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 6 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.598281  8508 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:25.633219  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:25.587353  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:25.588201  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.604281  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.635294  8465 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:25.578645  8433 connection.cc:256] RPC call timeout handler was delayed by -2.4197561350000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:02:25.640134  8433 connection.cc:256] RPC call timeout handler was delayed by -2.3639561350000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:02:25.640856  8433 connection.cc:256] RPC call timeout handler was delayed by -2.341456135000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 13:02:25.642726  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:25.644050  8433 connection.cc:256] RPC call timeout handler was delayed by -2.2955561350000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:02:25.644271  8508 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:25.644683  8433 connection.cc:256] RPC call timeout handler was delayed by -2.2721561350000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:02:25.645260  8433 connection.cc:256] RPC call timeout handler was delayed by -2.2586561350000238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 13:02:25.645613  8433 connection.cc:256] RPC call timeout handler was delayed by -2.251456135000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 13:02:25.646396  8433 connection.cc:256] RPC call timeout handler was delayed by -2.1011561350000534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:02:25.646865  8433 connection.cc:256] RPC call timeout handler was delayed by -2.0723561350000637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 13:02:25.647310  8433 connection.cc:256] RPC call timeout handler was delayed by -2.0138561350000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:02:25.648064  8433 connection.cc:256] RPC call timeout handler was delayed by -2.0111561350000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:02:25.648849  8433 connection.cc:256] RPC call timeout handler was delayed by -1.9805561350000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 13:02:25.649317  8433 connection.cc:256] RPC call timeout handler was delayed by -1.9499561350000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:02:25.649772  8433 connection.cc:256] RPC call timeout handler was delayed by -1.8707561350000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:02:25.650405  8433 connection.cc:256] RPC call timeout handler was delayed by -1.8482561350000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 13:02:25.650935  8433 connection.cc:256] RPC call timeout handler was delayed by -1.8149561350000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 13:02:25.651362  8433 connection.cc:256] RPC call timeout handler was delayed by -1.7699561350000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 13:02:25.651804  8433 connection.cc:256] RPC call timeout handler was delayed by -1.4315561350000507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2616s for a response
W20260709 13:02:25.652244  8433 connection.cc:256] RPC call timeout handler was delayed by -1.2227561350000542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2848s for a response
W20260709 13:02:25.656010  8359 leader_election.cc:336] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.745s (SENT)
W20260709 13:02:25.579739 11146 log.cc:927] Time spent T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.229s	user 0.004s	sys 0.000s
I20260709 13:02:25.659409  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:25.678396  8536 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:25.679499  8289 catalog_manager.cc:5697] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 4 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.680784  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.612916 10547 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:25.598347 11065 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:02:25.583498 11104 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:25.693097  8465 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:25.684063  8507 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:25.588388 10992 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:25.693300  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.686365  8469 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:02:25.698665  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 57907.8us
W20260709 13:02:25.699339  8359 leader_election.cc:336] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.887s (SENT)
I20260709 13:02:25.699676  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.700377 10977 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.700912 10994 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:25.701658  8359 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.900s (SENT)
I20260709 13:02:25.701858 10547 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:25.702601  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.115s (SENT) [suppressed 47 similar messages]
I20260709 13:02:25.690289 10972 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:25.702829 10547 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.703572 10972 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:25.656435 11105 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:25.655390 10839 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.655123 10811 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.715229  8537 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:25.642139 10904 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:02:25.719985  8464 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:25.694229 11073 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.655831 11049 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:25.724282  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 44992.6us
I20260709 13:02:25.704619 10972 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:25.710865 11105 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:25.726671  8508 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.734244  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.734884  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:25.736032  8508 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:25.708498 10992 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:25.741217  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.742214  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.748332 11104 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:25.751966  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.752480  8540 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:25.752599  8394 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.755805  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.756382  8386 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.760357  8539 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:25.728982 11105 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:25.772996  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.774580  8359 leader_election.cc:336] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.405s (SENT)
I20260709 13:02:25.775041  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.784188  8388 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:25.739017 10839 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.794093  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.794713  8393 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.790549 11049 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:25.805054 10836 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.805754 10981 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.148s
I20260709 13:02:25.793542 10679 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:02:25.810078  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.810702  8390 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.773213 11070 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:25.770303 10746 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:25.827296  8536 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:25.829912  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 78179us
I20260709 13:02:25.846230  8386 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:02:25.832662  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 63834.4us
W20260709 13:02:25.851384  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.855579  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:25.856495  8536 raft_consensus.cc:2393] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:02:25.857838  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.868526  8393 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:25.870601  8394 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:25.863880  8390 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:02:25.880707  8359 leader_election.cc:336] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.486s (SENT)
I20260709 13:02:25.881523  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:25.892120  8394 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:25.898463  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.900440  8388 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.832176 10992 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.878073 10977 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.906292  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:25.914726  8392 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.831306 10979 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:25.926473  8542 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
W20260709 13:02:25.928086  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 132533us
W20260709 13:02:25.936214  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 55567.9us
I20260709 13:02:25.894878 11070 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:25.895227 10826 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.948596  8388 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:25.951649  8508 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:25.990595  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.039852  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.041872 11144 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:26.042763 11153 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:02:26.042567 11144 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:26.044193 11156 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:26.044765 11144 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:25.949534  9065 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:26.045822  8359 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.644s (SENT)
W20260709 13:02:26.046684  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.052029  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:26.054849 11049 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:26.055872  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 100970us
I20260709 13:02:26.056025 11049 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.055123  8392 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:26.070399 10746 raft_consensus.cc:697] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:26.076530  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 125151us
I20260709 13:02:26.051822 10827 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:02:26.099125  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67096.9us
I20260709 13:02:26.060251 11157 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.104231  8508 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:26.097754 10547 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:26.106963  8542 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:26.107455 11049 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:26.109233  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:26.111815  8508 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:26.112592  8536 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:26.121054  8358 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:26.085671 11070 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.105479 10826 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:26.173921  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:26.170224  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:26.201187  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.111274 10679 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:26.168025  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:26.211786 11105 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:26.134797 11162 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:02:26.130213  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:26.220948  8542 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:26.142664  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:26.113425 10746 consensus_queue.cc:237] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.139922 11172 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:26.220162  8536 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.189257 11073 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:02:26.193216  9065 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:26.180868 10547 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:26.222543  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51791.2us
I20260709 13:02:26.219465  8464 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:26.132020 11144 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:26.227444 11073 consensus_queue.cc:1243] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer d2a645dcec4c479ba4c94d075b1bc98c log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:26.228425 11157 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:26.231245 11172 raft_consensus.cc:697] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:26.230787 11073 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.127730 11049 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:02:26.224036 11171 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:26.226130 10679 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:26.242597  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 100056us
I20260709 13:02:26.240978 11172 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.246539  8537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:26.247282  8537 raft_consensus.cc:606] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.246790 10679 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.247608  8537 raft_consensus.cc:614] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:26.231874 11073 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.257258  8465 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:26.232440 11144 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:26.269068  8464 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:26.270291  8465 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:26.273212  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.275427  8470 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:26.278201  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157886d313c14dff8294260f4377baf4"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:26.284112  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:26.265597 11144 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.279049  8542 raft_consensus.cc:606] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.308662  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:26.309357  8469 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.233095 10547 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.299932 11157 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.256819 11171 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:26.326570 11171 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:26.306903 11105 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:26.332388  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:26.339735  8469 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:26.335469  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.335963  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:26.352955  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:26.354671  8393 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:26.357630  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:26.358367  8386 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.358893  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:26.321970 11049 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:02:26.361146  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:26.363842  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.367424  8508 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:26.302268 11177 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:02:26.392735  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:26.355353 10977 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:26.395730  8391 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:26.399230  8393 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:26.404227  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 109683us
W20260709 13:02:26.404346  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 68957.4us
I20260709 13:02:26.373334 11145 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.413427  8507 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.413980  8386 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:26.417328 11171 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.420997 11171 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:26.404896  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 136326us
I20260709 13:02:26.421304 11073 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:26.415872  8389 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:26.424521  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.415902  9032 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.405529 10839 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.412777 10904 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.514007  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:26.514566  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:26.515280  8536 raft_consensus.cc:606] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:26.517059 11179 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:02:26.518675  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 88742.8us
I20260709 13:02:26.523381 11106 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.525471 11073 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:26.526095 11073 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:26.526507 11073 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:26.519544 10992 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.534472 10992 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:26.535508 10992 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.537272 11106 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:26.518812 10904 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:26.536924 11073 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.540657 11073 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:26.540910  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.538221 11106 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.543593 11006 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:26.543632 11106 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:26.550520 11184 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 13:02:26.427498 10836 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.430119 10839 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:26.424708 11170 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
W20260709 13:02:26.560500  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 49550.4us
I20260709 13:02:26.425179 10979 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 13:02:26.561343 10839 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.572734 11190 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.565199 10836 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:26.566771 11145 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 13:02:26.585938 11166 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.487s	user 0.005s	sys 0.000s
W20260709 13:02:26.590536  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 74565.1us
I20260709 13:02:26.607172  8359 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:26.610932  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 46449.2us
I20260709 13:02:26.609166 10826 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.613616  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:26.589668 10836 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.630578  8394 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:26.626387 11185 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.651670  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:26.650151  8508 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:26.659144  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:26.659876  8536 raft_consensus.cc:606] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:26.663180  8359 connection.cc:256] RPC call timeout handler was delayed by -1.6222271510000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 13:02:26.669658  8466 raft_consensus.cc:3055] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:26.670192  8466 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:26.639935 10547 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:26.678615  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:02:26.680184  8359 leader_election.cc:336] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.734s (SENT)
I20260709 13:02:26.684092  8467 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:26.684739 11192 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:02:26.687167  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.667843 11157 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.667536 10792 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:26.699388  8466 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.700661  8466 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:26.702088 11188 log.cc:927] Time spent T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:02:26.716857  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.711133 10792 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:26.712831 11049 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.712191 11185 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.727543 10792 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.728785 10839 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:26.730057  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 52415us
I20260709 13:02:26.717626 11081 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 13:02:26.731091  8359 connection.cc:256] RPC call timeout handler was delayed by -1.1290271510000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25070000000000003s for a response
I20260709 13:02:26.741066  8466 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:26.741677  8466 pending_rounds.cc:85] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 4
I20260709 13:02:26.748932  8466 pending_rounds.cc:107] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:26.725580 11185 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.750222  8466 raft_consensus.cc:2889] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:26.752032  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.740011 11177 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:26.750698 11185 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.772809 11177 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.782423 10839 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:26.782832 11177 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:26.783699  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.784581 10826 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.784986  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:26.785193 10826 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.787604  8389 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:26.787787 10826 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:26.788457 10826 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:26.789007 10826 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.790788 11073 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:26.791368 11073 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.792415  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:26.793286 11073 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:26.800033 10684 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:26.800530 10684 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:26.768090 11144 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:26.807314  8359 leader_election.cc:336] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.670s (SENT)
I20260709 13:02:26.806805  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:26.807865  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.809753  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:26.810150  8359 leader_election.cc:336] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.757s (SENT)
I20260709 13:02:26.813186 11092 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:26.810653 11157 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.811587 11177 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.815448  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:26.811679  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:26.821981 11144 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:26.821132 11092 raft_consensus.cc:2764] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:02:26.824512 11171 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:26.824501 10994 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:26.828104  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:26.828776  8391 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 5.
I20260709 13:02:26.834422  8463 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:26.834422  8387 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:26.835255  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.837548  8433 leader_election.cc:400] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:02:26.838229  8433 leader_election.cc:403] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:26.844192  9032 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:26.842875  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:26.844405  8359 leader_election.cc:336] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.110s (SENT)
I20260709 13:02:26.849207  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.834904 10836 raft_consensus.cc:993] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:26.850898 11169 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:26.851318 10836 raft_consensus.cc:1081] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:26.851359 11169 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.852028 11169 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.857007  8391 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:26.857477 10826 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:26.866139  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:26.870126 10839 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:26.870569 10679 raft_consensus.cc:993] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:26.871129 10679 raft_consensus.cc:1081] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:26.860270  8463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "157886d313c14dff8294260f4377baf4"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:26.890515  8463 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:26.891103  8463 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:26.913928  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 69560.4us
I20260709 13:02:26.900105 10826 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:26.941246  8359 leader_election.cc:336] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.131s (SENT)
I20260709 13:02:26.942988  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.829591 10684 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.948727  8466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:26.949344  8466 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:26.949772  8466 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:26.938721 10839 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:26.940495 11083 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.951682 11204 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:02:26.955480 11185 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.964047  8464 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 9: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:26.962208 11216 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.965056 10684 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.965942 10839 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:26.971500  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1686) took 1400 ms. Trace:
I20260709 13:02:26.948999 11144 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.971989  8461 rpcz_store.cc:276] 0709 13:02:25.570754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.575574 (+  4820us) service_pool.cc:224] Handling call
0709 13:02:25.575883 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.593475 (+ 17592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.593507 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.593994 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.719323 (+125329us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:25.727435 (+  8112us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.727655 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.727730 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.292489 (+564759us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b18003768a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1
0709 13:02:26.952143 (+659654us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b18003768a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:26.971233 (+ 19090us) raft_consensus.cc:1685] finished
0709 13:02:26.971260 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.971431 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16882,"prepare.queue_time_us":7917,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":18017,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":10245,"spinlock_wait_cycles":23493248,"thread_start_us":116013,"threads_started":1,"wal-append.queue_time_us":145781}
W20260709 13:02:26.983521  8359 leader_election.cc:336] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.507s (SENT)
I20260709 13:02:26.984510  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:26.992470 10839 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:26.993027 11216 consensus_queue.cc:1059] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:02:27.015753 10979 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.016296 10979 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.022533  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:26.969964 11083 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:27.022292  8466 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.024448  8464 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.980757 10826 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:02:27.048844  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.052023  8465 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:02:27.050545  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67077.7us
I20260709 13:02:27.057698  8466 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:27.056995  8359 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.793s (SENT)
I20260709 13:02:27.058897  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:27.073565 11206 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:27.088320  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:27.047636 11208 raft_consensus.cc:2764] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:02:27.090711 11144 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.094101 11173 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.094336 11185 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.099057  8395 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:27.100813  8462 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:27.102867 10979 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:27.091466 11169 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:27.105945  8388 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:27.108307 11169 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:27.110289  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:27.110983  8395 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.118103 11083 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.092198  8463 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.123070  8464 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:27.088387 11177 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:27.128559  8463 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.128348 11205 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:02:27.133850  8507 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:27.139997  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:27.160787  8507 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:27.161098  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:27.163332  8539 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:27.165421  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:27.166247  8537 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:27.167162  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:27.173491  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 116523us
W20260709 13:02:27.175038  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.131659 11177 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:27.196074  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:27.201685  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:27.203493  8395 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
I20260709 13:02:27.204808  9032 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:27.161450 10839 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:27.169354 10684 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:27.169538 10679 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:02:27.218143  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:27.218688 11169 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:27.219307 11169 raft_consensus.cc:697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:27.161864 11104 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:02:27.220249 11169 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:27.217983 11073 consensus_queue.cc:1059] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:27.226341  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.226429 10684 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:27.226989 10684 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:27.173187 10979 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.156070 10792 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:02:27.161402 10811 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:02:27.237596 11073 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:27.238149 10839 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:27.270170  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 47263.8us
I20260709 13:02:27.263712 11073 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:27.269673 11144 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:27.278550 11218 log.cc:927] Time spent T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:02:27.283254  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.284224  8464 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:27.289374  8469 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:27.289685  8469 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:27.273808 11106 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:02:27.292096 10839 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.296324 11144 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.269550 11177 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.297669 11177 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.298033 11073 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.306174  8544 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:27.308002  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:27.299260 11073 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.269268 10684 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.277424 11145 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:02:27.309165  8469 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.340718  8469 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.313567 11229 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:27.355017  8469 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:27.355629  8469 pending_rounds.cc:85] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 4
I20260709 13:02:27.355922  8469 pending_rounds.cc:107] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:27.356235  8469 raft_consensus.cc:2889] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.366981 11217 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:27.367482 11217 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:27.368379 11217 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.372987 11144 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.331265 11228 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:02:27.380636 11229 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.383853 11229 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.350427 10684 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:27.409945  8358 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:27.411151  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:27.411826  8544 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
I20260709 13:02:27.412761  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:27.416760  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:27.415217  9032 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:27.418170  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:27.418699 11083 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:27.419174 11083 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:27.425107  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 117225us
I20260709 13:02:27.427209 11070 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.427176 11083 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:27.431418  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.432549  8359 leader_election.cc:336] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.233s (SENT)
I20260709 13:02:27.443485  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.443796  8359 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:27.436226  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 497725us
I20260709 13:02:27.445428  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:27.441289  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.444185  8462 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:27.428632 10746 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.430999 11070 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:27.429000 11223 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:02:27.453333  8389 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:27.450521  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:27.467357  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.454048  8393 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:27.461104  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:27.468058  8469 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 6.
I20260709 13:02:27.468953  8462 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.469969  8386 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:27.427824 11177 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:27.446163 10826 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:27.491227  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:27.558863  8535 raft_consensus.cc:606] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:27.559407  8535 raft_consensus.cc:614] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.546854 11163 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.483187  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:27.572081  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 88992.2us
I20260709 13:02:27.454177 11070 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.453727 10746 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.456647 11205 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:27.586746  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 154223us
W20260709 13:02:27.595192  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.595315  8359 leader_election.cc:336] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.248s (SENT)
I20260709 13:02:27.596009  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:27.573087  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:27.453238 11173 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.635958  8393 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:27.450891 11144 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:27.455828 11145 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:02:27.590581 11208 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:27.654268  8470 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:27.588232 11177 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:27.638522  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:27.476845 11106 consensus_queue.cc:1059] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.159s
I20260709 13:02:27.594527 10746 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.660050  8467 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:27.663154  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67896.4us
W20260709 13:02:27.666177  8359 leader_election.cc:336] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 2.969s (SENT)
I20260709 13:02:27.666695  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:27.689653  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.652964 10904 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.590768 10826 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:27.697357  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 99429.8us
I20260709 13:02:27.711683  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.591302 11163 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:27.719548 11230 log.cc:927] Time spent T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:02:27.723363 11083 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:27.726433 11226 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:27.727078 11226 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:27.728116 11226 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:27.730090  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 63948.1us
I20260709 13:02:27.730279 10836 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.730932 10836 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.658174 11144 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.733369 10836 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:27.662464 11065 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:02:27.735651 11202 raft_consensus.cc:3055] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:27.665664 11228 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:02:27.684425 11208 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:27.743939 11208 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.745579 10981 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.746165 10981 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.747689  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:27.748499  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.748939  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.750226  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.751362  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.751715  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.752547  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.752810  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.753484  8469 raft_consensus.cc:2368] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:27.754598 11211 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.754910  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.755244 11211 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:27.755839 11240 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.751370  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.709216 11205 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.756206 11211 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.754263  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.757145 11205 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:27.757664 11039 raft_consensus.cc:993] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:27.758157 11205 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:27.761243  8359 leader_election.cc:336] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 3.015s (SENT)
I20260709 13:02:27.758194 11039 raft_consensus.cc:1081] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:27.763916  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:27.764508  8464 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.753672  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.761686  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:27.767863  8470 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:27.768241  8470 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:27.741263 11163 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:27.736088 11202 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:27.768908  8470 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.779811  8470 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.772239  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.772643  8462 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
I20260709 13:02:27.791734  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.792910  8468 raft_consensus.cc:2393] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:27.798403  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.806682  8464 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
W20260709 13:02:27.807664  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 154997us
W20260709 13:02:27.813486  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 46932.2us
W20260709 13:02:27.815584  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54374.6us
W20260709 13:02:27.816413  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.821267  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.762475 11177 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.787114 11238 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:27.837492  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.839112  8468 raft_consensus.cc:1813] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Handling vote request from an unknown peer 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:02:27.833453  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.843783  8467 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:27.843832  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.845570  8466 raft_consensus.cc:2393] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:27.847908  8468 raft_consensus.cc:2368] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:27.848497  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.820237 11237 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:27.878001  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 69593.9us
I20260709 13:02:27.878593  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.891340  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.892328  8462 raft_consensus.cc:2368] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:27.844726 11049 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:27.847467 11240 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:27.893350 11239 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:27.888111 11083 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.893594 11229 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.898836 11243 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:02:27.900625 11144 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.908658  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:27.924479  8386 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 3.
I20260709 13:02:27.924909  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.925629  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:27.911880 10826 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.913200  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:27.914162  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.916316 11004 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.926939  8393 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:27.930658  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:27.931496  8468 raft_consensus.cc:2368] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:27.882459 11105 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:02:27.939777  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:27.942173  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 342605us
I20260709 13:02:27.933056  8386 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
W20260709 13:02:27.944487  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.851897 11202 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.949376  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.934913 10981 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:27.917621 11049 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.970328  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.971860  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.975651  8462 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:27.976183  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:27.978533  8469 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:27.924671 11240 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.919143 11239 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.983865 11240 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.984376 11239 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.996894 11049 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:27.929925 11229 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.937465 11004 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:28.000051 11229 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:28.000731 11004 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:27.977306 11065 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:02:28.001610  9033 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:27.982086  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.006335  8470 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:28.006785  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.007159  8470 pending_rounds.cc:85] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 4
I20260709 13:02:28.007479  8470 pending_rounds.cc:107] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:28.007758  8470 raft_consensus.cc:2889] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.007486  8464 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:28.008107  8462 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: [4.4-8.5]
I20260709 13:02:27.974670  8542 raft_consensus.cc:2955] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:28.011785 11169 raft_consensus.cc:2804] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:28.014406 11169 raft_consensus.cc:697] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:28.015503 11169 consensus_queue.cc:237] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:27.993072 11070 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:28.023882  8392 raft_consensus.cc:1275] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:28.024597 11070 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:28.026247  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:27.942845 10746 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:27.954869 11039 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:02:28.042474  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:28.039776  8470 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:02:28.055011  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.057932  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.028196 10729 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:02:28.041291 11070 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:02:28.075103  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.076743  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.075297  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.078922  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.079959 10746 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:28.080277  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.081560  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.030493 11006 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:28.082659  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.085608  8464 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:28.086637  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.087903  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.088500  8464 raft_consensus.cc:1813] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Handling vote request from an unknown peer 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:28.089042  8464 raft_consensus.cc:2368] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:28.089856  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.093163  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.094347  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.102123  8470 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:28.109344  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.110445  8466 raft_consensus.cc:2368] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:28.114168  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:28.118538  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 97702.9us
I20260709 13:02:28.126154  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.128244  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:28.130715  8389 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:28.135035  8468 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:28.136262  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.137326  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.139025  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.141215  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:28.135689  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:28.137109  8467 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:28.142180 10746 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.140802  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:28.171090  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:28.166851  8386 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.084735 10904 consensus_queue.cc:1048] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:02:28.174813  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:28.175289  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:28.175951  8392 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.169094  8389 raft_consensus.cc:1240] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:28.173890  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:28.127329 11173 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:28.194044 11249 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:28.194860 11249 consensus_queue.cc:1243] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer d2a645dcec4c479ba4c94d075b1bc98c log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:28.201056  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:28.210191  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:28.134753 10547 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:02:28.216331  8386 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:28.231710  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:28.233160  8389 raft_consensus.cc:2410] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:02:28.227355  8433 connection.cc:256] RPC call timeout handler was delayed by -2.2036345899999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:02:28.233501  8433 connection.cc:256] RPC call timeout handler was delayed by -2.174834589999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:02:28.233861  8433 connection.cc:256] RPC call timeout handler was delayed by -2.16493459000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:02:28.234184  8433 connection.cc:256] RPC call timeout handler was delayed by -2.1343345899999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:02:28.213119 11217 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.236948  8359 leader_election.cc:400] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:28.238406  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:28.174983 10746 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:28.240600  8389 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:28.250135  8468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:28.251242  8468 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.251812  8468 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.240468  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:28.234459  8433 connection.cc:256] RPC call timeout handler was delayed by -2.1226345900000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:02:28.262565  8433 connection.cc:256] RPC call timeout handler was delayed by -2.118134590000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:02:28.262907  8433 connection.cc:256] RPC call timeout handler was delayed by -2.1100345899999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:02:28.263232  8433 connection.cc:256] RPC call timeout handler was delayed by -2.0938345900000286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:02:28.263530  8433 connection.cc:256] RPC call timeout handler was delayed by -2.0938345900000286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:02:28.263823  8433 connection.cc:256] RPC call timeout handler was delayed by -2.02453459000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:02:28.264127  8433 connection.cc:256] RPC call timeout handler was delayed by -2.0164345900000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:02:28.264420  8433 connection.cc:256] RPC call timeout handler was delayed by -1.8481345900000292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:02:28.264705  8433 connection.cc:256] RPC call timeout handler was delayed by -1.8409345900000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:02:28.265040  8433 connection.cc:256] RPC call timeout handler was delayed by -1.822034589999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:02:28.265358  8433 connection.cc:256] RPC call timeout handler was delayed by -1.7311345900000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:02:28.265699  8433 connection.cc:256] RPC call timeout handler was delayed by -1.7230345899999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 13:02:28.266038  8433 connection.cc:256] RPC call timeout handler was delayed by -1.7185345899999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:02:28.266374  8433 connection.cc:256] RPC call timeout handler was delayed by -1.7023345900000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 13:02:28.266661  8433 connection.cc:256] RPC call timeout handler was delayed by -1.6231345900000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:02:28.266893  8392 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
W20260709 13:02:28.266948  8433 connection.cc:256] RPC call timeout handler was delayed by -1.6060345899999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:02:28.268533  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.268608  8433 connection.cc:256] RPC call timeout handler was delayed by -1.5520345900000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22650000000000003s for a response
W20260709 13:02:28.269135  8433 connection.cc:256] RPC call timeout handler was delayed by -1.0651345900000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2806s for a response
I20260709 13:02:28.271602 10746 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:28.273635  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.276996  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.277984 11157 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.278999  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.279434  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.280205 11157 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.281337 11157 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:28.281857 11157 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:28.284029 11157 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:28.285162  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.286577 11157 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:28.287616  8467 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:28.287873  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.207443 11173 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:28.291787 11173 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:28.300434  8464 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:28.300851  8464 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:28.304219  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:28.325032  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.301509  8464 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:28.364573  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 73308.2us
I20260709 13:02:28.378582  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:28.379798  8535 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:28.382082  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:28.385309  8544 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:28.334810 11226 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.393378  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.395923  8536 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:28.392037  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.406311  8537 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.406515  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:28.406702  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:28.359879 11224 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.335769 11205 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.411844  8543 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:28.415850  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:28.426350  8540 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
W20260709 13:02:28.429714  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 64184.6us
I20260709 13:02:28.431032  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.429994  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.446403  8539 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:28.447050  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.449443  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.452311  8540 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:28.429482 11264 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:28.459051  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.461129  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.461230  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.439847 11157 raft_consensus.cc:2764] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:28.463546  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.430209 11224 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:28.527151  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:28.524998 11261 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:02:28.525398  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 60937.4us
I20260709 13:02:28.531466  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.532562  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.526223  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.535212  8536 raft_consensus.cc:1813] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Handling vote request from an unknown peer 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:28.535737  8536 raft_consensus.cc:2393] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:28.456010 11208 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:28.526451 11269 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:28.529533  8463 raft_consensus.cc:2410] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:28.529356  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.528705 11224 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:28.463052 11205 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:28.543888  8389 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
W20260709 13:02:28.551759 11234 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.732s	user 0.007s	sys 0.006s
I20260709 13:02:28.552990  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1664) took 1103 ms. Trace:
I20260709 13:02:28.553519  8394 rpcz_store.cc:276] 0709 13:02:27.449621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.452020 (+  2399us) service_pool.cc:224] Handling call
0709 13:02:27.476355 (+ 24335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.950216 (+473861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.950260 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.952674 (+  2414us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.154192 (+201518us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:28.154226 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.154288 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.552685 (+398397us) raft_consensus.cc:1685] finished
0709 13:02:28.552706 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.552910 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":207118,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6955,"thread_start_us":605508,"threads_started":2,"wal-append.queue_time_us":356244}
I20260709 13:02:28.548681 11157 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:28.544956  8540 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:28.533390 11217 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.561347  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.569847  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.574453  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:28.583511  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.586781  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.588006 11217 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:28.589978  8468 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:28.591984  8468 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:28.592639 11274 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.593115  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:28.593930 11217 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:28.595158  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.595899 11217 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:28.596853 11250 log.cc:927] Time spent T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.524s	user 0.005s	sys 0.000s
I20260709 13:02:28.598107 11217 consensus_queue.cc:1059] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:28.599094 11274 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:28.599501 11274 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:28.599887 11202 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:28.600438 11274 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:28.602099  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 1153) took 1464 ms. Trace:
I20260709 13:02:28.602546  8542 rpcz_store.cc:276] 0709 13:02:27.138122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.138508 (+   386us) service_pool.cc:224] Handling call
0709 13:02:27.163420 (+ 24912us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:27.197515 (+ 34095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.197568 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:27.719970 (+522402us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b180035bc00. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a
0709 13:02:27.753892 (+ 33922us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b2c001564c8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:02:27.754729 (+   837us) log.cc:844] Serialized 520 byte log entry
0709 13:02:27.937445 (+182716us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:28.063790 (+126345us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.064171 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.064277 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.596218 (+531941us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:28.601855 (+  5637us) raft_consensus.cc:1685] finished
0709 13:02:28.601875 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.602030 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53749,"raft.queue_time_us":34134,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":13886,"spinlock_wait_cycles":96003584,"thread_start_us":182329,"threads_started":1,"wal-append.queue_time_us":313056}
I20260709 13:02:28.605901  8464 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.615120  8464 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:02:28.616395  8464 pending_rounds.cc:85] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 4
I20260709 13:02:28.616951  8464 pending_rounds.cc:107] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:02:28.617457  8464 raft_consensus.cc:2889] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.622337  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.643556  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:28.682825  8540 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:28.647817  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 56822.3us
I20260709 13:02:28.673079  8544 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:28.641866  8468 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:28.694387  8539 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:28.694810  8465 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.694944  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.695432  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:28.696470  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:28.697036  8542 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:28.697247  8543 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:28.697345  8542 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:28.696630 11270 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:02:28.698187  8542 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:28.699101  8542 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.699368  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:28.700697  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.701488  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.702797  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 442836us
I20260709 13:02:28.706310  8388 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:28.707216  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 466825us
I20260709 13:02:28.707923  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:28.709380  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:28.705700  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:28.715758  8394 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.716305  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.717495  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.723017  8395 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:28.706857  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:28.725955  8540 raft_consensus.cc:2468] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:02:28.729348  8542 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:28.731284  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:28.731940  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:28.700227 11244 log.cc:927] Time spent T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.714s	user 0.006s	sys 0.001s
W20260709 13:02:28.734807  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 56737.2us
I20260709 13:02:28.717684  8290 catalog_manager.cc:5697] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 4 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 6 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.740375  8394 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:28.742627  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:28.742868  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:28.743778  8387 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.699105 11247 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:28.741483 11216 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.737255  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:28.715920 11211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.005s	sys 0.032s
I20260709 13:02:28.730635 11275 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.762537  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:28.765408  8393 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.763324  8507 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:28.722756 11237 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.782040  8507 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:28.730703 11205 raft_consensus.cc:2764] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:28.783236  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:28.783319  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 249140us
I20260709 13:02:28.788787  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.753999 10826 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:28.755726 11240 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.755992 11239 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.763273  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:02:28.819315  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 66315.8us
I20260709 13:02:28.823083  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:28.763053 11229 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:28.774804 11211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.006s	sys 0.035s
I20260709 13:02:28.790606 11208 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:28.826828 11208 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:28.788333 10836 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:28.830724  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 47572.2us
I20260709 13:02:28.831820  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:28.795029 11106 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:28.756315 11226 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:28.807684 11224 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:28.741842 11273 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:02:28.910399  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.830556 11244 log.cc:927] Time spent T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:02:28.920414  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 135293us
I20260709 13:02:28.793004 11251 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:02:28.866935 10836 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.871248 11106 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.922570  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:28.926227  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 112376us
I20260709 13:02:28.830325 11006 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.867262 11243 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:28.812156 11275 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 13:02:28.966769  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:28.967810  8388 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.919422 10746 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.817672 11247 consensus_queue.cc:1059] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:02:28.869493 11211 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.954248  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 122522us
I20260709 13:02:28.958560  8469 pending_rounds.cc:85] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:28.959482  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:28.898834 11171 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:28.952487 11106 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.809288 11157 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:02:28.835880 10811 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:02:28.872162 11177 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.820209 10994 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:28.870680 10826 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.088075  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:28.965242 11226 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.045944  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:28.946558 11274 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.960549  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:29.045325  8469 pending_rounds.cc:107] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:02:28.970311 11254 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.790957 11237 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.036643 11238 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.056279 11282 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:02:29.057746 11280 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:02:29.058688 11281 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
W20260709 13:02:29.071236 11285 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:29.082595  8387 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:28.952649 10836 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.966548 11216 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:28.963164 11202 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.969375 11243 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.953141 11224 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:28.963860 10547 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.970712  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:28.966233 11239 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.096638  8469 raft_consensus.cc:2889] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.047747  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:29.143885  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 304542us
W20260709 13:02:29.101092  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 140648us
I20260709 13:02:29.102708 11275 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:29.111593  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 65745.1us
I20260709 13:02:29.106353  8388 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:29.132696  8535 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:29.076244 11211 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:29.087584 11240 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.044826 11006 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.077888 10746 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.084870 11208 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.153343  8395 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.102183 11226 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:29.160593  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 368307us
I20260709 13:02:29.152910 10826 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:29.087523 10994 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.152520  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:29.185701  8392 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:29.178998  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:29.194505  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.159391  8394 raft_consensus.cc:1240] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:29.162855 11243 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:29.207613  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 418921us
I20260709 13:02:29.160791 11273 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.192337  8388 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.213331  8507 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.197340 11249 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.191250 11216 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:28.967435 11173 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:29.219553  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.252084 11297 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:29.253252  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.254977  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1654) took 1815 ms. Trace:
I20260709 13:02:29.184602 11202 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.150089 11238 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:29.275018  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1803) took 1143 ms. Trace:
I20260709 13:02:29.276291  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.279399  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.255920  8390 rpcz_store.cc:276] 0709 13:02:27.439269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.439727 (+   458us) service_pool.cc:224] Handling call
0709 13:02:27.459981 (+ 20254us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:27.717659 (+257678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.717709 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:27.747579 (+ 29870us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2c00000c88. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:02:27.748167 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 13:02:28.046417 (+298250us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:28.534297 (+487880us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b18002c0380. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe1308f4bc 00007fbe103dd48b 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f7455 00007fbe16edf3c7 00007fbe134f19a7 00007fbe135010bf
0709 13:02:28.535095 (+   798us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.114491 (+579396us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.220397 (+105906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.220480 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.250820 (+ 30340us) raft_consensus.cc:1685] finished
0709 13:02:29.250844 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.254910 (+  4066us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":277970,"prepare.queue_time_us":588902,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":545619,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":50227,"spinlock_wait_cycles":38273536,"thread_start_us":1067954,"threads_started":5,"wal-append.queue_time_us":418128}
I20260709 13:02:29.281674  8388 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:29.286448  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 75185.8us
I20260709 13:02:29.252429 11247 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:29.289575  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:29.212097 10994 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.275617  8462 rpcz_store.cc:276] 0709 13:02:28.132051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.332369 (+200318us) service_pool.cc:224] Handling call
0709 13:02:28.332809 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.535925 (+203116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.535957 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.547587 (+ 11630us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.730243 (+182656us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:28.730288 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.730360 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.274684 (+544324us) raft_consensus.cc:1685] finished
0709 13:02:29.274712 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.274922 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26878,"raft.queue_time_us":65566,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":300263,"threads_started":2,"wal-append.queue_time_us":120044}
I20260709 13:02:29.186908 10547 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.292698  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:29.197801 11239 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.218727 11287 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:29.197537 11240 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:29.300004  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 87308.8us
W20260709 13:02:29.302655  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.305338 11286 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:29.219314 11249 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.309144  8359 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.319276 11240 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:29.319346 11202 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:29.320025 11294 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:29.254197 11157 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:02:29.321110 11216 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.324235  8540 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:29.287956 10826 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.249620 11273 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:29.341662  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:29.292171 11297 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:29.322795 11301 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:29.303645 11201 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.335155  8359 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.331257 11249 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.330940 11286 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.343359 11287 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:29.344126 11275 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:29.376947  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 84344.4us
I20260709 13:02:29.394781  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.397105  8359 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.404731  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.311825 11224 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.434798  8359 leader_election.cc:400] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:29.383206 10826 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.438758  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.438762  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.450776  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.402479 11286 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:29.460287  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:29.464128 10684 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.404996 11301 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:02:29.465726 10547 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:29.359916 11294 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:29.458519 11247 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.471127  8359 leader_election.cc:400] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:02:29.446683 11297 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.407142 11300 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:29.446930 11240 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:29.482033  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 98301.6us
W20260709 13:02:29.519307  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 48329.6us
I20260709 13:02:29.579290  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.581086  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.471578 11237 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:29.582602  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.552373 11296 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:29.553529 11303 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:02:29.553086 10836 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.557166 11273 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:29.512032 11006 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:29.560415 11294 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:29.564793  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:29.566310 11239 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:29.567766 11211 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:29.524705 11287 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.570031 11226 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:29.570293 11217 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:29.571240 11177 raft_consensus.cc:3055] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:29.578250  8389 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:29.507258 10826 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:29.550060 11240 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.589023  8543 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:02:29.590195  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.594477  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:29.596752  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:29.598032  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.583812 11229 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:29.627573 11106 consensus_meta.cc:287] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.001s
I20260709 13:02:29.610558 11239 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:29.604694  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 149392us
I20260709 13:02:29.608770  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:29.616746 11306 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:29.618490  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:29.609803 11296 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.624529 11298 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:29.625181  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:29.627063 10836 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:29.630125  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.669055  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:29.670449  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.619998 11238 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:29.611178 11247 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.621634  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:29.678146  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:29.602154 11237 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:29.619578 11177 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:29.620038 10826 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.639369 11006 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:29.618314 11217 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:29.666520 11273 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.636940 11229 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:29.677765  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:29.649734 11226 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.716699  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:29.716846  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:29.674623 11300 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:29.664947 11249 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.745643  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:29.745776  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 74683.3us
I20260709 13:02:29.746156  8359 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.688125  9067 raft_consensus.cc:1813] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Handling vote request from an unknown peer d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:29.649360 11106 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.836612  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:29.688059 11238 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.838407 11106 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:29.720265 10826 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.838358  8540 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:29.838758 11238 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.836685  9067 raft_consensus.cc:2410] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:02:29.667248 11239 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.669068 11211 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:29.845387  8290 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 6 to 8, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:29.857280  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:29.682905 11286 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.860065  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:29.860647  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 239405us
I20260709 13:02:29.669194 11296 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.682112 11317 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.188s
I20260709 13:02:29.686431 11247 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.823947 11226 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.855810 11006 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:29.824368 11273 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:29.876092 11243 consensus_meta.cc:287] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.001s
I20260709 13:02:29.933437 11237 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:29.930785 11324 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
W20260709 13:02:29.946621  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 200559us
I20260709 13:02:29.859359 11211 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
W20260709 13:02:29.964380  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 89058.9us
I20260709 13:02:29.973359  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:29.945762 11329 log.cc:927] Time spent T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:02:29.945626 11237 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:29.977921 11293 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 13:02:29.978284 11321 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:02:29.978955 11314 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:02:29.979198  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1802) took 1847 ms. Trace:
I20260709 13:02:29.979663 11237 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:29.973359  8360 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:29.942642 11298 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:29.979570  8467 rpcz_store.cc:276] 0709 13:02:28.131809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.302231 (+170422us) service_pool.cc:224] Handling call
0709 13:02:28.304101 (+  1870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.706011 (+401910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.706041 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.723264 (+ 17223us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.209082 (+485818us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:29.209126 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.209186 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.978982 (+769796us) raft_consensus.cc:1685] finished
0709 13:02:29.979006 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.979145 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63702,"raft.queue_time_us":73294,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":62,"thread_start_us":689384,"threads_started":2,"wal-append.queue_time_us":856394}
I20260709 13:02:29.996709 11249 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:29.943467 11243 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:29.988726 11237 raft_consensus.cc:3060] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.012753 11273 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:30.016942 11284 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.694s	user 0.003s	sys 0.000s
I20260709 13:02:30.017171 10826 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.019418 10826 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.020805  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1811) took 1329 ms. Trace:
I20260709 13:02:30.021201  8470 rpcz_store.cc:276] 0709 13:02:28.691103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.693061 (+  1958us) service_pool.cc:224] Handling call
0709 13:02:28.693303 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.701491 (+  8188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.701521 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.701940 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.322558 (+620618us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b18003259c0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:29.361674 (+ 39116us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18003259c0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe1308f4bc 00007fbe103dd48b 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1
0709 13:02:29.362011 (+   337us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:29.362050 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.362114 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.016420 (+654306us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:30.020587 (+  4167us) raft_consensus.cc:1685] finished
0709 13:02:30.020612 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.020748 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7826,"raft.queue_time_us":12465,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":14996,"spinlock_wait_cycles":87726976,"thread_start_us":30475,"threads_started":1,"wal-append.queue_time_us":34217}
I20260709 13:02:30.024597  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.025085  8538 raft_consensus.cc:1275] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:30.026253  8541 raft_consensus.cc:2393] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:30.006368 11240 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:30.030071 11065 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.000s	sys 0.011s
W20260709 13:02:30.033723 11065 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.000s	sys 0.012s
I20260709 13:02:30.035238 11346 consensus_queue.cc:1048] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:30.041971  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 109632us
W20260709 13:02:30.027038 10994 consensus_meta.cc:287] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.715s	user 0.012s	sys 0.000s
I20260709 13:02:30.045722  9032 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:30.047755  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.048424  8390 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:30.047919  8386 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:30.047940  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.005692 11006 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.020300 11217 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.074088 11211 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.074927 11226 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.075708 11296 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:30.076624 11305 log.cc:927] Time spent T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.564s	user 0.001s	sys 0.000s
I20260709 13:02:30.077044 11243 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:30.068143 11273 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:30.078856 11273 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.080853 11273 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.064431 11337 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.064185 11311 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.054731 10826 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.045750 11287 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.059168 11240 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.088071 11337 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.049453 10994 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.083024 11217 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.066815 11247 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.116638  8435 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:30.134711  8542 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:30.135594  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 64869.2us
I20260709 13:02:30.107618 11337 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.104303 11348 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.144083  8435 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:30.081779 11311 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.151428 11311 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:30.134621 11294 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.153033 11294 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:30.153832 10994 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:30.104120 11240 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.155984 11240 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.109714 11287 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.158005 11287 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:30.160679  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.161492 11239 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.103662 10826 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.140688 11226 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.168921 11211 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:30.195128  8535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49334 (request call id 1010) took 1782 ms (client timeout 1617 ms). Trace:
W20260709 13:02:30.195696  8535 rpcz_store.cc:269] 0709 13:02:28.413188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.415523 (+  2335us) service_pool.cc:224] Handling call
0709 13:02:30.194842 (+1779319us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54001239d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:30.195011 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748887040}
I20260709 13:02:30.198354 11226 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.198946 11226 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.201097 11226 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.203095 10746 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:30.204538 10972 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:30.205346 10972 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:30.207710 11316 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.629s	user 0.004s	sys 0.002s
I20260709 13:02:30.209550  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1692) took 1253 ms. Trace:
I20260709 13:02:30.201566 11226 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.216495  8393 rpcz_store.cc:276] 0709 13:02:28.956113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.956364 (+   251us) service_pool.cc:224] Handling call
0709 13:02:29.036722 (+ 80358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.038469 (+  1747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.038512 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.326386 (+287874us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b2c00000c88. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:02:29.345336 (+ 18950us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.433014 (+ 87678us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:29.433052 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.433122 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.207139 (+774017us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:30.209339 (+  2200us) raft_consensus.cc:1685] finished
0709 13:02:30.209362 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.209494 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1333,"raft.queue_time_us":73060,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":85,"spinlock_wait_cycles":41622144,"thread_start_us":47442,"threads_started":1,"wal-append.queue_time_us":206469}
I20260709 13:02:30.223407 10826 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.208421 10972 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:30.210764  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:30.233500 10826 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:30.234098 10826 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:30.234513 11226 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.236575 11226 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.236701 10826 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:30.218313 11208 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:30.237460 11208 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:30.240263 11308 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.686s	user 0.001s	sys 0.001s
I20260709 13:02:30.191344 11287 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.241039 11287 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.241650  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1691) took 1286 ms. Trace:
I20260709 13:02:30.242094  8391 rpcz_store.cc:276] 0709 13:02:28.955714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.956253 (+   539us) service_pool.cc:224] Handling call
0709 13:02:29.036258 (+ 80005us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.206519 (+170261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.206555 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.212269 (+  5714us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.378304 (+166035us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:29.378356 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.378439 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.239572 (+861133us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:30.241337 (+  1765us) raft_consensus.cc:1685] finished
0709 13:02:30.241361 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.241590 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103089,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":29454,"spinlock_wait_cycles":86740352,"thread_start_us":228475,"threads_started":2,"wal-append.queue_time_us":203238}
I20260709 13:02:30.243149 11287 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:30.253177  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 126782us
I20260709 13:02:30.251853 11208 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:30.258615  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:30.261106  8461 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:02:30.264535 11294 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:30.268410 11304 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.710s	user 0.001s	sys 0.005s
W20260709 13:02:30.270448 11335 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.400s	user 0.002s	sys 0.000s
I20260709 13:02:30.280537 11238 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.282752  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.283273  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.283926  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:30.287768  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.283792  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.293673  9033 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:30.292776  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:30.261729  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:30.308166  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.320394  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:30.298736 11004 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.011s	sys 0.033s
W20260709 13:02:30.326493 11331 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.455s	user 0.003s	sys 0.000s
I20260709 13:02:30.302901 11346 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.306141 11208 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:30.327585 11004 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.011s	sys 0.033s
I20260709 13:02:30.336985  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.339869  8543 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:30.334749 11346 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.318313 11287 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.324572  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:30.341502  8538 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:30.289529 11273 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.353407  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:30.355309  8390 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.356005  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.356276  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.356647  8393 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:30.357923  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.354382  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:30.357976  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.362120  8395 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:30.362550  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:30.356873  8391 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:30.363901  8386 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.348297 11346 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.368364  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.368983  8393 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:30.369916  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:30.373564  8507 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:30.382555  8390 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:30.382661  8507 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:30.336270 11208 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.388506  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.337800 11177 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:30.409332 11350 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:02:30.414868  8388 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:30.418574 11352 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:30.386502 11226 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.407892 10994 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.423137 10994 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:30.423569 10994 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:30.423599 11351 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:30.432881 10994 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.408474  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:30.438477  8386 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:30.354326 11287 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.384270 11291 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.454315  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.359992 11273 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:30.462760 11310 log.cc:927] Time spent T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 1.011s	user 0.003s	sys 0.000s
I20260709 13:02:30.464030  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 242) took 1257 ms. Trace:
I20260709 13:02:30.464094 11307 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.464459  8465 rpcz_store.cc:276] 0709 13:02:29.206271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.206484 (+   213us) service_pool.cc:224] Handling call
0709 13:02:29.206809 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.207110 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.207155 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.221155 (+ 14000us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.334183 (+113028us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:29.334243 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.334340 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.462110 (+1127770us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:30.463728 (+  1618us) raft_consensus.cc:1685] finished
0709 13:02:30.463750 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.463966 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2278,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7277,"spinlock_wait_cycles":12690688,"thread_start_us":59327,"threads_started":1,"wal-append.queue_time_us":118251}
I20260709 13:02:30.461684  8393 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:30.454473 11177 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.850283  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:30.454177 11291 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.422523 11226 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.490860  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 1017) took 1531 ms. Trace:
I20260709 13:02:30.485095  8290 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 4 to 7, term changed from 6 to 7, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to <none>, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 7 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:30.466266 11237 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.500798  8542 rpcz_store.cc:276] 0709 13:02:28.959469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.959590 (+   121us) service_pool.cc:224] Handling call
0709 13:02:29.035867 (+ 76277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.135146 (+1099279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.490605 (+355459us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000406d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:30.490800 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2526812544}
I20260709 13:02:30.502480 11004 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.502740  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.503749 10994 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:30.474484 11157 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.506197 11157 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.509850 11157 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.492769 11291 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.502962 11004 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.519441 11004 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:30.534611  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 70284.2us
I20260709 13:02:30.535727  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:30.469316 11217 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.537654  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:30.543715  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1693) took 1587 ms. Trace:
I20260709 13:02:30.544211  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.464761 11307 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.546953  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.544142  8389 rpcz_store.cc:276] 0709 13:02:28.956720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.956864 (+   144us) service_pool.cc:224] Handling call
0709 13:02:29.577888 (+621024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.619644 (+ 41756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.543528 (+923884us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b5400162450. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:30.543661 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427286912}
I20260709 13:02:30.486032 11211 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.493069  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 102624us
I20260709 13:02:30.556093  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.558936  8387 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:30.562753  8507 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:30.564920  8507 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:30.490679 11224 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.581629  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:30.586781  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49228us
W20260709 13:02:30.587546  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.588732  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:30.541338 11238 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.589884  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:30.591610  8394 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:30.595494  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.595790  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.596017  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.594825  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.597160  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.598569  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.599747  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.601153  8539 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:30.601089  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.602295  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.603127  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.604382  8541 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:30.605367  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.606442  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.581393 11311 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:30.607460  8358 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:30.610558  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.617925  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.609427  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.603404 11237 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.620803  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:30.592501 11288 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:30.548647 11217 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.623386  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:30.580451 11211 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.616408 10547 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:30.620457 11311 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.637069  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.608284 11157 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.609478 11300 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.672212  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:30.678323  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 195198us
I20260709 13:02:30.627555 11173 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.585639 11224 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.689342  8391 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:30.693707  8394 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:30.625245 11345 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:02:30.716941 11291 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:30.698807  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 54460.1us
I20260709 13:02:30.703411 10547 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:30.725332 10547 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.726557 11291 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:30.711139 11358 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:02:30.712395 11360 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:02:30.643736 11249 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.678440 11311 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:30.677624 11288 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.731523 11345 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:30.691395 11173 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.740662  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:30.737090 11208 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.747856 11273 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.747372 11288 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.751533 11273 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.752173 11273 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.753638 11288 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.755512  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:30.756193  8541 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 4.
I20260709 13:02:30.757417  8358 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:30.762857 11300 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:30.763300 11300 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.763625 11300 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:30.764871  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58882 (request call id 96) took 1106 ms. Trace:
I20260709 13:02:30.765065 11340 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:30.764891  8507 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:30.691907 11157 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.765678 11340 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:30.765355  9065 rpcz_store.cc:276] 0709 13:02:29.658603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.683259 (+ 24656us) service_pool.cc:224] Handling call
0709 13:02:30.163696 (+480437us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b5800076898. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184c0fc0 00007fbe184ab929 00007fbe184ab3d2 00007fbe11a22bd4
0709 13:02:30.163916 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.191592 (+ 27676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.215399 (+ 23807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:30.219023 (+  3624us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:30.221027 (+  2004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.764610 (+543583us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b540058eb54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:30.764662 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.764802 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47084672}
I20260709 13:02:30.770170 11340 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.750087 11173 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.748306 11287 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.776248 11287 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:30.776830 11287 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:30.779435 11287 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:30.780059 11287 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.780673 11287 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.783082  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:30.783721  8392 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.784235 11228 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:30.784642 11228 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:30.784976 11228 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:30.786218 11291 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:30.789220  8386 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:30.789858 11217 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.741295 11345 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:30.791172 11345 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.792133 11345 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.792970  8392 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:30.787686 11346 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:30.802274  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:30.807644  8463 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:30.804283  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:30.809751  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:30.810549  8463 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.813875 11323 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.820832  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:30.821774  8389 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:30.822664  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:30.824792  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:30.825479  8461 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:30.815865  8290 catalog_manager.cc:5697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:30.798061 10811 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.814210 11217 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.862932  8463 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:30.828173 11226 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.875813  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:30.877028  8463 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.895473  8463 raft_consensus.cc:2410] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:30.830437 11323 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:30.870918 11348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.007s
I20260709 13:02:30.872051 11307 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.873386 11370 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.912230  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:30.863993 10811 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:30.904424 11348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.008s	sys 0.008s
I20260709 13:02:30.916496  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:30.921105 11307 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.870288 11217 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.897361 11226 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.924397 11378 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.904011 11273 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.935990  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:30.936810  8469 raft_consensus.cc:2410] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:30.940091 11378 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.942564 11323 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:30.942956 11378 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.939363 11226 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.909569 11373 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.918233  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:30.954396 11226 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.912669 11224 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.970790 11383 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.945196 11370 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:30.972121 11374 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:30.952136 11378 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:30.973905  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:31.017050 11378 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.018182  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:30.935060 11211 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.949535  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:31.019603 11378 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.023499  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:31.027766  9032 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:31.028661  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.998047 11157 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.003367 10811 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:31.004899  9064 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:30.937510 11307 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.009975 11287 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.011059 11346 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.014094 11383 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:31.035429  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 85999.7us
I20260709 13:02:31.037568 11378 raft_consensus.cc:2764] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:02:31.053052  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.037048 11177 consensus_meta.cc:287] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.003s
I20260709 13:02:31.056463  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:31.061936  8390 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:31.032027 11370 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:30.976567 11373 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.072279 11211 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:31.061326 11226 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:02:30.985550 11004 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.073714 11211 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:31.076946  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1830) took 1823 ms. Trace:
I20260709 13:02:31.079010  8468 rpcz_store.cc:276] 0709 13:02:29.253631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.253779 (+   148us) service_pool.cc:224] Handling call
0709 13:02:29.254131 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:29.254497 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.254526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:29.255086 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 13:02:29.377120 (+122034us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:29.586790 (+209670us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.587003 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.587115 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.267012 (+679897us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18003c3040. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db
0709 13:02:30.267656 (+   644us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:02:31.072731 (+805075us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b24000ee0b8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe102809c4 00007fbe1027eacb 00007fbe10439dc9 00007fbe10439a55 00007fbe10438fb0 00007fbe130af488 00007fbe130afbe8 00007fbe13087398 00007fbe1308276a 00007fbe13081bb6
0709 13:02:31.076725 (+  3994us) raft_consensus.cc:1685] finished
0709 13:02:31.076746 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.076889 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202161,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":4850,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":4105,"spinlock_wait_cycles":79549440,"thread_start_us":305505,"threads_started":2,"wal-append.queue_time_us":216559}
I20260709 13:02:31.083331 11004 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:31.063195 11273 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:02:31.044896 11228 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:31.067236 11311 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.085726 11228 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:31.087625 11311 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:31.054937 11353 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.036101 11173 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.089615  8386 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:31.032887 11300 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.090098  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.090952  8541 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:31.091253  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.091426 11300 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:31.091874  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.076282 11370 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.092833 11370 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:31.093634 11370 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:31.094362 11370 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.094906 11370 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.093016  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:31.095491  8542 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:31.096768 11307 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.064019 11239 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.083252 11373 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:31.098340 11380 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:31.099452  8536 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:31.102108  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:31.097470 11239 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.179296  8542 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:31.181476  8358 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:31.196633 11173 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:31.208233  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 116871us
W20260709 13:02:31.245934  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 344194us
I20260709 13:02:31.247041  8507 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:31.251652 11300 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.252323 11300 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.253356  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.254211 11374 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.255698 11374 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:31.255240 11300 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.257926  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.252696 11157 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:31.196448 11238 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:31.260023  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.182691 11311 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:02:31.276466  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:31.263686 11283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.017s
I20260709 13:02:31.295158  8508 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:31.262064 11004 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:31.296887  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:31.260748 11384 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:31.295301 11283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.008s	sys 0.018s
I20260709 13:02:31.276032 11157 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:31.304888 11224 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.295713 11300 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:31.283627 11217 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.273345 11228 consensus_queue.cc:1059] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:02:31.320916  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.296064 11238 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:31.327083 11340 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:31.327957 11238 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.321163  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:31.331811  8467 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.322510 11224 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:31.334303 11385 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:31.335661 11224 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.326746 11004 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:31.338819 11004 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.324783 11378 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.326678 11106 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:31.343400  8467 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
W20260709 13:02:31.324326  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 64396.4us
I20260709 13:02:31.346403  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.347885  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.349615  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:31.350437  8467 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.353585  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.345208 11106 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:31.376137  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.389281  8467 raft_consensus.cc:2410] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:31.344331 11226 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:31.342201 11300 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.364408 10811 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:31.365736 11378 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.375272 11106 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.360930 11383 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.406281 11226 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:31.415436 11224 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.437623  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.439054  8461 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:31.438956  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:31.440755  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.409967 11391 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:31.372396 11157 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.445564  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:31.445866  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.446292  8542 raft_consensus.cc:2368] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:31.448330  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.449476  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.450085  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.442888  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.443753  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.450675  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.451200  8543 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:31.451879  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.453882 11392 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.454142  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.455384  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.456388  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.457441  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:31.457734  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.462730  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.464226 11238 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.464682  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.462777 11226 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.465461 11238 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.465603 11226 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:31.466149  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.466899 11238 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.467252 11300 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.468233  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.469401 11300 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.463200 11157 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.472735  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.473838 11300 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.475863  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.476987 11300 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.477352  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.477659 11379 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.478236 11379 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.479238  8433 leader_election.cc:400] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5.
I20260709 13:02:31.480392 11379 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:31.487025 11397 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:02:31.458498  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:31.489554  8468 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:31.491099  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.492535  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.492769  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.493139  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.494336  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.495988  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.496760  8392 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:31.486855  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.446170  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.504987  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.506192  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.507903  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.515581  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.516710  8395 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:31.517966  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:31.513437  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.520351  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:31.495141  8388 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:31.534056  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.522025  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:31.537349  8394 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.532986  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.537545  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.522346  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:31.539899  8392 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:31.541368  8386 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:31.543126  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.532577  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.544713  8359 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.544723  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.543901  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.548239  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.548264  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.549641  8468 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:31.552778  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.554847  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.555644  8468 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:31.559391  8394 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:31.538364 11345 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.541340 11379 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.551523 11173 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.547580 11238 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.586555  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.551412 11297 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:31.522961 10746 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.577108  8394 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:02:31.577342  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 73659.7us
I20260709 13:02:31.590644  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.591352  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.538985 11391 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:31.592496  8468 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:31.648052  8468 pending_rounds.cc:85] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 5
W20260709 13:02:31.647915  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 56633.2us
I20260709 13:02:31.648459  8468 pending_rounds.cc:107] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:31.648758  8468 raft_consensus.cc:2889] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.591358  8466 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:31.594470  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.629108  8393 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:02:31.629925  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.601207  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.583176 11106 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.654592 11391 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.553493  8359 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:31.656260  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 102886us
I20260709 13:02:31.656834 11391 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.657135  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.588639  8388 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:02:31.639490  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.657974 11379 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.658406 11379 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:31.647063 11226 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.658715  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.659839  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.660727 11300 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.660868  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.661626 11177 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:31.661996  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.658800 11379 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.662161 11177 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.663136  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.666497 11173 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:31.666975 11173 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.647997 10746 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.671748 10746 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:31.650059  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.639583  8392 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:31.647600  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:31.679123  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.681443  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 103752us
I20260709 13:02:31.682929  8508 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:31.684680  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.684995  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.686774  8466 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:31.685755  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.691471  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:31.692194  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.699410  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:31.700518  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.702222  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.640027 11297 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.708510  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.674259 11374 consensus_queue.cc:1059] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:02:31.705353  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 1033) took 1106 ms. Trace:
I20260709 13:02:31.713025  8536 rpcz_store.cc:276] 0709 13:02:30.598432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.598542 (+   110us) service_pool.cc:224] Handling call
0709 13:02:30.598807 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.099852 (+501045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.705191 (+605339us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400161554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:31.705308 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150996352}
I20260709 13:02:31.714496  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:31.715610  8393 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:02:31.701128 10746 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:31.699064 11226 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.706301 11217 raft_consensus.cc:2764] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:31.711007  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.727370 11297 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.727603  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.727972 11224 raft_consensus.cc:3055] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:31.728330 11224 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:31.712596 11237 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:02:31.728809  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.729384 11106 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:31.729099 11224 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.712538 11340 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.790275 11340 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.790587 11224 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:31.790704 11340 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.724354  8395 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:31.709532 11392 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.730427 11039 raft_consensus.cc:3055] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:31.732486  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 1038) took 1186 ms. Trace:
I20260709 13:02:31.701638 11391 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.735484  8461 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:31.737911  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.755084  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.816865  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.703714  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:31.818361  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 114700us
I20260709 13:02:31.819329  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:31.821117  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.706037 11378 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.762357 11379 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.765733 11173 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.766638 10746 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:31.768007 11065 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:31.772329 11239 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.785092  9065 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:31.786327 11238 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:31.804860 11070 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:31.806087 11405 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.002s
I20260709 13:02:31.847703 11177 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.810974  8390 rpcz_store.cc:276] 0709 13:02:30.546554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.546724 (+   170us) service_pool.cc:224] Handling call
0709 13:02:31.732278 (+1185554us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400335c54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:31.732393 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182276352}
I20260709 13:02:31.813284  8464 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:02:31.814396  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:31.823907 11157 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.838567  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.841881  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.853915  8539 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:31.854928  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.853940  8544 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:31.855901  8539 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:31.810681 11039 raft_consensus.cc:740] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:02:31.845716  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.846283 11070 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:31.859699  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:31.832722  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.850529 11238 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:31.851307  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.851548 11379 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:31.831496 11226 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.830127 11217 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:31.861433  8541 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
W20260709 13:02:31.863121  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.839600 11065 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:31.866288  8540 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:31.864356  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:31.869005  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 155696us
I20260709 13:02:31.870713  8540 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:02:31.870818  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 191494us
I20260709 13:02:31.873309  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.864212  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.879776  8544 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:31.840122 11391 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:02:31.886144  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.867976 11217 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:31.893591  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.884452 11392 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.898536  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.896373  8507 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:31.894558  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:31.880846 11157 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.863130 11378 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:02:31.873052 10811 consensus_queue.cc:1059] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:02:31.893855 11226 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:31.922919  8507 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:31.900643 11391 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.909123 10684 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.906641 11217 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.932801  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.937944  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.936103  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:31.943833  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.924952 11383 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:31.946841  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 118933us
I20260709 13:02:31.948081  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.923099 11226 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:31.952185  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:31.927862 11392 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:31.900259 10746 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.977829 11211 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:31.978644 11211 consensus_queue.cc:1243] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:31.980060  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.954578 11392 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:31.909173 11065 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:31.985432 11065 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.946197 11378 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:31.946700 11391 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.951459 11208 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.996512  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:31.999796  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:31.946382 11157 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:02:31.956879 11374 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.956166 11384 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.002537  8507 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.004385  8544 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:31.973766 11319 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:31.991971 11239 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:32.015482  8358 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.019488  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:32.016098  8535 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:32.033702  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.035727  8358 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.006249 11006 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:32.046273  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:32.046638  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:32.056412  8394 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:32.063496  8388 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:32.069129  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:32.004995 11340 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.071843 11340 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:32.072629  8539 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:32.076573  8394 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:32.078608  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:32.084877  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 114099us
I20260709 13:02:32.085716  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:32.001713 11004 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:32.021659 11345 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:32.086678  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:32.092970  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.034368 11319 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:32.096479  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:32.110706  8535 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:32.030330 11417 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:32.099409  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:32.100216 11238 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:32.101562  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:32.102069  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:32.103626  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:32.104014  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:32.105875  8465 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:02:32.105592  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:32.123703  8465 pending_rounds.cc:85] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:32.124063  8465 pending_rounds.cc:107] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:02:32.124337  8465 raft_consensus.cc:2889] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.106103  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:32.039862 11410 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:32.117719  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:32.078583 11173 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:32.115110 11374 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:32.097002 11224 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:32.038378 11412 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:02:32.142895  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.115995 11417 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:32.005390 11226 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.134400 11418 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.134624 11384 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.181988 11384 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:32.182466 11384 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.144956 11410 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.183139 11410 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:32.170392 11414 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:32.179522 11291 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:32.179531 11226 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.191830 11291 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.194075 11302 consensus_queue.cc:1059] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:32.194731 11291 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:32.195196 11302 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:32.195655 11302 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:32.196542 11302 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.202574  8360 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.143762 11345 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:32.229954 11173 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.178138 11379 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:02:32.232270 11393 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.800s	user 0.001s	sys 0.003s
I20260709 13:02:32.163077 11300 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.148166 11177 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:32.193313 11217 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:32.254192  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:32.265684  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:32.268422  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:32.214128 11302 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.153110 11417 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.277156  8466 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:02:32.291772  8466 pending_rounds.cc:85] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:32.292208  8466 pending_rounds.cc:107] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:32.292560  8466 raft_consensus.cc:2889] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.273770  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:32.246047 11340 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.241550 11177 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:32.287914 11361 consensus_queue.cc:1059] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:32.141839 11408 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:02:32.316397  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:32.211947 11418 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.329418 11039 consensus_queue.cc:260] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:32.301411 11177 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.320667 11238 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.332165  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:32.335239 11238 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:32.339874 11420 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:02:32.341311 11238 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:32.342546 11217 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:32.343204  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:32.344961 11039 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:32.348732  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.349990  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:32.350318 11217 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:32.351045 11217 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.351845 11239 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:32.352120  8435 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:32.352371 11239 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:32.353448 11211 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.354208 11006 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:32.354744 11006 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.353513 11217 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:32.360096 11421 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:02:32.360248  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:32.365833  8467 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:02:32.331478 11345 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.370114  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:32.371347  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:32.372465 11238 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:32.372925 11238 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.373291 11238 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:32.359434 11423 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:32.359462  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:32.303047 11340 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.380558 11323 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:02:32.383374 11226 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:32.378037 11410 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.420163  8358 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.416352 11070 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:32.391553 11177 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.418179  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:32.399271 11217 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:32.423740  8468 raft_consensus.cc:1240] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:32.426244  8358 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.427731  8394 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:32.295152 11319 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.437831  8395 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:32.438463  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:32.438496  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:32.442169  9067 raft_consensus.cc:1240] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:32.436885 11070 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:02:32.444205  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:32.445132 11224 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.446344  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:32.447932  8509 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:32.448882 11106 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.449939 11391 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:32.450973 11378 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.424701 11297 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.435285 11173 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.435652 11211 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:32.418426 11226 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.469599  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:32.473012  8468 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:32.432003 11237 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:32.432541 11300 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:02:32.471727 11426 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:02:32.844013  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:32.440553 11217 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:32.605855 11392 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.793248 11418 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:32.793814 11346 raft_consensus.cc:3055] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:32.795620 11208 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:32.869360 11208 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.886546 11208 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:32.888144  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:32.797029 11065 consensus_meta.cc:287] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.006s
I20260709 13:02:32.798616  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 1066) took 1217 ms. Trace:
I20260709 13:02:32.895104  8539 rpcz_store.cc:276] 0709 13:02:31.581349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.883295 (+301946us) service_pool.cc:224] Handling call
0709 13:02:31.883756 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.073076 (+189320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.624165 (+551089us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400041ad4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:32.798552 (+174387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433791744}
I20260709 13:02:32.802367 11409 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:32.896673 11409 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:32.897527 11409 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.898849 11409 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.837148 11157 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:32.903376 11157 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:32.907773  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.908555 11238 consensus_meta.cc:287] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.535s	user 0.014s	sys 0.000s
W20260709 13:02:32.864177 11424 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.456s	user 0.000s	sys 0.010s
W20260709 13:02:32.917944 11006 consensus_meta.cc:287] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.563s	user 0.014s	sys 0.005s
I20260709 13:02:32.918483 11006 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.920984 11006 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:32.923494 11217 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:32.925347  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:32.437566 11348 consensus_queue.cc:1059] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:32.810245 11177 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:32.816700 11384 consensus_meta.cc:287] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.634s	user 0.002s	sys 0.017s
I20260709 13:02:32.819226 11226 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:32.822268 11239 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:32.823292 11428 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.360s	user 0.004s	sys 0.005s
W20260709 13:02:32.826027 11417 consensus_meta.cc:287] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.005s
I20260709 13:02:32.828621 11410 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:32.829523 11340 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:32.834349  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:32.835597  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 360535us
W20260709 13:02:32.835657  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 360115us
I20260709 13:02:32.490947 11224 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:32.836313  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:32.837770  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:32.838690  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:32.866765 11392 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:32.842202 11378 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:32.866866  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet ef4deccb7c274fec97786db5d6131514 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:47224
W20260709 13:02:32.868295 11430 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:02:32.928009  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:32.956720 11378 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:32.959076 11378 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:32.909097 11238 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:32.946223  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 111999us
I20260709 13:02:32.951858 11177 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.950204  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.951099  8507 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:32.966629  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:32.967236  8392 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
W20260709 13:02:32.969995  8289 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50742 (request call id 137) took 17411 ms (client timeout 15000 ms). Trace:
I20260709 13:02:32.972991  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:32.986429  8466 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:32.865617 11346 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:32.964390 11177 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:32.976449 11319 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.989506  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:32.946007 11417 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.992573 11238 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:32.993283  8390 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:02:32.941161 11384 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.988173  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.024677  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:33.025581  8466 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:32.954115 11224 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:32.974720 11157 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:32.985144 11070 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.044034  8388 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:32.970490  8289 rpcz_store.cc:269] 0709 13:02:15.558267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.561026 (+  2759us) service_pool.cc:224] Handling call
0709 13:02:32.969928 (+17408902us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:26.227173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:26.337907 (+110734us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:26.337978 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:02:26.338011 (+    33us) tablet.cc:662] Decoding operations
0709 13:02:26.339752 (+  1741us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:26.339880 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:26.339921 (+    41us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:02:26.362512 (+ 22591us) tablet.cc:701] Row locks acquired
0709 13:02:26.397142 (+ 34630us) write_op.cc:260] PREPARE: finished
0709 13:02:26.415672 (+ 18530us) write_op.cc:270] Start()
0709 13:02:26.431021 (+ 15349us) write_op.cc:276] Timestamp: P: 1783602146404069 usec, L: 0
0709 13:02:26.523717 (+ 92696us) op_driver.cc:348] REPLICATION: starting
0709 13:02:26.585465 (+ 61748us) log.cc:844] Serialized 8234 byte log entry
0709 13:02:26.834279 (+248814us) op_driver.cc:464] REPLICATION: finished
0709 13:02:26.980686 (+146407us) write_op.cc:301] APPLY: starting
0709 13:02:26.980821 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:27.111728 (+130907us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:27.111880 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:27.114297 (+  2417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:27.114696 (+   399us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:02:27.114756 (+    60us) write_op.cc:312] APPLY: finished
0709 13:02:27.115208 (+   452us) log.cc:844] Serialized 144 byte log entry
0709 13:02:27.115394 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.115568 (+   174us) write_op.cc:454] Released schema lock
0709 13:02:27.115643 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:27.116043 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.116074 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34424,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":136101,"apply.run_cpu_time_us":5389,"apply.run_wall_time_us":144329,"num_ops":21,"prepare.queue_time_us":111671,"prepare.run_cpu_time_us":13459,"prepare.run_wall_time_us":387458,"raft.queue_time_us":81215,"raft.run_cpu_time_us":48061,"raft.run_wall_time_us":151191,"replication_time_us":310260,"spinlock_wait_cycles":726912,"thread_start_us":307457,"threads_started":4,"wal-append.queue_time_us":36705,"wal-append.run_cpu_time_us":19445,"wal-append.run_wall_time_us":1490900}]]}
I20260709 13:02:33.019955 11177 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:33.037883 11428 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:33.020147 11378 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.048116  8466 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:02:33.030488 11297 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:33.035102 11300 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.055756  8435 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:33.057917  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:33.058950  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:02:33.060252  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 56678.9us
I20260709 13:02:33.062148  8508 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.063333  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.068320  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:33.056937 11300 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.065730 11346 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:33.077020 11346 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:33.080978 11239 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.082422 11169 raft_consensus.cc:3055] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:33.082919 11169 raft_consensus.cc:740] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:33.083832 11169 consensus_queue.cc:260] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:33.096627  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.097364  8465 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:33.103554  8461 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
W20260709 13:02:33.105357  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 46500.2us
I20260709 13:02:33.107113  8536 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:33.109730  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.056524 11297 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:33.061720 11157 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.091322 11410 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:33.112591  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.113705 11239 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:33.053366 11378 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.114399 11311 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:33.112432 11302 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:33.126183 11378 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.077338 11300 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.114050 11425 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:33.104832 11432 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.120688 11238 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:33.107694 11392 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:02:33.124120 11177 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.131177  8508 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.132642  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.133268  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet ef4deccb7c274fec97786db5d6131514 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:33.119978 11239 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.138314 11239 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.138016 11297 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.131346 11410 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:33.140126 11410 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.121258 11408 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:33.130796 11379 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.145936 11177 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.146407 11417 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.138649 11238 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:33.136883 11432 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.142230 11392 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:33.147063 11384 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.148458 11039 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.184159 11238 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.151598  8467 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:02:33.165366 11392 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:33.186962  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.187819 11392 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.189020  8541 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:33.168721  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:33.179634 11224 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.164125 11379 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.133934 11425 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:33.143654 11408 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.184597  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.197252  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.188105  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.198114  8539 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:33.188220 11070 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:33.161406  8463 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:33.189692  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.190351  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.203660  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.204391  8541 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:33.204825 11425 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:33.205175  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.201381 11408 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.190457  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.153311  8543 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:33.191435  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.194671  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.208843  8544 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:33.209340  8461 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:33.210574  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.216255  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.203712  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.240386  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.240746  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:33.241168  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:33.241465  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.242594  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:33.189043 11392 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.243412  8393 raft_consensus.cc:2368] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:33.243566  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.250241  8390 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:33.221712  8539 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:33.246892  8386 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 10: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:33.254078  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.261281  8469 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:33.202131 11239 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.271059  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:33.275943  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:33.271423  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.272449  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:33.282838  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:33.282030  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 175947us
I20260709 13:02:33.284029  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.264559 11237 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.266562 11173 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:33.289702  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.291647  8433 leader_election.cc:400] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:33.283821 11157 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.282193  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:33.290132 11226 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.247048 11224 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:02:33.271256 11384 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.283030 11418 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.292241 11211 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.318478  8359 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.324769  8433 leader_election.cc:403] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.286325 11217 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:33.339839  9034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.326942 11226 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.343295 11226 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.328244 11417 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.348011  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.345526 11226 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.327419 11348 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.330241 11211 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.333145 11374 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.298178 11237 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.360277 11348 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:33.367352 11432 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.370587  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.373063  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.388756  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.390239  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.330061 11418 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.358938 11238 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:33.374893 11211 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.412782  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.414294  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:33.414999  8468 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:33.402496 11226 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.430181  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:33.430861  8466 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.416553 11392 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:33.423278 11432 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:33.423117 11173 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:33.443917 11348 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.446821  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.447536  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.448580  8463 raft_consensus.cc:2410] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:33.438289 11226 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:33.457950 11226 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:33.459209  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:33.467454 11173 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.468047 11391 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.468533 11391 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.434626 11319 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:02:33.470574 11391 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.471247 11325 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:33.471452 11239 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.471633 11325 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:33.475840  8466 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:33.431577 11170 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:33.479125  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 48725.7us
I20260709 13:02:33.485853 11418 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.477982  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.486769 11226 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.490694 11226 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.491495 11237 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.492074 11170 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.494441 11170 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:33.498848 11418 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:33.499464 11418 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:33.500382 11418 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:33.511997  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 70415.7us
I20260709 13:02:33.513927 10972 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:33.516978 10746 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:33.517650 10746 consensus_queue.cc:1243] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer d2a645dcec4c479ba4c94d075b1bc98c log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:33.520504  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.522953 11374 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:33.523886 11311 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:33.530550  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.548298 11319 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.475881 11408 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.551017  8544 raft_consensus.cc:2368] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8.
I20260709 13:02:33.553200 11408 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:33.553615 11237 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.558461 11237 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.559680 11374 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.560238 11374 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.561312 11237 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:33.574493  9034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.575238 11211 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.576766  8461 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:33.564188  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.579146 11211 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.493497 11226 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.567395  8467 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:33.571439  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.587255 11408 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.751983  8463 raft_consensus.cc:2410] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:33.751796 11408 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:33.754139 11408 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:33.590857  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.592921  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.755347  8393 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:33.594621 11239 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.756172 11239 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.758186 11239 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.595857  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.758888  8390 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:33.765158 10893 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.596632  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.599009  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:33.601199 11410 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.766664  8392 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 10: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:33.766546 11410 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.768579 11410 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.565667 11374 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.607009  8470 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:02:33.608088  8391 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:33.608640  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:33.614621  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.770370  8469 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.768968  8386 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:33.771039  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.615978  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:33.765687 10893 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.617085  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.617302  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.618100  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.619251  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.619400  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.619469  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.593711 11379 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.780360 10893 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:33.782899  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:33.783702  9065 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:33.785192  8509 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:33.788723 11374 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:33.788913  8358 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.630126  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.632704  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.637019  8464 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:02:33.643368  8461 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:02:33.644896 11384 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.646983 11157 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:33.668853 11325 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.796080 11157 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:33.796505 11374 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:33.798774  9033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.791539 11379 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:33.799572 11374 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:33.801187 11157 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.801626 11384 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.802871 11157 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.677845  8508 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:02:33.804504  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 126764us
I20260709 13:02:33.687789  8394 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:33.805698 11302 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:33.806365 11302 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:33.694621 10746 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.807031 11170 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:33.697484  8433 leader_election.cc:400] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8.
I20260709 13:02:33.807605 10746 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:33.808106 11170 raft_consensus.cc:3055] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:33.808130  8433 leader_election.cc:403] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.808490 11170 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:33.710367  9067 consensus_queue.cc:237] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:33.807299 11302 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.809442 11170 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.810659 11170 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.812608  8538 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:02:33.813115  8358 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.814713 11384 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.815380  8461 pending_rounds.cc:85] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:33.815687  8461 pending_rounds.cc:107] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:02:33.815959  8461 raft_consensus.cc:2889] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.816859 11173 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:33.822690  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 190076us
I20260709 13:02:33.825400 11379 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.825938 11379 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.826752 11379 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.795867  8464 pending_rounds.cc:85] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:33.830391  8464 pending_rounds.cc:107] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:33.830713  8464 raft_consensus.cc:2889] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.847211  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:33.848181  9065 raft_consensus.cc:2393] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 9: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:33.800179 11374 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:33.855775 11374 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.858631 11325 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.862952 10746 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:02:33.865288  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 52265.2us
I20260709 13:02:33.788771 10893 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:33.866227 10893 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.866667 10893 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:33.868983 11374 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.728435 11208 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:33.879137  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 181809us
I20260709 13:02:33.879635 11208 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.616355  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.882638  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.882975 11208 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:33.883670  8394 raft_consensus.cc:2410] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:33.886057  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.674594 11169 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.888643  8395 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:33.890280  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:33.891206  8394 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.892436 11379 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.903976  8391 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:33.907451  8470 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:33.911448 11170 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.911970 11353 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:33.912073 11170 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:33.711472  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 33) took 8418 ms. Trace:
I20260709 13:02:33.918339  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.875186  8465 pending_rounds.cc:85] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:02:33.919225  8465 pending_rounds.cc:107] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:33.919544  8465 raft_consensus.cc:2889] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.920161  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.875607 11291 consensus_queue.cc:1059] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:33.877575 11412 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:33.939057  8462 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:33.939872  8540 raft_consensus.cc:1275] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:33.873000  8469 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:02:33.887063 11436 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.122s	user 0.000s	sys 0.027s
I20260709 13:02:33.922737  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:33.942000  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.942550  8386 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:33.924471  8535 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:33.927345  8544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "448878eafac247d592f6889cb1e26a56"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:33.944068  8544 raft_consensus.cc:606] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:33.933985  8468 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:33.934389  9032 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.935503  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.936385  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:33.936905  8467 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:02:33.942730  8463 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:33.937726  8433 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:33.878669  8542 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:33.948535  8358 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.949700  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.949942 11239 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.950246  8376 tablet_service.cc:1558] Processing DeleteTablet for tablet 13811dee93af4290bdcf7d73b527d0f4 with delete_type TABLET_DATA_TOMBSTONED (TS 2122d8c723e84e3da22f81f7eeb4b1a9 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34302
I20260709 13:02:33.950958 11353 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.952857  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.953773  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.954402  8538 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:33.951412 11353 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.955825  8542 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 13:02:33.957765  8542 pending_rounds.cc:85] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 4
I20260709 13:02:33.958137  8542 pending_rounds.cc:107] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:02:33.958474  8542 raft_consensus.cc:2889] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.959278  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.914175  8290 rpcz_store.cc:276] 0709 13:02:25.293664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.293967 (+   303us) service_pool.cc:224] Handling call
0709 13:02:33.711398 (+8417431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:33.122813 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:33.149327 (+ 26514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:33.149379 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:02:33.149404 (+    25us) tablet.cc:662] Decoding operations
0709 13:02:33.179486 (+ 30082us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:33.179545 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:33.179573 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:33.179958 (+   385us) tablet.cc:701] Row locks acquired
0709 13:02:33.179979 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:33.180116 (+   137us) write_op.cc:270] Start()
0709 13:02:33.180224 (+   108us) write_op.cc:276] Timestamp: P: 1783602153180078 usec, L: 0
0709 13:02:33.180249 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:33.180878 (+   629us) log.cc:844] Serialized 1639 byte log entry
0709 13:02:33.580576 (+399698us) op_driver.cc:464] REPLICATION: finished
0709 13:02:33.620872 (+ 40296us) write_op.cc:301] APPLY: starting
0709 13:02:33.620962 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:33.621110 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:33.621250 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:33.621876 (+   626us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:33.622063 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:02:33.622105 (+    42us) write_op.cc:312] APPLY: finished
0709 13:02:33.622341 (+   236us) log.cc:844] Serialized 40 byte log entry
0709 13:02:33.622510 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:33.639364 (+ 16854us) write_op.cc:454] Released schema lock
0709 13:02:33.639419 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:33.639850 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:33.639897 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5337972,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":40016,"apply.run_cpu_time_us":2230,"apply.run_wall_time_us":18949,"num_ops":4,"prepare.queue_time_us":279790,"prepare.run_cpu_time_us":53369,"prepare.run_wall_time_us":170894,"raft.queue_time_us":218574,"raft.run_cpu_time_us":10199,"raft.run_wall_time_us":57591,"replication_time_us":400154,"thread_start_us":569729,"threads_started":4,"wal-append.queue_time_us":159742}]]}
I20260709 13:02:33.962054  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:33.942946 11226 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8.
I20260709 13:02:33.964910  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.960016 11208 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:33.967396 11467 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:02:33.955613 11353 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.956219 11239 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.971375  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:33.972312  8394 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:33.959870  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:33.976656  8538 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:33.962932 11211 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:33.983944  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:33.947446 11302 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:02:33.973398 11170 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:33.997332  8507 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:34.011559  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:34.012336  8468 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:33.997623  8542 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:34.000490  8544 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:33.961253 11106 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:02:33.970168 11384 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.014837  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:34.018151  8507 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:34.010087 11211 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.020555  8386 raft_consensus.cc:2393] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:33.994275  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet 7219cc411cf6498f8f250f689007874f with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:47224
I20260709 13:02:34.022434  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:34.026661 11442 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.023850  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:34.028064 11442 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.028467 11442 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.028898  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:34.032235 11345 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:34.032810 11345 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:34.033367 11226 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:34.033964 11226 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:34.033741 11345 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.034924 11226 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.036324 10746 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:34.036752 10746 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:34.038084 11065 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:34.044515  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:34.000977 11348 consensus_queue.cc:1048] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:34.024559  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:33.991931 11239 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:34.018618 11384 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.021574 11425 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:34.037667 10746 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.046871 11211 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:34.022790 11418 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:02:34.074921 10746 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.055189 11438 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:02:34.027117 11177 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:02:34.086139 11379 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.082472 11470 tablet_replica.cc:333] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:02:34.058028 11297 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:34.059748 11384 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:34.159521  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 126453us
W20260709 13:02:34.162357  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 133553us
I20260709 13:02:34.050496 11208 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.512584 11173 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:34.515895 11353 consensus_meta.cc:287] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.004s
I20260709 13:02:34.068764 11237 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:02:34.518564 11442 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.101897 11300 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.173s
W20260709 13:02:34.519325 11157 consensus_meta.cc:287] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.005s
I20260709 13:02:34.510129 11473 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.511652  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:34.527705  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:34.569118  8468 raft_consensus.cc:2410] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:02:34.509685 10893 consensus_meta.cc:287] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.005s
I20260709 13:02:34.531334 11392 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:02:34.470243  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 416718us
I20260709 13:02:34.531848  8358 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:34.510560 11169 consensus_meta.cc:287] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: Time spent flushing consensus metadata: real 0.623s	user 0.014s	sys 0.014s
W20260709 13:02:34.533602  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 371957us
I20260709 13:02:34.543577 11478 tablet_replica.cc:333] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:02:34.514335 11384 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.512810 11211 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.558331 11173 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:34.590847  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 59083.6us
I20260709 13:02:34.598728  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:34.603401 11237 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:34.575927 11473 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:34.607084 11004 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.607573 11004 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.607960 11004 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.594972 11477 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:34.562345 11353 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:34.600515 11157 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:34.584295 10893 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:34.623840 11384 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.626051 11157 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.629588 11173 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:34.590571 11392 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.630599 11486 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.631290  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:34.634392 11473 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:34.625486 11211 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.610298 11484 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.619158  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 456018us
I20260709 13:02:34.620476 11476 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.643429  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 114345us
I20260709 13:02:34.646929  9067 raft_consensus.cc:2393] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:34.647135  9065 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:34.628391 11442 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:34.646195  8433 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:34.651111  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:34.665575  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:34.666443  8542 raft_consensus.cc:2368] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:34.667245  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:34.667881  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:34.668035  8538 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.663760 11211 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:34.671211  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:34.641273 11157 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.674288 11211 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:34.645406 11486 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.697988 11392 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.736359 11488 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:34.718735 11211 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.649971 11484 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:34.651527 11476 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:34.736397 11482 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:34.746749 11486 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.746904 11476 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.743916 11353 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:34.749675 11475 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:02:34.749678 11484 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:34.633709  8293 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index 7 to 4, term changed from 7 to 6, leader changed from <none> to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196), VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) added. New cstate: current_term: 6 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:34.778790  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 187020us
I20260709 13:02:34.784809  8360 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:34.791785  8293 catalog_manager.cc:5697] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 3 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 4 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:34.794983  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 148648us
I20260709 13:02:34.799914  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:34.801170  8387 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.809141  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:34.810531  8393 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:34.811338  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:34.813095  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:34.674024  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 109910us
I20260709 13:02:34.815145  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:34.818876  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:34.797821  8293 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.832746  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:34.831166  8387 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:34.835044  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:34.838778  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:34.840078  9064 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:34.852252 10893 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:34.854271  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:34.855082  8435 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:34.855705  8542 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:34.860114 11157 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.861276  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:34.862528  8542 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:34.873997  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:34.875233  9067 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:34.859952  8391 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
I20260709 13:02:34.889528 11004 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:34.891569 11239 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:34.892526 11157 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:34.892814 11485 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:34.893409 11157 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.893719 11485 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.895804  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:34.896355 11485 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.896512 11157 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:34.897037  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:34.898017  8463 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:02:34.897575 11477 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:34.900568 11477 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:34.901160 11477 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:02:34.903254  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 48557.3us
I20260709 13:02:34.904289 11485 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:34.901244  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:34.886463 11476 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:02:34.902339  8538 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:02:34.908015 11491 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.909533 11211 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:34.905609  8464 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:34.907904  9033 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:34.914479  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:34.934744 11323 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.927925 11477 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:34.937983 11323 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.939924 11211 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:34.940716 11323 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:34.930158 11485 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.945711  8468 raft_consensus.cc:3060] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.951587  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:34.952829  9064 raft_consensus.cc:2393] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:34.956525 11448 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:34.955391  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 47874.1us
W20260709 13:02:34.959260  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58187.7us
I20260709 13:02:34.960466 11208 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:34.961082 11208 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:34.961531 11208 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:34.962316  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:34.963519 11211 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:34.963876  9067 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:34.964087 11211 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:34.965934  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:34.966713  8509 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:34.967654 11211 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:34.969594 11412 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:34.968287  8463 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:34.970255 11412 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:34.970513  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:34.971843 11412 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:34.974244  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 59949.2us
I20260709 13:02:34.975498  8360 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:34.976667 11300 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:34.977999  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:34.977934  8464 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:34.948432 11485 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:34.958781  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 177238us
I20260709 13:02:34.988523  8468 raft_consensus.cc:2468] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:02:34.948949 11004 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:34.990590  8433 leader_election.cc:400] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:34.991864  8433 leader_election.cc:403] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:34.957020 11448 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.992631 11374 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.014681 11483 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:34.996752 11448 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.955159 11491 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.028782 11491 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.028088  8293 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.030336  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 1961) took 1187 ms. Trace:
I20260709 13:02:35.041381  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:35.046445  9067 raft_consensus.cc:2368] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:35.030812  8465 rpcz_store.cc:276] 0709 13:02:33.815959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.874563 (+ 58604us) service_pool.cc:224] Handling call
0709 13:02:33.874938 (+   375us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:33.920221 (+ 45283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.920267 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:33.920870 (+   603us) log.cc:844] Serialized 78 byte log entry
0709 13:02:34.007601 (+ 86731us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.029199 (+ 21598us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b48000cd5d8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe18410aa1 00007fbe18407b37 00007fbe184079ca 00007fbe184ff26f 00007fbe184fef37 00007fbe1851355c 00007fbe18513508 00007fbe18513488 00007fbe18513443 00007fbe185126ec 00007fbe1743ca96
0709 13:02:34.539864 (+510665us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b1800460d80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe10374c0a 00007fbe19ab4219 00007fbe103fca40 00007fbe103f74e4 00007fbe103f7455 00007fbe16edf3c7 00007fbe134f19a7 00007fbe135010bf 00007fbe13501038
0709 13:02:34.540115 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.564187 (+ 24072us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.750282 (+186095us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b1800460d80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:34.827769 (+ 77487us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b1800460d80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f7455 00007fbe134df060 00007fbe134f1716 00007fbe13502287 00007fbe13502208
0709 13:02:34.956023 (+128254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.991086 (+ 35063us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.996753 (+  5667us) raft_consensus.cc:1685] finished
0709 13:02:34.996775 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.003443 (+  6668us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32763,"prepare.queue_time_us":517297,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":65998,"raft.run_cpu_time_us":3306,"raft.run_wall_time_us":116616,"spinlock_wait_cycles":40945536,"thread_start_us":163616,"threads_started":3,"wal-append.queue_time_us":192653}
I20260709 13:02:35.054051  8435 leader_election.cc:400] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:35.054504  8435 leader_election.cc:403] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.055363 11374 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:35.073961 11374 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.087313 11211 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.088104 11211 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.090306  8387 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:35.091471  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 440510us
I20260709 13:02:35.091701  9033 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.093211 11434 raft_consensus.cc:2804] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:35.093297 11476 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:35.093771 11434 raft_consensus.cc:697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:35.094594  8465 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:35.095606 11434 consensus_queue.cc:237] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.094125 11476 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.100075 11476 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.100262 11448 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.101572 11491 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.101974 11476 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.102675 11157 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.102413 11491 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.103284 11157 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.102687 11476 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.105060 11491 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.107326 11476 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.109869 11442 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.110587 11442 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.105551 11157 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.115051 11442 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:35.117383  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 127093us
I20260709 13:02:35.118553 11211 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.119035  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.121012  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:35.123301 11004 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:35.124056 11004 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.130561 11157 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:35.134384 11496 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.138408 11496 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.139250 11486 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.139901 11486 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.140620 11496 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.133335 11211 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:35.134842 11442 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:35.156827 11004 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:35.145634 11211 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:35.165885  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:35.166895  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.166908  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.168531  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.170650  8538 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:35.169991  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.173040 11237 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:35.176225  8390 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.176862  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.177433  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.177481  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.179906  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.155225 11374 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:35.180560  8393 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 3.
I20260709 13:02:35.161375 11211 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:35.183691  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.183809  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.186523  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:35.187220  8392 raft_consensus.cc:3060] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.186857  8544 raft_consensus.cc:2368] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:35.165503 11208 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.190330  8535 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.191007  8470 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:35.186460 11157 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.192011 11208 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.191980 11157 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.194207 11157 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.194978  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.195780  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.196578  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:35.197417  8468 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:35.197079 11442 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.198827  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:35.199532  8468 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:35.199785 11442 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:35.200763  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:35.201395  8468 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 3.
I20260709 13:02:35.201982 11486 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.203483  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:35.204069  8468 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:35.206703  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:35.206794  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.208443  8433 leader_election.cc:400] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:02:35.208352  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.209501 11157 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:35.210047 11157 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:35.210712 11157 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.209348 11491 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:02:35.209867 11300 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:35.212245  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:35.212816 11300 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.213891  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.215672  8387 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.209513 11237 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.216944 11300 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:35.217149 11237 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.217305  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:35.217600 11237 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.219128 11157 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.221248 11157 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.209331  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.223925  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.224748 11208 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.178840 11477 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.226104  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.226825 11208 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:35.209381  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.227933 11300 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:35.228117 11477 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:35.228397 11300 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.228845 11300 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.229144 11448 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:35.229575  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.230348 11496 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.230898  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:35.231603  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.232105  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:35.232512 11496 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.210209  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.209966  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.233515  8542 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:35.234380 11157 consensus_queue.cc:1059] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:02:35.234005  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.230935  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.235297 11496 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.234150  9067 raft_consensus.cc:2368] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:35.236680  8359 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.236913  8360 leader_election.cc:400] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:35.236944  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.237336  8360 leader_election.cc:403] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.244940  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.244997  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:35.247169  8392 raft_consensus.cc:2468] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:02:35.248508  9032 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:02:35.242075  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.251829  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:35.178369  8293 catalog_manager.cc:5697] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 5 to 7, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.252991  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.255540  8542 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.241339 11239 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.241091 11491 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:35.257561 11492 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.257894 11491 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:35.258040 11492 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.258368 11491 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.258483 11492 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.247022 11477 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.246647 11496 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:35.251078 11486 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.254220 11448 raft_consensus.cc:2804] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:35.271270  8392 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:35.263738 11496 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.272320 11496 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.278525  8293 catalog_manager.cc:5697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 6 to 7, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.261595 11477 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.256868 11208 consensus_queue.cc:1059] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:02:35.265842 11442 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.299587 11239 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7.
I20260709 13:02:35.301884 11374 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:35.302383 11374 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:35.304399  8387 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:35.283849 11448 raft_consensus.cc:697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:35.292865 11477 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:35.314620  8542 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
W20260709 13:02:35.314845  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 47119.3us
I20260709 13:02:35.246683 11237 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.316661  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:35.319408  8394 raft_consensus.cc:2368] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:02:35.322106  8433 leader_election.cc:400] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:02:35.322696 11392 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.322422 11300 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.323187 11392 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.324604 11300 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.325349 11392 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.322427  8433 leader_election.cc:403] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.309939 11442 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.327898 11442 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:35.328647  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.329162 11491 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.329942 11486 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.330081  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:35.331444 11491 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.332705 11157 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.335455  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.336059  8394 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
W20260709 13:02:35.336730 11497 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
I20260709 13:02:35.337172 11392 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.337821 11392 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:35.342676 11502 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:35.333225 11157 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:35.351069  8392 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:35.357017  8468 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:35.341292 11496 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.344111 11392 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.367045  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.367978  8392 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:02:35.368686  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.356473 11300 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.370337  8387 raft_consensus.cc:2410] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:35.366617 11486 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:02:35.393532  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:35.381238 11208 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.382226  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:35.381573 11157 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.378233 11392 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.393725  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:35.394428  8464 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.370394 11237 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.389480 11483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51684 (request call id 3) took 1663 ms. Trace:
I20260709 13:02:35.398705 11496 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.404482  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.379891  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.396220 11211 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.427575 11508 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.442322  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.402022 11392 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:35.428778  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 48984.5us
I20260709 13:02:35.451624  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:35.453583  8468 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:35.405555 11486 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:35.445235  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 55268.3us
I20260709 13:02:35.455195 11510 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.454713  8293 catalog_manager.cc:5697] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 4, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 4 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.458181  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.461022  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.399714 11448 consensus_queue.cc:237] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.466214  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.466459  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:35.444895 11496 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.422415 11157 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.459283 11510 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.424078 11208 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.473951  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.481074  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.480486 11300 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.472901 11496 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.468628 11442 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:35.506620  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.464772 11486 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.477113 11412 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:35.517675  8392 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:35.467267 11508 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.520504 11491 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.522881 11509 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.530493  8464 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:35.532500 11470 raft_consensus.cc:2243] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.532959 11157 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.514568 11496 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.483922  8293 catalog_manager.cc:5697] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 1 to 2, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.480686 11512 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:35.555743  8466 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:35.472780 11374 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.484678 11485 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.541761 11510 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.546990 11208 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.580981  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.515410 11300 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.587780 11348 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:35.406806 11483 rpcz_store.cc:276] 0709 13:02:33.707489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.707674 (+   185us) service_pool.cc:224] Handling call
0709 13:02:33.812092 (+104418us) log.cc:844] Serialized 494 byte log entry
0709 13:02:35.366564 (+1554472us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":309,"raft.run_cpu_time_us":1226,"raft.run_wall_time_us":1225,"thread_start_us":90939,"threads_started":1,"wal-append.queue_time_us":90396,"wal-append.run_cpu_time_us":2818,"wal-append.run_wall_time_us":1093480}
I20260709 13:02:35.588989  8467 raft_consensus.cc:2393] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 9: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:35.588722  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.591666  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:35.546005 11442 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.570567 11512 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:35.592175 11485 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:35.594069  8538 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:35.581889  8543 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:35.597204 11004 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:35.620009  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.597668 11208 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.550390 11518 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.623884  8543 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:35.624222  8541 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 13:02:35.624661  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:35.584160 11491 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.624533 11157 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.593297 11412 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.614012 11374 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.602994 11348 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.637549  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.661568  8464 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:35.657917  8468 raft_consensus.cc:1240] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:35.651629  8359 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.642150  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.732451  8541 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:35.732636  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.735047  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.741613  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.642557 11470 raft_consensus.cc:2272] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.632480 11510 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.611339 11509 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.646152 11392 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.654857 11508 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.639181 11412 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:35.672408 11211 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.652757 11491 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.643627 11478 raft_consensus.cc:2243] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.657305 11515 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.657151 11442 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:35.651870 11239 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.768975  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.646513 11237 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.638123 11520 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.630753 11208 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.774053  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:35.758507 11157 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:35.776201  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.660135 11492 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.786897  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.633052 11518 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.646440 11004 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.775585 11514 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:35.786419 11486 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.805238  8394 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.804371  8279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6becd976429a45a3874a10895b19b63e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:35.808178 11521 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:35.808773 11521 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:35.809437 11004 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:35.810225 11478 raft_consensus.cc:2272] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.811015 11521 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:35.799968 11239 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.650291 11512 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.820813 11522 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:35.821376 11522 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:35.822057 11477 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.822386 11522 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.824455 11477 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.825026 11509 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.825222  8464 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:35.794610 11237 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.827044  8393 raft_consensus.cc:1240] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:35.827476 11348 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.827919 11237 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.805805  8541 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:35.848891  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:35.863085  8467 raft_consensus.cc:2393] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:35.868654  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.788075 11510 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:35.873649  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 183343us
I20260709 13:02:35.879379  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:02:35.880534  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 228950us
I20260709 13:02:35.880578  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.882097  8463 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:35.882110  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.884438  8535 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.884899  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.784554 11515 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.848594 11478 ts_tablet_manager.cc:1916] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:35.885921  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:35.892752  8467 raft_consensus.cc:2410] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:35.892927  8466 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:02:35.886809  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:35.896241  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.896775  8392 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:35.893440  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.898178  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:35.898931  8394 raft_consensus.cc:2393] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 9: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:02:35.899469  8391 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:02:35.900121 11515 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.901750 11300 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.906221  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.907023  8540 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:35.793933 11520 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.917738  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.918417  8541 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.922109  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.906029 11434 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:02:35.926048  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:35.927485 11492 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.932183 11520 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.891063 11237 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:35.933158 11237 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:35.937431  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:35.937929  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:35.939692  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.951372  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:35.957507  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:35.960429 11208 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:35.960748 11525 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.960937  8540 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:35.961395  8540 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:35.962474 11533 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.915495 11477 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:35.963433  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.968936  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.960790  8393 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:35.975322  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:35.976636 11492 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:35.977392 11492 consensus_queue.cc:1243] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer d2a645dcec4c479ba4c94d075b1bc98c log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:35.977949 11492 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:35.978361 11492 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:35.979453 11492 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:35.980908 11492 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.983644  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.960330 11470 ts_tablet_manager.cc:1916] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:36.002148  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:35.948729 11486 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.006552  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.006711  8468 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:36.008046 11237 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.012233  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:36.017433  8541 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:35.960973 11518 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.026503  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.019654  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:36.019582  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 56884.3us
I20260709 13:02:36.023655  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.027707  8463 raft_consensus.cc:2393] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 4: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:36.024561  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.974421 11515 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:35.983428 11512 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.030689  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.031898 11519 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.032189  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.032501 11519 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.032972  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.033317  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:35.992408 11477 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:36.005308  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:36.037202  8467 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:36.042593  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.043556  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.045135  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:36.111838  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 48836.5us
I20260709 13:02:36.117416  8535 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:35.961467 11525 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:36.104679 11448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.016s	sys 0.040s
I20260709 13:02:36.122491  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:36.126232  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 143614us
I20260709 13:02:36.107983 11518 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.138814  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 92975.7us
I20260709 13:02:36.137954  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:36.039682 11486 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:36.138499 11448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.016s	sys 0.041s
I20260709 13:02:36.141832  8470 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:36.142649 11004 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.140120 11518 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.040845 11515 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.145357  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:36.184149  8358 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.005832 11533 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.141261 11509 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.146322 11208 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.153689 11512 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:36.205825 11512 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.205952 11522 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:36.206337 11512 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:36.206750 11522 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:36.207998 11522 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.198597  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:36.213958  8537 raft_consensus.cc:2393] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:36.217280  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.218587 11442 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.218600  8535 raft_consensus.cc:1275] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:36.220582 11442 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:36.203754 11486 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.234557 11519 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:36.199864  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 54606us
I20260709 13:02:36.202883 11509 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.203711 11523 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:02:36.203964 11518 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.204181 11208 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.204689 11541 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.201524 11157 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.245533 11486 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:02:36.201766 11004 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.250020 11208 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.251127 11004 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:36.252462  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:36.252938 11515 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.193874 11510 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.253477  8535 raft_consensus.cc:606] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:36.259747  8535 raft_consensus.cc:614] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:36.240749  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:02:36.262966  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 111260us
I20260709 13:02:36.263633 11541 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.267694 11541 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.261417  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.268252 11509 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.268149 11534 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:02:36.150334 11477 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.281000  8433 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.288854  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.286283 11208 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:36.283500 11496 consensus_meta.cc:287] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.000s
I20260709 13:02:36.278666 11515 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:36.296617  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 77002.2us
I20260709 13:02:36.297977  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:36.283802 11509 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.302377  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.316222  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.316524  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.317437  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.296707 11208 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.321820  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.323627 11558 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:36.326651  8387 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:36.297577 11515 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.331156  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.331815  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.298938 11520 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:36.332362  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.333828  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.334297  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.305325 11533 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.316633 11534 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.338624  8466 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:36.340704  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.341063  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.341264 11525 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.342424  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.343003  8540 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.344067  8540 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.300362 11496 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.338922 11520 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:36.344740 11534 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.336727 11515 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.335985 11509 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.350888  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:36.404183  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 53366.5us
I20260709 13:02:36.421108  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.396055  8507 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:02:36.402860 11374 consensus_meta.cc:287] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.005s
I20260709 13:02:36.428732  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.434394  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:36.434656  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.430763  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.403020 11534 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.436337  8394 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:36.439155  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.426548  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:36.435966  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 83781us
I20260709 13:02:36.473723  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.475931  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:36.476915  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.477666  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.478124  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.427018 11157 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.435050 11486 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:36.482496  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 143778us
I20260709 13:02:36.488453  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.497308  8467 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:36.499255  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:36.499965  8395 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.505460  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.431851 11509 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.495266 11239 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.521548  8539 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:36.520917  8467 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:36.521673 11237 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.524881 11237 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.494243 11550 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:36.517840 11562 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:36.534127  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.541993  8540 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
I20260709 13:02:36.547159  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.560601  8540 pending_rounds.cc:85] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 3
I20260709 13:02:36.549083  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.541607 11526 consensus_queue.cc:1059] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:02:36.545272 11522 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.562424 11526 raft_consensus.cc:3055] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:36.531663 11496 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.562870 11523 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.563799 11523 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.564324 11523 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.557480 11486 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.566478 11486 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.549923 11511 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.568637 11486 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.570538 11515 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.533124 11509 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.538230 11237 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.539247 11512 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.574208 11522 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.576277 11512 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:36.544193 11492 consensus_meta.cc:287] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.004s
I20260709 13:02:36.577910  8389 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:36.545370 11239 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.579257 11239 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.562870 11526 raft_consensus.cc:740] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:36.579900  8358 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.581274  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.580938 11526 consensus_queue.cc:260] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.549098  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.568372 11511 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.582532 11526 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:36.538849 11533 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.583576 11533 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.552968  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.586236 11492 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.588270  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.589381 11560 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.590193 11560 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.576298 11522 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.591859 11523 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.581537 11239 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.560910  8540 pending_rounds.cc:107] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:02:36.598001  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.598583  8540 raft_consensus.cc:2889] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:36.596625  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:36.598770  8393 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:36.573520 11515 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.602787  8358 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.600946  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.606617  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:36.607520  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 87404.1us
I20260709 13:02:36.597314  8395 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:36.612941  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:36.613802  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:36.584003 11511 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.625687  8386 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:36.585654 11533 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:36.615454  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.626485  8393 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.621498  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.623405  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.627966  8358 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.624923  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.616956 11512 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.628878 11239 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.629277  8358 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.629539 11239 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:36.630244 11239 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.630465  8358 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.624558  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.627985  8464 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:36.632040  8358 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.640025  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.544710 11562 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:36.633570  8358 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.627167  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.645900  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:36.628185 11517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.005s	sys 0.003s
I20260709 13:02:36.647737  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.650341  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.651044  8540 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:36.651120  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.604897 11519 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.650347  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:36.653369  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.661494  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.638604 11509 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.656782  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.672142  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:36.672686  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:36.647462 11517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.006s	sys 0.004s
I20260709 13:02:36.676919  8358 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.678499  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:36.647972 11515 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.681484  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.647301 11521 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:36.652805 11539 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.658150 11486 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.686352  8465 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:02:36.661341 11496 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.693372  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.694352  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.694628  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.673955 11511 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:36.694398  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.675894 11491 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.701578  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.703099  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.676108 11536 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.678515 11541 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.704321  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.661049 11533 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:02:36.661202 11522 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:36.689901 11525 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.719970  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:36.701184 11509 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:36.723330  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:36.700421 11492 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.703362 11512 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.705093 11157 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.704020 11491 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.718703 11208 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.744985 11515 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.720604 11510 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.731734 11509 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.730588 11374 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.731467 11533 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.720134 11521 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.732888 11486 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.763093  8386 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:36.752102 11157 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.752585 11491 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.734072 11237 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:02:36.721382 11536 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.770485 11509 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.815990  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.747813 11518 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:36.774359 11374 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.766916 11492 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.749859 11525 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.837481 11492 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:36.839550 11525 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.774557 11512 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.821374  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:36.812872 11239 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.820377 11157 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:36.826261 11573 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:02:36.770722 11515 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.849258  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:36.860214  8535 raft_consensus.cc:606] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:36.860571  8535 raft_consensus.cc:614] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:36.830776 11374 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.794448 11510 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.855952 11584 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.825235 11533 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.858129 11570 consensus_queue.cc:1059] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
W20260709 13:02:36.859145 11545 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.803s	user 0.008s	sys 0.012s
W20260709 13:02:36.856678 11571 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:02:36.840376 11525 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:36.844605 11478 ts_tablet_manager.cc:1929] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:02:36.813853 11562 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.850404 11512 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.865989 11486 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:36.909081 11478 log.cc:1199] T 7219cc411cf6498f8f250f689007874f P d2a645dcec4c479ba4c94d075b1bc98c: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/wals/7219cc411cf6498f8f250f689007874f
I20260709 13:02:36.924095 11588 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:02:36.925602 11578 log.cc:927] Time spent T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:02:36.924340 11586 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:36.955780  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 114857us
I20260709 13:02:36.958325  8508 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.959278  8469 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:36.923730 11492 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:36.871987 11584 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.926481 11520 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.973412  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.965238 11511 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.977036  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.977618 11511 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:36.978609  9067 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:36.977088  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:36.980835 11533 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.958160 11525 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.970638 11492 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:36.985618 11529 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.005s	sys 0.014s
I20260709 13:02:36.970551 11586 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.993607  8508 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:36.996834  8393 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:36.980000 11536 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:36.997189 11529 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.005s	sys 0.014s
I20260709 13:02:37.015534  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:37.001070 11520 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:37.000173 11523 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:37.026263  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:36.975680 11534 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.025302  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.033288  8393 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:37.034749  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.035615  8395 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:37.033262  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.030851 11510 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.016750 11515 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:36.985991 11486 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:37.040665 11581 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:02:37.032404 11598 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.997082 11525 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:37.026584 11574 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:02:36.999946 11492 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.042562 11601 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.023411 11580 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.027544 11536 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:36.999965 11586 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.068871 11515 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:37.101606 11517 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.106977 11534 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.115083 11536 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.115636 11584 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.116868 11579 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.117843  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.222796 11579 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.223490  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.224712  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.224929 11579 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.119498  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.226503  8391 raft_consensus.cc:2468] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:37.120822  8392 raft_consensus.cc:1240] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:37.228643  8392 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:37.228932 11470 ts_tablet_manager.cc:1929] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:02:37.229379 11470 log.cc:1199] T 13811dee93af4290bdcf7d73b527d0f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/wals/13811dee93af4290bdcf7d73b527d0f4
I20260709 13:02:37.122603  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.122944  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.124394 11597 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:37.124883 11506 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.126639 11492 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.128213  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:37.220840 11585 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.208s
I20260709 13:02:37.221316  8395 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:37.221444 11587 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.222193 11536 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.221817 11517 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.133697 11512 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.255121  8392 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:02:37.258240  8392 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:37.256733  8390 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:37.259285 11470 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34302 (request call id 0) took 3321 ms. Trace:
I20260709 13:02:37.260206 11586 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.259810 11470 rpcz_store.cc:276] 0709 13:02:33.948098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.949989 (+  1891us) service_pool.cc:224] Handling call
0709 13:02:34.082073 (+132084us) ts_tablet_manager.cc:1151] Deleting tablet 13811dee93af4290bdcf7d73b527d0f4
0709 13:02:34.082159 (+    86us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:36.605539 (+2523380us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:37.228760 (+623221us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:37.259146 (+ 30386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":976405,"tablet-delete.queue_time_us":131226,"thread_start_us":70509,"threads_started":1}
I20260709 13:02:37.264467 11525 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.275381 11517 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.238047 11348 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.279235  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 148886us
W20260709 13:02:37.285123  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 291658us
I20260709 13:02:37.288421  8508 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:37.289346 11478 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47224 (request call id 63) took 3322 ms. Trace:
I20260709 13:02:37.128758 11580 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.291749 11597 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:37.312388  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:37.320458 11597 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.321640 11607 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.312817 11553 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.320998  8508 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:37.278259 11515 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:02:37.332286  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 204165us
I20260709 13:02:37.334239  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.338164 11512 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:37.338616 11512 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.339012 11512 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.339267 11541 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.339892 11541 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.318823 11491 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:37.344265 11526 consensus_meta.cc:287] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.761s	user 0.007s	sys 0.004s
I20260709 13:02:37.344762 11491 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.345463  8394 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:37.345644 11374 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.347842 11374 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.313241 11509 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.330580  8507 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:37.293035 11348 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:37.351368 11512 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.351998 11348 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.352332 11553 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.352664  8463 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:37.352980 11553 consensus_queue.cc:1059] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:37.353780 11553 consensus_queue.cc:1059] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:37.353695 11515 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.354835 11553 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:37.355193 11553 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:37.355860 11587 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:37.356232 11587 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:37.351482  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:37.332984  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:37.319092 11525 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.316893 11237 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.328805 11584 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:37.380008  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46900.7us
I20260709 13:02:37.383730 11613 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.386827 11607 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:37.279032 11506 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.337754 11478 rpcz_store.cc:276] 0709 13:02:33.966865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.973853 (+  6988us) service_pool.cc:224] Handling call
0709 13:02:34.543084 (+569231us) ts_tablet_manager.cc:1151] Deleting tablet 7219cc411cf6498f8f250f689007874f
0709 13:02:34.543148 (+    64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:36.394874 (+1851726us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:36.830589 (+435715us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:37.289219 (+458630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1058144,"tablet-delete.queue_time_us":492547,"thread_start_us":466777,"threads_started":1}
I20260709 13:02:37.390146 11614 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:37.390957 11606 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:37.392633 11541 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.393572  8508 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:37.394016 11237 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.391288 11614 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:37.389263 11607 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:37.406081 11610 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.407984 11585 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:37.403352 11553 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.410338 11553 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:37.411594 11601 consensus_queue.cc:1175] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
I20260709 13:02:37.394037 11589 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.357095 11587 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.400439 11496 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.414170 11587 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:37.414366 11496 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.416508 11496 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:37.416679 11157 consensus_meta.cc:287] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.003s
I20260709 13:02:37.380867 11525 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.417060 11157 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.418785 11525 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.383229 11584 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.421555 11584 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.422148 11596 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:37.422583 11596 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.422986 11596 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:37.425700  9032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.022s	sys 0.013s
W20260709 13:02:37.427525  9032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.023s	sys 0.013s
W20260709 13:02:37.428134  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 803273us
I20260709 13:02:37.429008 11348 consensus_queue.cc:1048] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:37.427083 11237 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.399610 11614 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:37.440454 11525 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.440258 11584 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.448865 11525 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.449319 11577 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:02:37.449746 11542 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 1.421s	user 0.003s	sys 0.015s
I20260709 13:02:37.451236 11525 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.443542 11512 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:37.463130  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 77775.2us
I20260709 13:02:37.449390 11584 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.467170 11584 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:37.482362 11570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.007s
I20260709 13:02:37.469537 11521 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:37.492871 11506 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.494259 11580 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:37.498744 11570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.009s	sys 0.007s
I20260709 13:02:37.503894 11157 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.500682 11614 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.505046 11614 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.513579 11596 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.515997 11596 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:37.516341  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 51894.9us
W20260709 13:02:37.528450  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 130550us
I20260709 13:02:37.534749  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:37.538017  8461 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.539026  8464 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:37.545449 11550 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:37.547168 11550 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:37.548151 11550 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.549880 11550 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.559697  8466 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:37.531771 11529 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:37.561515 11529 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:37.562798 11529 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.563786 11529 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.568987 11522 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:37.571820 11509 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.573105  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 1282) took 1055 ms. Trace:
I20260709 13:02:37.573542  8537 rpcz_store.cc:276] 0709 13:02:36.517312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.522705 (+  5393us) service_pool.cc:224] Handling call
0709 13:02:36.530479 (+  7774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.548839 (+ 18360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.548867 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.549354 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.648670 (+ 99316us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:36.671030 (+ 22360us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.762695 (+ 91665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.762767 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.414249 (+651482us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b1800381400. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:02:37.565239 (+150990us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b2400200dc8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe102809c4 00007fbe1027eacb 00007fbe10439dc9 00007fbe10439a55 00007fbe10438fb0 00007fbe130af488 00007fbe130afbe8 00007fbe13087398 00007fbe1308276a 00007fbe13081bb6
0709 13:02:37.572873 (+  7634us) raft_consensus.cc:1685] finished
0709 13:02:37.572898 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.573022 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60984,"prepare.queue_time_us":24869,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2793,"raft.queue_time_us":53796,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":174,"spinlock_wait_cycles":54457984,"thread_start_us":177740,"threads_started":2,"wal-append.queue_time_us":139619}
W20260709 13:02:37.579977  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.580552  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.580909  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.582540 11511 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.591320  8466 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:37.594259 11506 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.594815 11506 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:37.596786 11506 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:37.600135  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.610093  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.611246  8539 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:37.612346  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.614032  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.611204  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:37.615290  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.616325  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.617290  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.613544  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:37.619913  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.624405  8538 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:02:37.627089  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.627933  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:37.629858  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.631207  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:37.635334  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 286) took 1007 ms. Trace:
W20260709 13:02:37.683435  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 72993.7us
I20260709 13:02:37.685293 11530 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:37.687108 11607 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:37.687649 11607 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:37.688820 11607 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.629467 11509 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:37.696310 11509 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.696785  8508 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:37.569675 11522 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.698750  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.622430 11590 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:37.634068 11562 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.712390 11588 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:37.723727 11590 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.635679  8468 rpcz_store.cc:276] 0709 13:02:36.627596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.320712 (+693116us) service_pool.cc:224] Handling call
0709 13:02:37.321078 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.321304 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.321329 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.321829 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.475007 (+153178us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:37.621966 (+146959us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.630970 (+  9004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.635178 (+  4208us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.635208 (+    30us) raft_consensus.cc:1685] finished
0709 13:02:37.635215 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.635293 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8726,"prepare.queue_time_us":153737,"raft.queue_time_us":9577,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"thread_start_us":273770,"threads_started":2,"wal-append.queue_time_us":167971}
I20260709 13:02:37.758751  8358 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:37.764127  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:37.733417 11509 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.725236 11562 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:37.728892 11588 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:37.778949  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 71137.6us
I20260709 13:02:37.765570 11527 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:37.770048 11523 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:37.785508  8536 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:37.788465  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.761219 11506 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:02:37.783797 11561 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.794781 11523 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:37.815306 11562 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:37.794885 11583 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:02:37.809437  8537 raft_consensus.cc:2955] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:37.825937 11491 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:37.833345  8541 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:37.834323 11491 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:37.835242 11627 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:37.836719 11491 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.837661 11590 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:37.841866  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.846134  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 44848.1us
I20260709 13:02:37.848063 11588 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:37.855073  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:37.859342 11558 raft_consensus.cc:3055] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:37.859850 11558 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:37.861301 11348 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.864248  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c257a516245f4698b8937b228b23d23a"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:37.864890  8536 raft_consensus.cc:606] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:37.865271  8536 raft_consensus.cc:614] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:37.868847  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:37.869772  8466 raft_consensus.cc:2410] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:37.874364  8392 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.844069 11543 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:02:37.900352  8463 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:37.900848  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:37.884109 11239 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:02:37.879534 11523 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.046988  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:37.893417 11477 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:02:37.895150 11558 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.047853  8542 raft_consensus.cc:606] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:38.053611 11558 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:38.053900 11521 consensus_queue.cc:1175] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" responder_term: 8 status { last_received { term: 8 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 8 index: 4 } }
I20260709 13:02:38.058346 11553 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:02:38.127509  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.115676 11625 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:38.146657 11522 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.147657 11606 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.148058 11606 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:38.148911 11606 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.150964 11580 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:38.151618 11526 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:38.151520 11580 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.152005 11526 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:38.152721 11632 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.152899 11526 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.153643 11580 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.153484 11632 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.164196 11526 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:38.178475 11630 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.355s	user 0.004s	sys 0.000s
I20260709 13:02:38.160197 11625 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.182443  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.185003 11625 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:38.174134 11606 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.202426 11580 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:38.202673  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1933) took 1084 ms. Trace:
I20260709 13:02:38.203166 11580 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.203085  8387 rpcz_store.cc:276] 0709 13:02:37.117953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.123847 (+  5894us) service_pool.cc:224] Handling call
0709 13:02:37.124136 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.277482 (+153346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.277526 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.277579 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:37.277617 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.202391 (+924774us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540035a554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:02:38.202442 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.202587 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352058240}
I20260709 13:02:38.217175 11583 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.222796  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:38.230760  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.290917 11591 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.205569 11580 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.300928 11520 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.301559 11520 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.303835 11520 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.307602 11591 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.317665 11583 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.335414  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.337324  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.160528 11632 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:38.383397  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.384279  8538 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:02:38.398996 11591 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:37.289398  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet 13811dee93af4290bdcf7d73b527d0f4 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
W20260709 13:02:38.402258  8277 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 1.11533e+06us
I20260709 13:02:38.321019 11583 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:38.405702 11607 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.407564 11637 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.434880 11637 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:38.435735 11637 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.414170  8463 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:38.440400  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.440659  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:38.441164  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:38.441489  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.442709  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:38.450222  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.450865  8393 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:38.452085  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.452641  8393 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:38.466897  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:38.467633  8463 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 4.
I20260709 13:02:38.470651  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.472327  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:38.474958  8358 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:38.475438  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:38.476388  8464 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:38.481235  8463 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:38.482996  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:38.513976  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 133248us
W20260709 13:02:38.520637  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 421333us
I20260709 13:02:38.535845  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.548766  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.466243 11580 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:38.550357  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.483642 11518 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:38.557876  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:38.558447  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.559085  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.559743  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.564239  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.564375  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.565471  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:38.568153  8392 raft_consensus.cc:2393] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:38.564970  8394 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 4.
I20260709 13:02:38.531622 11506 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:38.535130 11619 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:38.573949  8507 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:38.579567  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:38.582769  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:38.585062  8466 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:38.583420  8461 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:38.567312 11477 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.594206  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.595379  8388 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:38.576603 11506 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.599181  8466 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:38.604890  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:38.605751  8461 raft_consensus.cc:2410] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:38.606925  8466 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:38.568599 11518 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.614624  8391 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:38.591632 11520 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:38.572255 11580 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.610049  8507 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:38.617043  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.620075  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.602556 11506 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:38.626178  8391 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:38.586962 11619 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.628505 11566 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:38.628979 11566 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.629338 11566 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.636451  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.600198 11477 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.682036  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 1310) took 1070 ms. Trace:
I20260709 13:02:38.618806 11520 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:38.802452  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 192479us
I20260709 13:02:38.804507  8507 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:38.729588 11633 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:38.682519  8544 rpcz_store.cc:276] 0709 13:02:37.611898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.630763 (+ 18865us) service_pool.cc:224] Handling call
0709 13:02:37.682198 (+ 51435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.682556 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.682595 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.069709 (+387114us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b2c001564c8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:02:38.071291 (+  1582us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.506304 (+435013us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:38.506358 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.506454 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.679078 (+172624us) raft_consensus.cc:1685] finished
0709 13:02:38.679100 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.681941 (+  2841us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":459,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":63987072,"thread_start_us":431031,"threads_started":1,"wal-append.queue_time_us":598123}
I20260709 13:02:38.803772 11517 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.805686 11541 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.820657 11517 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.822676  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.828500 11412 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.838876 11518 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.830719 11580 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.839960 11619 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:38.841041 11477 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.841948 11523 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:38.842836 11520 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.849205 11631 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:38.813434 11648 log.cc:927] Time spent T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:02:38.859412 11646 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.155s	user 0.003s	sys 0.000s
W20260709 13:02:38.872746  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 53367.5us
W20260709 13:02:38.852461 11606 consensus_meta.cc:287] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.002s
I20260709 13:02:38.861361 11637 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.863943 11561 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.896312  8508 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:38.877563 11580 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.877192 11631 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:38.906598  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.908258  8540 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:38.851742 11506 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.908586  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:38.911237  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.870496 11541 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.892885 11518 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:38.913700  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.919387  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:38.876011 11412 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.909833 11631 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:38.921762  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:38.896262 11561 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.923117  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.923668  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.923870  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.924351  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.877331 11523 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.926352  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.926882 11541 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.929229 11651 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.930222  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.930799  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:02:38.934506  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.505s (SENT) [suppressed 11 similar messages]
I20260709 13:02:38.936532 11517 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.903975 11606 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:02:38.938397  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.939635 11570 raft_consensus.cc:3055] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:38.940002 11570 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:38.940462 11523 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.940799 11570 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:38.943660 11650 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
I20260709 13:02:38.934551 11604 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:02:38.931807 11580 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.945998 11580 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.947019 11580 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:38.947480 11580 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.955686  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:38.956759  8541 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:02:38.957147  8541 pending_rounds.cc:85] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 6
I20260709 13:02:38.957373  8541 pending_rounds.cc:107] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:02:38.957607  8541 raft_consensus.cc:2889] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.956458 11651 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.961773 11651 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.961896 11412 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:38.963740  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.963857  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:38.964025  8535 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:38.964735  8544 raft_consensus.cc:2410] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:38.936422 11601 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.956489  8538 raft_consensus.cc:2393] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:38.970323  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:38.967578 11570 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:38.968007 11601 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:38.978258 11601 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.982257 11561 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:38.968253 11004 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.983179 11004 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.985245 11004 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:38.965410 11607 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.987448 11607 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:38.990154  8544 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:38.932613 11518 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:38.995223  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 60746.2us
I20260709 13:02:38.989656 11607 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.004724  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.040975  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:02:39.053915 11645 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.335s	user 0.000s	sys 0.003s
I20260709 13:02:39.050554 11655 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.055711 11518 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.055583 11655 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.058785 11655 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.066378 11631 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.069213 11631 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.078209 11601 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.079129  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.080848  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.081632 11601 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.083472  8390 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:39.085455  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.087606  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.088231  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.088855  8535 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:39.088231  8538 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:39.090775  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.091341  8535 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:39.092612  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.048184 11580 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.093292 11506 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.094152  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.094877  8535 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:38.998404 11566 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.102476 11566 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.103236  8537 raft_consensus.cc:2393] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 5: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:39.113627  8536 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:39.115803 11580 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.116789 11518 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:39.119200  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.122524 11583 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:39.129151  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:39.130906  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 202159us
I20260709 13:02:39.141696  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.142378  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.143030  8389 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:38.437487  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet 7219cc411cf6498f8f250f689007874f (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
W20260709 13:02:39.144224  8278 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 706830us
I20260709 13:02:39.143944 11518 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.145125 11583 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.146343 11518 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.147866 11583 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.148830 11580 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.150149  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.150993  8394 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:39.151343 11580 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.155965  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.152911 11657 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.156677  8388 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
W20260709 13:02:39.171058  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.175915  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.176648  8394 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:39.176225  8288 catalog_manager.cc:5697] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.178036  8288 catalog_manager.cc:5697] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 6, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.180480  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.179948  8288 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.186192  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.185717  8288 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:39.190382  8293 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 159) took 23356 ms (client timeout 15000 ms). Trace:
W20260709 13:02:39.190882  8293 rpcz_store.cc:269] 0709 13:02:15.833916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.834102 (+   186us) service_pool.cc:224] Handling call
0709 13:02:39.190280 (+23356178us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:35.930051 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:35.930756 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:35.930806 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:02:35.930838 (+    32us) tablet.cc:662] Decoding operations
0709 13:02:35.931807 (+   969us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:35.931896 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:35.931930 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:02:35.932701 (+   771us) tablet.cc:701] Row locks acquired
0709 13:02:35.932744 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:02:35.932897 (+   153us) write_op.cc:270] Start()
0709 13:02:35.933041 (+   144us) write_op.cc:276] Timestamp: P: 1783602155932838 usec, L: 0
0709 13:02:35.933059 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:02:35.933691 (+   632us) log.cc:844] Serialized 3290 byte log entry
0709 13:02:36.470872 (+537181us) op_driver.cc:464] REPLICATION: finished
0709 13:02:36.624746 (+153874us) write_op.cc:301] APPLY: starting
0709 13:02:36.624864 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.625079 (+   215us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.625219 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.636533 (+ 11314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.636825 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:02:36.636891 (+    66us) write_op.cc:312] APPLY: finished
0709 13:02:36.637257 (+   366us) log.cc:844] Serialized 64 byte log entry
0709 13:02:36.637445 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.637575 (+   130us) write_op.cc:454] Released schema lock
0709 13:02:36.637642 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:36.670836 (+ 33194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.672851 (+  2015us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28437,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":153570,"apply.run_cpu_time_us":3618,"apply.run_wall_time_us":16515,"num_ops":8,"prepare.queue_time_us":249252,"prepare.run_cpu_time_us":13754,"prepare.run_wall_time_us":195314,"raft.queue_time_us":205066,"raft.run_cpu_time_us":37640,"raft.run_wall_time_us":51916,"replication_time_us":537598,"thread_start_us":393703,"threads_started":4,"wal-append.queue_time_us":301854,"wal-append.run_cpu_time_us":21217,"wal-append.run_wall_time_us":1469100}]]}
I20260709 13:02:39.189077  8288 catalog_manager.cc:5697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 10 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.194941  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.200582  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.197036  8288 catalog_manager.cc:5697] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.201076  8463 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:39.202936  8288 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.203358  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.204905  8465 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:39.205449 11654 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:39.207334  8433 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:39.206032 11654 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:39.215976 11654 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:39.218897  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:39.209824 11651 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.229019  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:39.229893  8388 raft_consensus.cc:2368] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7.
I20260709 13:02:39.211287  8288 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 4 to 7, term changed from 6 to 7, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193), VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:39.235977  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.237985  8463 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.236637  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:39.242059  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:39.245507  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:39.235399 11660 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:39.246315  8288 catalog_manager.cc:5697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.239079 11651 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:39.243494 11518 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:39.248193 11657 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:39.245072  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:39.249550  8395 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.251824 11580 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:39.257908  8288 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 7, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:39.261987 11518 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:39.263144 11518 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.306010  8288 catalog_manager.cc:5697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 7, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.306103  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.310706 11658 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:39.311460 11658 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:39.316398  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.316861  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.317032  8465 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:39.283963 11583 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:39.329277 11583 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.308128  8288 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.390220  8463 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:39.402361  8395 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:39.403631  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.404287  8537 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
W20260709 13:02:39.407372  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 154598us
I20260709 13:02:39.398681  8288 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 10 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.408089  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.382577 11660 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:39.382220 11580 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:39.409658  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:39.411854  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:39.416142  8535 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:39.414273  8288 catalog_manager.cc:5697] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.418244 11654 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:39.418790 11654 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.420864 11654 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.421449 11637 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.422164 11637 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:39.441247  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.430205  8288 catalog_manager.cc:5697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.430547  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.445331  8535 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:39.445428  8544 raft_consensus.cc:1813] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Handling vote request from an unknown peer 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:39.448051  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.459774  8463 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:39.433852 11543 raft_consensus.cc:993] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:39.449334  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.461367  8288 catalog_manager.cc:5697] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.446493  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.443706 11670 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:39.460094  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:39.438432 11658 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:39.464326 11660 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.465411  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:39.466600 11412 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:39.467060 11412 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.468602  8544 raft_consensus.cc:2410] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:39.425391  8465 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:39.467410 11412 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.434047 11583 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.472112  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.470465  8507 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:39.470348  8288 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:39.501154  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.446005 11666 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:39.503212  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.473470 11518 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.511024 11442 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:39.513252  8507 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:39.511219  8376 tablet_service.cc:1558] Processing DeleteTablet for tablet 13811dee93af4290bdcf7d73b527d0f4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:34302
I20260709 13:02:39.513420 11442 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.514437 11442 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.514743 11591 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:39.515149 11591 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:39.515654 11591 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:39.475500 11637 raft_consensus.cc:1081] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:39.515175  8507 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:39.508039  8288 catalog_manager.cc:5697] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.519007  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.521152 11613 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:39.521552 11613 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.521858  8507 leader_election.cc:400] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7.
I20260709 13:02:39.522193  8507 leader_election.cc:403] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:39.524747 11635 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7.
I20260709 13:02:39.507019 11669 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:39.521893 11613 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:39.533942 11442 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.536327 11442 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.438970 11580 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.544719  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.500448 11670 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:39.552372  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.548528  8288 catalog_manager.cc:5697] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 5, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.553870  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.540266 11518 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:39.555543  8508 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:39.557479  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.555168 11667 raft_consensus.cc:2764] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:02:39.555289 11656 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:39.556738 11651 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:39.573696  8508 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:39.548184 11666 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:39.571133 11528 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.575270  8288 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.590831 11607 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:39.588356 11670 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:39.601560  8508 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:39.602909  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.618842  8433 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.620842  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.620011 11666 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:02:39.608071  8508 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:39.590018 11667 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:02:39.628885  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 90290.8us
I20260709 13:02:39.618911 11527 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:39.620329 11657 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:39.622774 11518 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:39.619107 11607 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:39.633554  8288 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.629071 11670 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:39.605324 11412 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.640101 11607 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.642237  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:39.643474  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.643630  8288 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 6, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.625021 11669 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:02:39.633257 11527 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:39.643114  8508 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:39.653882  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.657467  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.654508  8358 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:39.665657  8358 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:39.662585  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.671253  8288 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 6 to 8, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.670732 11666 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:39.673947 11670 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:39.677682  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.679697  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.681273  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.682875  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.684593  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.685616 11412 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.687116  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.688271  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.642345 11606 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:39.689865  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.668879 11527 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.691529  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.693725  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.671231 11566 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:39.671851 11561 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:39.707140  8358 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:39.655139 11518 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.668692 11523 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:39.708834 11677 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:39.710289 11677 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.710602 11677 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.706316 11591 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.712864 11591 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.718427  8288 catalog_manager.cc:5697] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 3, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 3 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.720566  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.721472  8469 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.727648  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.730856  8288 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 8, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.743661 11677 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.708648 11566 raft_consensus.cc:697] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:39.748237 11566 consensus_queue.cc:237] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.719745 11523 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.750321 11523 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.751078 11677 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.707917 11561 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:39.758143 11561 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:39.762903 11613 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.765286 11613 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.765885 11541 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:39.766341 11541 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.766701 11541 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.730337 11412 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.770309 11412 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.772526 11412 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.783710  8288 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 5, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.785676  8288 catalog_manager.cc:5697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 8, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.794819  8288 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 6 to 7, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.797899  8469 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:02:39.803580  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 75466.7us
I20260709 13:02:39.804382  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.804435  8358 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:39.807758  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:39.810850  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.811086  8464 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:39.812379  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.813060  8288 catalog_manager.cc:5697] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 5, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.838768  8288 catalog_manager.cc:5697] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 6, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.817355 11412 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:39.842051 11527 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.823800  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.824396  8461 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:39.843924  8461 pending_rounds.cc:85] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 5
I20260709 13:02:39.844192  8461 pending_rounds.cc:107] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:39.844429  8461 raft_consensus.cc:2889] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:39.845072 11527 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:39.824586  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.825219  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.826546  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.845602  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.847596  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.848932  8470 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:39.849359  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 45011.6us
I20260709 13:02:39.847600  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.829007  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.829921  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.830587  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.832861 11518 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.833346 11561 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.823314  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.846235 11523 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.840689  8288 catalog_manager.cc:5697] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 6, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 6 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.850080  8358 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:39.852234  8469 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:39.852869 11677 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:39.869438  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.868673  8288 catalog_manager.cc:5697] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.870019  8358 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:39.854149  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.862828  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.870113  8470 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:39.871359  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.871722  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.866029 11652 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:39.872589  8288 catalog_manager.cc:5697] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 5, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.843055 11412 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:39.870105  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.854133 11541 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.873129  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.874184  8463 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:39.877354  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.869150 11677 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.879195 11677 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:39.877663 11652 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.876072 11673 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:39.882973 11561 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.883065  8395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:39.872663 11506 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:39.883875  8395 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.884083 11506 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:39.878803  8288 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.884995  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:39.885097 11506 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.884300  8395 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:39.886829  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.887940  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.885600  8393 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.866175  8468 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:02:39.893213  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:39.893752  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:39.894613  8387 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:39.895601 11412 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.888450  8462 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:39.897270  8466 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:39.898015  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.898622  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:39.899690  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.898955  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:39.898669  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.900425  8387 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:39.899250  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.905160  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:39.898810  8395 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.907003  8391 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:39.907583  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet 13811dee93af4290bdcf7d73b527d0f4 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:39.909595  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:39.909744  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.910399  8390 raft_consensus.cc:1240] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:39.912446  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:39.912700  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:39.913169  8541 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:39.913407  8540 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:39.916103  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:39.922857  8395 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.927918  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:39.928426  8537 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:39.922144  8393 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:39.919773  8463 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:39.933001  8507 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:39.933974 11606 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:39.929561  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.881673 11652 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.905447 11553 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:39.948707  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.960580 11541 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:39.923121 11673 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:39.969220  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.970605  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.970744  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:39.977306 11673 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:39.965091 11553 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.004436 11523 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:40.013320 11677 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.050514  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.061707  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:40.064556  8537 raft_consensus.cc:3055] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:40.064919  8537 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:40.065661  8537 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.067114  8537 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.063681  8507 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.035166 11553 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.079237  8389 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:40.087090  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.095463  8537 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:40.097637  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.074474 11587 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:40.142593  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.147069  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 64360.1us
I20260709 13:02:40.153105 11523 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:40.153743 11523 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.155961 11523 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:40.085758 11673 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:40.162134  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.166215  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.166393  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:40.164621  8358 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:40.174754  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.176360  8507 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.173694  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.181773  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:40.182441  8543 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.186890  8470 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:40.186730  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:40.187557  8540 raft_consensus.cc:2393] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:02:40.191860  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:40.198105  8543 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:40.199334  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:40.174589 11674 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:40.201109  8538 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:40.201771  8470 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:40.168972 11673 consensus_queue.cc:1059] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:02:40.203982  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:40.205562  8537 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:40.202754 11677 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:40.204229  8507 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.210947  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.200052 11591 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:40.215417  8537 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:40.215735  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.217985  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.214512 11637 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:40.211453 11674 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:40.226711  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:02:40.225116 11686 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:02:40.222999 11677 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:40.233539  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:40.236281  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:40.236373  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.236984  8463 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:40.228698 11591 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:40.236172 11677 raft_consensus.cc:697] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:40.238929 11591 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.239331 11677 consensus_queue.cc:237] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.229158 11527 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:02:40.235395 11689 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:02:40.247773  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.256850  8468 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:02:40.258849  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 59588.7us
I20260709 13:02:40.262741 11535 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:40.268689  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.266336  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:40.272585  8540 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:40.254665 11674 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.274744 11561 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:40.275272 11673 consensus_queue.cc:1243] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:40.275768  8358 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:40.278563  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:40.278949  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:40.286988  8465 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.279309  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:40.280040  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.280277  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.281208  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:40.289320  8467 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.296846  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.322013  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:40.324839  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:40.324725  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:40.326001  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:40.325289  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:40.327250  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:40.328186  8541 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:40.328524  8540 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:40.328986  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:40.328859  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:40.325287  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:40.333926  8395 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:40.334220  8393 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:40.338169  8393 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:40.339182  8465 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:40.340754  8389 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:40.341310  8541 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:40.343221  8389 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.343775  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:40.345768  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:40.347163  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:40.347915  8537 raft_consensus.cc:2393] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:02:40.350613  8543 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:40.352272  8391 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:40.353189  8542 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:40.329948 11673 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:40.356346  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:40.360728  8540 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:40.372313 11580 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:02:40.390076  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:40.419727  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.426113  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.374002 11518 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:40.373973 11655 consensus_queue.cc:1059] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:02:40.429828  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 56770.3us
I20260709 13:02:40.443197  8391 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:40.444350  8393 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:40.444844  8393 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:40.445896 11535 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.445729  8393 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.446410 11535 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.447309  8393 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.448634 11535 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:40.410414 11694 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:40.454486 11673 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:40.462352  8393 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:40.476096  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:40.477290  8467 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:40.458356 11580 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:40.464798 11677 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:40.492290 11523 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:40.492761 11523 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:40.486625 11702 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:40.462711 11655 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:02:40.495636 11697 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:40.452145 11708 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:02:40.498062 11518 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:40.499100 11518 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:40.499450 11518 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:40.500317 11518 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.486434 11580 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:40.503700 11580 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.505016 11580 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:40.490315 11699 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:02:40.490475 11707 consensus_queue.cc:1059] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:02:40.498402 11708 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:40.517728  8389 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:40.501694 11518 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:40.524268  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 98269.3us
I20260709 13:02:40.516734 11707 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:40.528115  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:40.523715 11506 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:02:40.543226  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.546765  8466 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:40.551232 11541 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.551473 11655 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:40.522858 11673 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.493587 11523 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.557695  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:40.558504  8467 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:02:40.539497 11711 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:40.569700 11711 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:40.529397 11707 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:40.598466 11707 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:40.600397 11553 consensus_meta.cc:287] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.003s
I20260709 13:02:40.600878 11553 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.570644 11711 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:40.620405  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 77215.7us
I20260709 13:02:40.623167  8359 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:40.622547  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 106019us
I20260709 13:02:40.627277  8537 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:40.626678  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.676834  8544 raft_consensus.cc:2368] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10.
W20260709 13:02:40.677584  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 201578us
I20260709 13:02:40.678943  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:40.619719 11711 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:40.681248  8542 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:40.681759  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 55166.4us
I20260709 13:02:40.682595  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.620368 11637 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:02:40.685127  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.685494 11637 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.686281  8537 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:40.687587 11637 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:40.625684 11703 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:40.684736  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54252.3us
I20260709 13:02:40.690852  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:40.692814  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 67442.2us
I20260709 13:02:40.693620  8359 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:40.697129  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.684660 11674 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:40.755110  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.692126 11693 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:40.706609 11703 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:40.786067 11719 log.cc:927] Time spent T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:02:40.769496  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 85004us
I20260709 13:02:40.761970 11674 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:40.689025 11708 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:40.778751  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 87373.1us
W20260709 13:02:40.778625  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 85072.9us
I20260709 13:02:40.820410  8359 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.824827  8389 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:02:40.829571  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.832903  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.834425  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:40.836686  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:40.836896  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 143509us
I20260709 13:02:40.851222  8390 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:40.796165 11718 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:40.840293 11709 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:40.837083 11693 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:40.861238  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 168899us
I20260709 13:02:40.864661 11708 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:40.864954 11727 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:40.866216 11726 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.866710 11726 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.829484 11674 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:02:40.868813 11726 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:40.832755 11580 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:02:40.848489 11553 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:40.871728 11725 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.878377  8543 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:40.889047 11709 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:40.898630  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58772.4us
I20260709 13:02:40.897126 11716 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.912427 11716 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:40.930778  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 1347) took 1025 ms. Trace:
I20260709 13:02:40.931227  8544 rpcz_store.cc:276] 0709 13:02:39.905825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.906804 (+   979us) service_pool.cc:224] Handling call
0709 13:02:40.919076 (+1012272us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400079254. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:02:40.930709 (+ 11633us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658135936}
I20260709 13:02:40.941779  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:40.945510 11716 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:40.946712  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 110150us
I20260709 13:02:40.947880  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:40.949728  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:40.950564 11736 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:40.959534  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:40.981839 11708 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.987144 11580 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:40.970377 11736 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:40.971994 11723 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:02:40.990399 11721 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.002s
I20260709 13:02:40.962978 11732 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:02:40.946240 11530 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:40.962181 11718 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:40.989401 11637 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:41.035324  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 72619.5us
I20260709 13:02:41.036207  8389 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:41.039912  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:41.037349  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 203007us
I20260709 13:02:41.040572  8390 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:02:41.041076  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.042238  8359 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.042354  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:41.045740  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:41.031486 11637 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.046453  8394 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.997515 11708 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:41.047864 11733 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:41.050482  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.048909 11655 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.048413 11637 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.053941  8395 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.055799  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:41.049044  8359 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:41.058296  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 61664.1us
I20260709 13:02:41.076435  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:41.083266  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:41.088807  8536 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:41.072546  8395 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:41.059041  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.095477  8395 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:41.098876  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:41.100903  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:41.109342  8358 leader_election.cc:400] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10.
I20260709 13:02:41.109905  8358 leader_election.cc:403] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:41.059600 11725 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:41.119343  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:02:41.119387  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 60439us
I20260709 13:02:41.120076  8461 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.121058  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.062767 11707 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.123770 11637 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:41.118512 11704 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:41.066861 11523 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.127949  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.131983  8394 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:41.134141 11731 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:02:41.138355 11714 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.136044 11637 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:41.140638  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.141193  8461 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:41.141438 11714 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:41.142988  8359 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.144109 11714 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.145916  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.146920  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:41.151746 11714 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.152156 11708 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:41.107237 11711 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:02:41.130733 11677 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.149536 11741 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10.
I20260709 13:02:41.137467 11506 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:41.167008  8536 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:41.169678  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:41.171864  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:41.155566  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.177027 11723 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:41.177444 11730 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:02:41.180874 11654 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:41.190305 11506 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:41.218127  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 66751.7us
I20260709 13:02:41.219362  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.245476  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:41.290691  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45346.6us
I20260709 13:02:41.292363  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.298925  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.304253  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.305239  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.295038 11654 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:41.291167 11714 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:41.323961  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.300711 11652 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.348758  8467 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:41.352805  8464 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:41.322444 11655 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.325054 11733 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.359905  8466 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:41.336766 11711 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:41.357919 11736 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:41.394383 11736 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:41.395085 11749 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:02:41.356345 11673 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:41.403548  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:41.442302  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49026.1us
I20260709 13:02:41.393507 11711 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:41.441270 11707 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:41.447670 11677 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:41.458461 11736 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:41.446830 11655 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:02:41.461755 11708 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:02:41.495556 11747 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:02:41.459018 11707 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:41.498624  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54633us
I20260709 13:02:41.508369 11652 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:41.509060 11754 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:41.515866 11652 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:41.518373 11707 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:41.508630 11752 log.cc:927] Time spent T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:02:41.508560 11751 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:02:41.505493 11708 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:41.552557  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 378053us
I20260709 13:02:41.553333  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:41.544925 11708 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:41.575882 11726 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:41.573552 11711 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:41.588297  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:41.590447  8386 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.590866  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:41.592960  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:41.592157  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:02:41.606668  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 300844us
I20260709 13:02:41.611945  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:41.612578  8463 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.617126  8469 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:02:41.617461  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:41.609644  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:41.620357  8540 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:41.618971  8469 pending_rounds.cc:85] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 6
I20260709 13:02:41.622560  8469 pending_rounds.cc:107] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:02:41.616257  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:41.622855  8469 raft_consensus.cc:2889] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:41.641912 11718 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:02:41.642532 11718 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:41.644582 11718 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:41.648958  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:41.651786  8394 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:41.656242  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.657557 11613 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.660298  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.662029 11722 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:41.665023  8508 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.669413  8386 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:41.647848 11726 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:41.680222 11553 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:41.687729 11715 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:02:41.709391 11732 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:41.711524 11726 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:41.717118  8507 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:41.720351 11535 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:41.720857 11535 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:41.721671 11535 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:41.727890  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 81330.8us
I20260709 13:02:41.750895  8467 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:02:41.751196  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:41.751716  8467 pending_rounds.cc:85] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 4
I20260709 13:02:41.752259  8467 pending_rounds.cc:107] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:41.753314  8467 raft_consensus.cc:2889] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:41.758668  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:41.763871  8463 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:41.764075  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:41.766106  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 119148us
I20260709 13:02:41.767590  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3476b7ee17e048f38396353721fa682f"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:41.773636  8536 raft_consensus.cc:606] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.778798  8536 raft_consensus.cc:614] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:41.792735  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:41.798460 11518 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:41.816427  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 50634.5us
I20260709 13:02:41.821156 11580 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:41.824687 11518 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.843792 11518 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:41.855463 11518 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:41.892228  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 107111us
I20260709 13:02:41.897436 11722 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.899963 11722 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:41.906420 11722 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:41.913476  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6595c51b9ae043699167a92b109f328e"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:41.914098  8538 raft_consensus.cc:606] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:41.915068  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:41.916283  8469 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:41.934244  8290 catalog_manager.cc:5697] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.937765  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:41.938496  8392 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:02:41.950706  8507 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:41.951498  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:41.952126  8538 raft_consensus.cc:606] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:41.952510  8538 raft_consensus.cc:614] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:41.971762  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 179092us
I20260709 13:02:41.975564  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:41.959733 11535 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:41.979794 11535 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.994037 11535 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.985610 11780 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.007102 11535 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.012763  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:42.013621 11707 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.014086  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:42.017104 11741 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:42.018507 11707 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:42.018942 11707 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:42.019335 11707 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.021060  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:42.021847  8392 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.025972 11535 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:42.047231  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:42.047256  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:42.048267  8538 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:42.061241  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:42.061961  8536 raft_consensus.cc:606] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:42.067651  8392 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:42.071231  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:42.071941  8461 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.091559  8461 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:42.098264  8507 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:42.099949  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:42.104518 11781 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.109093 11527 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:42.114984 11527 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:42.106544 11607 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.117879 11607 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.120009 11607 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:42.120784 11527 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:42.127872  8288 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50744 (request call id 159) took 13567 ms (client timeout 15000 ms). Trace:
I20260709 13:02:42.128759  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:42.129755  8469 raft_consensus.cc:2410] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:42.132445  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:42.133116  8393 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:02:42.134618  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:42.135222  8536 raft_consensus.cc:606] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:02:42.128310  8288 rpcz_store.cc:269] 0709 13:02:28.560350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.560514 (+   164us) service_pool.cc:224] Handling call
0709 13:02:42.127787 (+13567273us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:40.226920 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:40.261511 (+ 34591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:40.261549 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:02:40.261570 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:40.264178 (+  2608us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:40.264259 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:40.264290 (+    31us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:02:40.506117 (+241827us) tablet.cc:701] Row locks acquired
0709 13:02:40.506148 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:02:40.506304 (+   156us) write_op.cc:270] Start()
0709 13:02:40.506446 (+   142us) write_op.cc:276] Timestamp: P: 1783602160506263 usec, L: 0
0709 13:02:40.506485 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:02:40.507279 (+   794us) log.cc:844] Serialized 13229 byte log entry
0709 13:02:41.118673 (+611394us) op_driver.cc:464] REPLICATION: finished
0709 13:02:41.336552 (+217879us) write_op.cc:301] APPLY: starting
0709 13:02:41.340637 (+  4085us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:41.505671 (+165034us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:41.525953 (+ 20282us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:41.545883 (+ 19930us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:41.546299 (+   416us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=34
0709 13:02:41.546348 (+    49us) write_op.cc:312] APPLY: finished
0709 13:02:41.546886 (+   538us) log.cc:844] Serialized 223 byte log entry
0709 13:02:41.547074 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:41.547346 (+   272us) write_op.cc:454] Released schema lock
0709 13:02:41.550671 (+  3325us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:41.551084 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:41.551114 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44485,"reported_tablets":57,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":183487,"apply.run_cpu_time_us":7346,"apply.run_wall_time_us":225537,"num_ops":34,"prepare.queue_time_us":127796,"prepare.run_cpu_time_us":18926,"prepare.run_wall_time_us":404481,"raft.queue_time_us":198336,"raft.run_cpu_time_us":25764,"raft.run_wall_time_us":146573,"replication_time_us":612035,"thread_start_us":513040,"threads_started":5,"wal-append.queue_time_us":368227}]]}
I20260709 13:02:42.153867  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:42.155623  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:42.156968  8507 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:42.102183 11707 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.183241  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet 7219cc411cf6498f8f250f689007874f with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:47224
I20260709 13:02:42.167469 11561 raft_consensus.cc:476] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:42.168052 11583 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.199417 11736 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:02:42.204625 11736 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.193743 11583 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.207428  8389 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:42.207336 11583 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.209007  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:42.233747 11780 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.245318  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:42.247495  8541 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:42.239152 11707 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:42.262444  8389 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:42.264000  8433 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:42.264951 11708 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:42.265466 11708 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:42.266479 11708 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.236815 11716 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:02:42.248597 11780 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.284838  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:42.286461  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:42.287461  8389 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:02:42.289296  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:42.291816 11707 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.292282 11707 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.292659 11707 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.283823 11780 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:42.322248  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 168291us
I20260709 13:02:42.339206  8469 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:42.345853 11717 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.351508 11736 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:42.362151 11767 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:42.362875 11767 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:42.346503 11717 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.365690 11717 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:42.367906 11767 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:42.373045  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:42.379550 11707 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.376989 11583 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.384302 11583 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:42.385545  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:42.386534  8541 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:42.386842  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:42.387454  8390 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.391348  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:42.393414  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:42.394088  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:42.394913 11561 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.395753  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:42.259296  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet 7219cc411cf6498f8f250f689007874f (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
W20260709 13:02:42.407096  8278 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 147821us
I20260709 13:02:42.406348 11707 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:42.408452  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 34) took 7494 ms. Trace:
I20260709 13:02:42.418475  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:02:42.419255  8393 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:02:42.419904  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:42.423485  8390 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:02:42.426102  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:42.442209  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:42.443198  8540 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:02:42.408849  8290 rpcz_store.cc:276] 0709 13:02:34.914028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.926893 (+ 12865us) service_pool.cc:224] Handling call
0709 13:02:42.408370 (+7481477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:42.010490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:42.011106 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:42.011146 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:02:42.011165 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:42.011544 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:42.011602 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:42.011637 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:42.011820 (+   183us) tablet.cc:701] Row locks acquired
0709 13:02:42.011839 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:42.011971 (+   132us) write_op.cc:270] Start()
0709 13:02:42.012094 (+   123us) write_op.cc:276] Timestamp: P: 1783602162011933 usec, L: 0
0709 13:02:42.012117 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:42.012896 (+   779us) log.cc:844] Serialized 532 byte log entry
0709 13:02:42.113488 (+100592us) op_driver.cc:464] REPLICATION: finished
0709 13:02:42.165988 (+ 52500us) write_op.cc:301] APPLY: starting
0709 13:02:42.166115 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:42.166268 (+   153us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:42.166430 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:42.166737 (+   307us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:42.166968 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:42.167033 (+    65us) write_op.cc:312] APPLY: finished
0709 13:02:42.215152 (+ 48119us) log.cc:844] Serialized 22 byte log entry
0709 13:02:42.234591 (+ 19439us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:42.237944 (+  3353us) write_op.cc:454] Released schema lock
0709 13:02:42.245627 (+  7683us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:42.255705 (+ 10078us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:42.255746 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4645,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":52121,"apply.run_cpu_time_us":2525,"apply.run_wall_time_us":88633,"num_ops":1,"prepare.queue_time_us":68449,"prepare.run_cpu_time_us":2783,"prepare.run_wall_time_us":5987,"replication_time_us":92623,"spinlock_wait_cycles":3328,"thread_start_us":85721,"threads_started":2}]]}
I20260709 13:02:42.435977  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:42.448678 11783 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.456794  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:42.459496  8507 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:42.461241 11553 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.461656 11553 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.462630 11553 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.471676 11518 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:42.472419 11518 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:42.462226 11701 raft_consensus.cc:993] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:42.474148 11701 raft_consensus.cc:1081] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:42.487622  8462 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:42.489202  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:42.489884 11518 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.491807 11553 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.502112 11553 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:42.503816  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 50251.2us
W20260709 13:02:42.620775  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 168716us
I20260709 13:02:42.634647 11701 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:42.656430  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:42.673749 11583 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.692003  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:42.707373  8541 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:42.705755  8289 catalog_manager.cc:5697] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index 4 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 7 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:42.721709  8289 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 7, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:42.725734  8289 catalog_manager.cc:5697] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:42.728416  8289 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 11, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:42.678123 11530 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:02:42.778103  8289 catalog_manager.cc:5697] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 8 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.843217  8289 catalog_manager.cc:5697] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 3 to 5, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 5 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:42.873179  8469 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:42.718851 11783 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
W20260709 13:02:42.923228  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 296946us
I20260709 13:02:42.926692  8390 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:42.932760  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:42.933580  8393 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:42.934072  8393 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.935549  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:42.936369  8392 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.961911  8393 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:42.965731  8389 raft_consensus.cc:1240] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:42.969524  8392 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
W20260709 13:02:42.987658 11799 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:43.016604  8393 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:43.027508  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 56076.7us
I20260709 13:02:43.037683  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:43.042246  8540 raft_consensus.cc:3055] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:43.042588  8540 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:43.043421  8540 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:43.044853  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 94178.3us
I20260709 13:02:43.045393  8540 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:43.061924  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.064971  8540 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:43.134843 11527 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:43.148890 11740 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:43.149397 11740 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:43.150355 11740 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.117060 11808 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:02:43.157670 11706 raft_consensus.cc:993] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:43.158221 11706 raft_consensus.cc:1081] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
W20260709 13:02:43.163853  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 107648us
W20260709 13:02:43.194676  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 120926us
W20260709 13:02:43.195981  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 132500us
I20260709 13:02:43.197499  8358 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:43.199958  8543 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:43.201696  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.203485  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:43.208284  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:43.208923  8470 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:43.223049  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 107647us
I20260709 13:02:43.224282  8389 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:43.206158 11541 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:43.256685  8507 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:43.257524 11727 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:43.258054 11727 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:43.265514  8462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:43.266358  8462 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:43.266853  8462 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:43.269420 11727 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.269763 11706 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:02:43.232321 11806 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:02:43.282155  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 61999.6us
I20260709 13:02:43.263589 11541 raft_consensus.cc:697] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:43.310182  8388 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:43.327530 11736 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:02:43.349500  8389 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:43.368289  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 43770.6us
W20260709 13:02:43.392972  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 90913.7us
I20260709 13:02:43.375150 11541 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.442188  8470 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:43.443064  8461 raft_consensus.cc:1240] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:43.441462  8462 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.457029  8462 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:43.457667  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.464203 11607 raft_consensus.cc:993] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:43.464771 11607 raft_consensus.cc:1081] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:43.483707  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:43.484380  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:43.484380  8389 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:43.485024  8541 raft_consensus.cc:3055] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:43.485322  8541 raft_consensus.cc:740] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:43.486016  8541 consensus_queue.cc:260] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.487036  8541 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:43.487349 11740 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.491750  8389 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:43.528276  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:43.533285  8541 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:43.542004 11807 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:43.576321  8390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6595c51b9ae043699167a92b109f328e"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:43.576931  8390 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:43.577334  8390 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.587966  8390 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.585588 11807 raft_consensus.cc:697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:43.639072 11807 consensus_queue.cc:237] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.649220  8390 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:43.650104  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:43.650719  8467 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.687268  8467 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:43.688776  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:43.694665 11829 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:43.695214 11829 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:43.696094 11829 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.701181  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:43.714267  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:43.715005  8538 raft_consensus.cc:3055] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:43.715376  8538 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:43.716266  8538 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:43.717595  8538 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.748307  8389 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:43.766505  8538 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:43.786785 11637 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:43.863840  8390 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:43.916622  8290 catalog_manager.cc:5697] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.918366  8290 catalog_manager.cc:5697] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 8 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 10 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.920214  8463 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:02:43.920751  8463 pending_rounds.cc:85] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 7
I20260709 13:02:43.920990  8463 pending_rounds.cc:107] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:02:43.921229  8463 raft_consensus.cc:2889] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:43.922765  8290 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 5 to 7, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:43.924119 11742 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:43.944501  8467 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:43.948856 11829 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:02:43.993084  8538 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:43.998190 11814 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:44.031162  8390 raft_consensus.cc:1275] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:44.032836 11807 consensus_queue.cc:1048] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:44.050534  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:44.051152  8543 raft_consensus.cc:606] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:44.059015 11742 raft_consensus.cc:993] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:44.059487 11742 raft_consensus.cc:1081] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:44.062490  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 35) took 1580 ms. Trace:
I20260709 13:02:44.065716  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:44.066387  8543 raft_consensus.cc:606] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:44.066745  8543 raft_consensus.cc:614] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:44.063099  8290 rpcz_store.cc:276] 0709 13:02:42.486739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.486928 (+   189us) service_pool.cc:224] Handling call
0709 13:02:44.062367 (+1575439us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:43.961190 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:43.992556 (+ 31366us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:43.992603 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:02:43.992626 (+    23us) tablet.cc:662] Decoding operations
0709 13:02:43.993261 (+   635us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:43.993331 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:43.993365 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:43.993756 (+   391us) tablet.cc:701] Row locks acquired
0709 13:02:43.993779 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:02:43.993972 (+   193us) write_op.cc:270] Start()
0709 13:02:43.994099 (+   127us) write_op.cc:276] Timestamp: P: 1783602163993919 usec, L: 0
0709 13:02:43.994116 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:02:43.994775 (+   659us) log.cc:844] Serialized 1288 byte log entry
0709 13:02:43.996531 (+  1756us) op_driver.cc:464] REPLICATION: finished
0709 13:02:43.996971 (+   440us) write_op.cc:301] APPLY: starting
0709 13:02:43.997050 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:43.997192 (+   142us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:43.997298 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:43.997708 (+   410us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:43.997931 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:02:43.997985 (+    54us) write_op.cc:312] APPLY: finished
0709 13:02:43.998201 (+   216us) log.cc:844] Serialized 34 byte log entry
0709 13:02:43.998362 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:43.998459 (+    97us) write_op.cc:454] Released schema lock
0709 13:02:43.998505 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:43.998875 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:43.998906 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65588,"reported_tablets":4,"spinlock_wait_cycles":5120,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":1857,"apply.run_wall_time_us":1856,"num_ops":3,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":3436,"prepare.run_wall_time_us":37095,"replication_time_us":2277}]]}
I20260709 13:02:44.079126  8463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:44.079958  8463 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:44.080467  8463 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:44.119233  8544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:44.119902  8544 raft_consensus.cc:606] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:44.120266  8544 raft_consensus.cc:614] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:44.124574  8463 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:44.141832  8463 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:44.142464  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:44.143101  8393 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:44.142987  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:44.143687  8544 raft_consensus.cc:3055] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:44.144004  8544 raft_consensus.cc:740] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:44.151316  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:44.151861  8543 raft_consensus.cc:606] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:44.154708  8393 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:44.155242  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50742 (request call id 138) took 8833 ms. Trace:
I20260709 13:02:44.149492  8544 consensus_queue.cc:260] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:44.155988  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:44.156543  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet 7219cc411cf6498f8f250f689007874f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:47224
I20260709 13:02:44.157015 11824 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:44.157534 11824 raft_consensus.cc:697] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:44.158388 11824 consensus_queue.cc:237] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:44.146031  8376 tablet_service.cc:1558] Processing DeleteTablet for tablet 6becd976429a45a3874a10895b19b63e with delete_type TABLET_DATA_TOMBSTONED (TS 2122d8c723e84e3da22f81f7eeb4b1a9 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34302
I20260709 13:02:44.171108  8544 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:44.172717  8536 raft_consensus.cc:1275] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:44.180197  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:44.180971  8536 raft_consensus.cc:606] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:44.181380  8536 raft_consensus.cc:614] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:44.189519  8544 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:44.192381  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:44.194456  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:44.155625  8289 rpcz_store.cc:276] 0709 13:02:35.320939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.321253 (+   314us) service_pool.cc:224] Handling call
0709 13:02:44.154272 (+8833019us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:43.273221 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:43.380844 (+107623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:43.391722 (+ 10878us) write_op.cc:435] Acquired schema lock
0709 13:02:43.394358 (+  2636us) tablet.cc:662] Decoding operations
0709 13:02:43.463883 (+ 69525us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:43.463964 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:43.464009 (+    45us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:43.464789 (+   780us) tablet.cc:701] Row locks acquired
0709 13:02:43.464817 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:02:43.465000 (+   183us) write_op.cc:270] Start()
0709 13:02:43.465155 (+   155us) write_op.cc:276] Timestamp: P: 1783602163464942 usec, L: 0
0709 13:02:43.465196 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:02:43.467458 (+  2262us) log.cc:844] Serialized 2458 byte log entry
0709 13:02:43.705117 (+237659us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b54001608d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e2e28 00007fbe16f1d581 00007fbe16f1cd58 00007fbe16f219f1 00007fbe16f219a9 00007fbe16f21939 00007fbe16f21901 00007fbe16f20b2d 000000000038f354 000000000038f199
0709 13:02:43.760863 (+ 55746us) op_driver.cc:464] REPLICATION: finished
0709 13:02:43.892420 (+131557us) write_op.cc:301] APPLY: starting
0709 13:02:43.892507 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:43.892672 (+   165us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:43.892693 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:43.893398 (+   705us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:43.893584 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:02:43.893628 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:43.893871 (+   243us) log.cc:844] Serialized 52 byte log entry
0709 13:02:43.894049 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:43.894154 (+   105us) write_op.cc:454] Released schema lock
0709 13:02:43.894195 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:43.898605 (+  4410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:43.898641 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1465,"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":111756,"apply.run_cpu_time_us":2169,"apply.run_wall_time_us":6144,"num_ops":6,"prepare.queue_time_us":266473,"prepare.run_cpu_time_us":13437,"prepare.run_wall_time_us":442513,"raft.queue_time_us":60052,"raft.run_cpu_time_us":25478,"raft.run_wall_time_us":148209,"replication_time_us":284072,"spinlock_wait_cycles":3579648,"thread_start_us":413179,"threads_started":4,"wal-append.queue_time_us":174422}]]}
I20260709 13:02:44.189150 11707 consensus_queue.cc:1048] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:02:44.197119  8292 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.208151  8470 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:44.204319  8292 catalog_manager.cc:5697] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 5 to 7, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.215263 11803 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:44.230195  8536 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:44.233937  8292 catalog_manager.cc:5697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 12, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.236305  8292 catalog_manager.cc:5697] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 6 to 10, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 10 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.238436  8292 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.243889 11803 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:44.249167  8292 catalog_manager.cc:5697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 7 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:44.260890 11854 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:44.279425  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet 7219cc411cf6498f8f250f689007874f (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:44.285005 11561 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:02:44.285624 11561 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:44.288543 11561 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:44.289206  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:44.292459 11858 tablet_replica.cc:333] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:02:44.292363  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:44.295228  8359 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:44.295967  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:44.298171 11561 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:44.305969 11858 raft_consensus.cc:2243] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.306972 11858 raft_consensus.cc:2272] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.312249 11858 ts_tablet_manager.cc:1916] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:44.347506 11858 ts_tablet_manager.cc:1929] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:02:44.348057 11858 log.cc:1199] T 6becd976429a45a3874a10895b19b63e P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/wals/6becd976429a45a3874a10895b19b63e
I20260709 13:02:44.350025  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet 6becd976429a45a3874a10895b19b63e (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:44.384642  8288 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.389984  8288 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 11, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.393775  8288 catalog_manager.cc:5697] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.403596  8288 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 9 to 10, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 10 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.410357 11637 raft_consensus.cc:993] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:44.411031 11831 raft_consensus.cc:1081] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:44.413424  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:44.414083  8393 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:44.414446  8393 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.422245  8288 catalog_manager.cc:5697] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.429410  8288 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 11, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 11 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.427222  8393 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:44.460609  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:44.461251  8470 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.487726  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:44.488467  8544 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:44.488791  8544 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:44.490110  8544 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:44.514927  8544 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.535216  8470 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:44.540167  8359 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:44.541226 11561 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:44.541899 11561 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:44.542874 11561 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:44.538725  8393 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:44.577169  8288 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.580277  8288 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 9 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.592535  8544 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:44.594815  8376 tablet_service.cc:1558] Processing DeleteTablet for tablet 13811dee93af4290bdcf7d73b527d0f4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:34302
I20260709 13:02:44.595852  8381 tablet_service.cc:1558] Processing DeleteTablet for tablet 6becd976429a45a3874a10895b19b63e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:34302
I20260709 13:02:44.581890  8288 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 10 to 11, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.599324  8292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 160) took 9070 ms. Trace:
I20260709 13:02:44.599505  8288 catalog_manager.cc:5697] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 9 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.611953  8288 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 6 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.619149  8544 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:44.620955 11824 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:44.601254  8292 rpcz_store.cc:276] 0709 13:02:35.529390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.529623 (+   233us) service_pool.cc:224] Handling call
0709 13:02:35.804994 (+275371us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b54001608d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13451090 00007fbe134eff3a 00007fbe192a61cc 00007fbe193a437e 00007fbe178652a4 00007fbe17865232 00007fbe17865161 00007fbe178650dc 00007fbe17864392 00007fbe1182248c 00007fbe118218c6
0709 13:02:44.599269 (+8794275us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:44.318092 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:44.318700 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:44.318739 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:02:44.318765 (+    26us) tablet.cc:662] Decoding operations
0709 13:02:44.319597 (+   832us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:44.319657 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:44.319685 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:44.320247 (+   562us) tablet.cc:701] Row locks acquired
0709 13:02:44.320268 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:44.320454 (+   186us) write_op.cc:270] Start()
0709 13:02:44.320569 (+   115us) write_op.cc:276] Timestamp: P: 1783602164320404 usec, L: 0
0709 13:02:44.320596 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:02:44.321290 (+   694us) log.cc:844] Serialized 2463 byte log entry
0709 13:02:44.323593 (+  2303us) op_driver.cc:464] REPLICATION: finished
0709 13:02:44.324260 (+   667us) write_op.cc:301] APPLY: starting
0709 13:02:44.324350 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:44.324637 (+   287us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:44.324726 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:44.331272 (+  6546us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:44.331454 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:02:44.331497 (+    43us) write_op.cc:312] APPLY: finished
0709 13:02:44.331725 (+   228us) log.cc:844] Serialized 52 byte log entry
0709 13:02:44.332951 (+  1226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:44.333533 (+   582us) write_op.cc:454] Released schema lock
0709 13:02:44.333566 (+    33us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:44.334003 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:44.334033 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":58,"spinlock_wait_cycles":10307328,"child_traces":[["op",{"apply.queue_time_us":274,"apply.run_cpu_time_us":5318,"apply.run_wall_time_us":9648,"num_ops":6,"prepare.queue_time_us":6448,"prepare.run_cpu_time_us":3532,"prepare.run_wall_time_us":7137,"replication_time_us":2876}]]}
I20260709 13:02:44.637683  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet 13811dee93af4290bdcf7d73b527d0f4 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:44.614073  8288 catalog_manager.cc:5697] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.638530  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet 6becd976429a45a3874a10895b19b63e (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:44.641230  8288 catalog_manager.cc:5697] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 10 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.642910  8288 catalog_manager.cc:5697] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.644519  8288 catalog_manager.cc:5697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 10 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.646266  8288 catalog_manager.cc:5697] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 6 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.647661  8288 catalog_manager.cc:5697] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 8 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 10 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.649097  8288 catalog_manager.cc:5697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 9 to 11, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 11 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.651808  8288 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.654307  8288 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.664131  8389 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:44.667502 11824 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:02:44.764901  8289 catalog_manager.cc:5697] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 6, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 6 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.767902  8289 catalog_manager.cc:5697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 6, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 6 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.783185  8289 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.785820  8289 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 7 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:02:44.788259  8289 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 8 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.939066  8292 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.950309  8470 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:44.952118 11803 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:44.967605  8538 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:44.970567 11827 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:45.195953  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:45.290019  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 85971.4us
W20260709 13:02:45.317544  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 125640us
I20260709 13:02:45.591171  8389 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:02:45.622618  8360 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6de9f8d6e504e40b0a5e555abe5c0c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.625133  8467 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:45.630524 11876 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:45.621605  8544 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:45.663170 11876 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:45.667490 11871 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Committing config change with OpId 12.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:45.672852  8461 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Committing config change with OpId 12.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:45.698232  8292 catalog_manager.cc:5697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.718798  8541 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Committing config change with OpId 12.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:45.729156  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:45.789831  8544 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:02:45.858770  8509 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b79a5acddc004781bbeac307ae4e58d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.871232  8461 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:45.877758  8389 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:45.886703 11706 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:45.889071 11706 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:45.924360 11583 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:45.966979  8389 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:45.972930  8541 consensus_queue.cc:237] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:45.984429  8288 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.007982  8392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:46.008832  8392 raft_consensus.cc:606] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:46.012971  8544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:46.013571  8544 raft_consensus.cc:606] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:46.017002  8544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:46.017855  8544 raft_consensus.cc:606] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:46.020606  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:46.021196  8543 raft_consensus.cc:606] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:46.024263  8392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:46.024828  8392 raft_consensus.cc:606] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:46.026820  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:46.028617  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:46.052178  8461 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:46.060647 11706 raft_consensus.cc:993] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.073483 11706 raft_consensus.cc:1081] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.075968  8463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:46.076599  8463 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.076956  8463 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.062189 11637 raft_consensus.cc:993] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.091802 11870 raft_consensus.cc:1081] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.093993  8467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:46.094578  8467 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.094906  8467 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:46.102547  8509 consensus_peers.cc:597] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdd8533706064dd78b4e61de0beb5255. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.105031  8468 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:46.107060 11742 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:46.111512  8390 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:46.121619  8463 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.124585  8463 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:46.126118  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:46.126936  8394 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.129464 11583 raft_consensus.cc:993] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.130127 11583 raft_consensus.cc:1081] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.128201  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:46.131608  8541 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:46.132046  8541 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:46.133095  8541 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.134730  8541 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.137358  8470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:46.139031  8470 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.139518  8470 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.143527  8467 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.149926  8394 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:46.151655 11742 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:46.156790  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:46.160152  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:46.161691  8544 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:46.163220  8544 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:46.164402  8544 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.152053  8467 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:46.167852  8544 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.160341 11892 ts_tablet_manager.cc:933] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:02:46.169842  8389 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.168653  8462 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:46.184227  8433 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:46.165577 11742 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:46.185281 11873 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:46.202948  8389 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:46.212307  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:46.212975 11876 raft_consensus.cc:993] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.213490 11876 raft_consensus.cc:1081] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.195015 11892 tablet_copy_client.cc:323] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
I20260709 13:02:46.221293  8541 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:46.222150  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet c6de9f8d6e504e40b0a5e555abe5c0c0 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
I20260709 13:02:46.222877  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet c6de9f8d6e504e40b0a5e555abe5c0c0 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-c6de9f8d6e504e40b0a5e555abe5c0c0
I20260709 13:02:46.223181  8544 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:46.226263  8470 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.220417 11873 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:46.238739 11873 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.245019  8470 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:46.262247  8405 tablet_copy_source_session.cc:215] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:46.270310  8394 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:02:46.276106  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 63893.2us
I20260709 13:02:46.278654 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6de9f8d6e504e40b0a5e555abe5c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.283216  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:46.283911  8389 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.291502  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:46.292426  8536 raft_consensus.cc:3055] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:46.292812  8536 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:46.298942  8461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:02:46.300621  8461 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.300994  8461 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.294287  8536 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.313175  8536 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.320492  8461 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.323661 11896 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:46.324328 11896 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:46.325341 11896 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.326890  8289 catalog_manager.cc:5697] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 5, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.331558  8394 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:46.327373  8536 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:46.335053  8461 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:46.341359  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:46.342073  8390 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:46.342327  8390 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:46.342989  8390 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.344071  8390 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.346531  8389 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:46.351261  8390 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:46.353010  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:46.353619  8544 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.366983  8544 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:46.370536  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:46.382193 11897 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.382371  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:46.382794 11897 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:46.383216 11873 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:46.383788 11873 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:46.383687 11897 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.384914 11873 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.420869 11561 raft_consensus.cc:993] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.421432 11561 raft_consensus.cc:1081] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:46.427089  8462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:02:46.428731  8462 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.429231  8462 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.458212  8288 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 11, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.464411 11892 tablet_copy_client.cc:806] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:46.470242 11892 tablet_copy_client.cc:670] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:46.474399  8536 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:46.476935 11876 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:46.478459  8360 consensus_peers.cc:597] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6595c51b9ae043699167a92b109f328e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.478986  8462 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.481087  8462 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:46.481573  8465 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:46.484582 11903 ts_tablet_manager.cc:933] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:46.484412 11561 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:46.484448  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:46.486675  8541 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.488842  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:46.489394  8394 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:46.489666  8394 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:46.503928  8541 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:46.503736  8394 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.487521 11892 tablet_copy_client.cc:538] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:46.511077  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:46.517022 11873 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.519081 11873 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:46.536499  8394 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.569437 11892 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:46.558826 11873 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:46.609248  8394 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
W20260709 13:02:46.611464  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 100478us
W20260709 13:02:46.670254  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45099.6us
I20260709 13:02:46.683291 11876 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:02:46.676173 11905 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.116s	user 0.004s	sys 0.000s
I20260709 13:02:46.675299 11903 tablet_copy_client.cc:323] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:02:46.723827  8554 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet b79a5acddc004781bbeac307ae4e58d1 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:02:46.724305  8554 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet b79a5acddc004781bbeac307ae4e58d1 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-b79a5acddc004781bbeac307ae4e58d1
I20260709 13:02:46.731729  8289 catalog_manager.cc:5697] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 11, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.733860  8289 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.742359 11919 ts_tablet_manager.cc:933] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:46.749104  8289 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 8 to 9, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:46.751250  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 67484.1us
I20260709 13:02:46.752897  8465 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:46.751300  8289 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.764667  8544 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:46.766845 11900 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:46.752811  8554 tablet_copy_source_session.cc:215] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:46.782847 11919 tablet_copy_client.cc:323] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:02:46.786257  8553 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet fdd8533706064dd78b4e61de0beb5255 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:02:46.786917  8553 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet fdd8533706064dd78b4e61de0beb5255 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-fdd8533706064dd78b4e61de0beb5255
I20260709 13:02:46.793502 11903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79a5acddc004781bbeac307ae4e58d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.805962 11892 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.807058 11892 tablet_bootstrap.cc:492] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:46.807860 11892 ts_tablet_manager.cc:1403] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.239s	user 0.035s	sys 0.030s
I20260709 13:02:46.817046  8393 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:46.822705  8536 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:46.832947 11911 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:46.835934  8553 tablet_copy_source_session.cc:215] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:46.850520 11900 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:46.859225 11919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd8533706064dd78b4e61de0beb5255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.862628  8392 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:46.875116  8288 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:46.883785 11873 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:46.885689 11892 raft_consensus.cc:359] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:46.886718 11892 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:46.887605 11892 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:02:46.897050  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 44037.4us
I20260709 13:02:46.907879 11903 tablet_copy_client.cc:806] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:46.908552 11903 tablet_copy_client.cc:670] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:46.911019 11892 ts_tablet_manager.cc:1434] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 13:02:46.910051  8541 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:46.915926  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-c6de9f8d6e504e40b0a5e555abe5c0c0 received from {username='slave'} at 127.0.0.1:60598
I20260709 13:02:46.916433  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-c6de9f8d6e504e40b0a5e555abe5c0c0 on tablet c6de9f8d6e504e40b0a5e555abe5c0c0 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:46.951355  9067 raft_consensus.cc:1217] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.5->[12.6-12.6]   Dedup: 12.6->[]
I20260709 13:02:46.951910 11903 tablet_copy_client.cc:538] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:47.014951 11919 tablet_copy_client.cc:806] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:47.016419  8394 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:47.016659 11919 tablet_copy_client.cc:670] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:47.026965 11903 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:47.027915 11900 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:47.029551  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:47.035218  8544 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:47.044173  8392 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:47.048776  8538 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:47.070675 11919 tablet_copy_client.cc:538] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:02:47.062258  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 74606.5us
W20260709 13:02:47.064433  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 98235.5us
I20260709 13:02:47.092643 11896 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:47.099790 11900 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:47.102124 11873 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:47.105482 11919 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:47.175823 11892 ts_tablet_manager.cc:933] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:02:47.256979 11892 tablet_copy_client.cc:323] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
I20260709 13:02:47.258944  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet 6595c51b9ae043699167a92b109f328e from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
W20260709 13:02:47.307430  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46334us
I20260709 13:02:47.309942  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet 6595c51b9ae043699167a92b109f328e from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-6595c51b9ae043699167a92b109f328e
W20260709 13:02:47.325985 11925 log.cc:927] Time spent T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:47.367040  8390 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:47.379285 11933 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:47.380735  8405 tablet_copy_source_session.cc:215] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:47.389384 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595c51b9ae043699167a92b109f328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.508313  8543 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:47.561203  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 49142.4us
I20260709 13:02:47.564477  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:47.580235  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 48417.7us
I20260709 13:02:47.652920 11892 tablet_copy_client.cc:806] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:47.653734 11892 tablet_copy_client.cc:670] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:47.654647 11911 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:47.697985  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 138366us
I20260709 13:02:47.700814 11918 raft_consensus.cc:1064] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:47.704581 11918 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 4, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:47.761554 11892 tablet_copy_client.cc:538] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:47.844091 11892 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:47.828491 11919 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:47.840716 11903 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:47.870440 11919 tablet_bootstrap.cc:492] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:47.870838  8463 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:47.871310  9067 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:47.872002 11903 tablet_bootstrap.cc:492] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:47.872828 11903 ts_tablet_manager.cc:1403] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.846s	user 0.040s	sys 0.040s
I20260709 13:02:47.873052  8543 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:47.873694 11953 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:47.880398 11876 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:47.871359 11919 ts_tablet_manager.cc:1403] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.766s	user 0.033s	sys 0.014s
I20260709 13:02:47.885186 11915 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:47.927659 11903 raft_consensus.cc:359] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:47.934422  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:47.935120  8536 raft_consensus.cc:606] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:47.931052 11903 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:47.943552 11903 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:47.951669 11903 ts_tablet_manager.cc:1434] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.004s
I20260709 13:02:47.957046  8553 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-b79a5acddc004781bbeac307ae4e58d1 received from {username='slave'} at 127.0.0.1:56998
I20260709 13:02:47.957587  8553 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-b79a5acddc004781bbeac307ae4e58d1 on tablet b79a5acddc004781bbeac307ae4e58d1 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:47.963567  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:47.964232  8536 raft_consensus.cc:606] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:47.966826 11919 raft_consensus.cc:359] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:47.967778 11919 raft_consensus.cc:740] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:47.968484 11919 consensus_queue.cc:260] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:47.971077  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:47.971310 11919 ts_tablet_manager.cc:1434] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 13:02:47.972067  8536 raft_consensus.cc:606] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:48.012318  8553 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-fdd8533706064dd78b4e61de0beb5255 received from {username='slave'} at 127.0.0.1:56998
I20260709 13:02:48.012822  8553 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-fdd8533706064dd78b4e61de0beb5255 on tablet fdd8533706064dd78b4e61de0beb5255 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:48.017445  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:48.018133  8543 raft_consensus.cc:606] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:48.029063  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:48.029731  8543 raft_consensus.cc:606] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:48.038493 11931 raft_consensus.cc:993] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:48.040321 11931 raft_consensus.cc:1081] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:48.041276  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:47.994212 11876 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Committing config change with OpId 12.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:48.043541  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:48.000559  8462 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:48.006419 11956 log.cc:927] Time spent T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:48.054085  8463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:48.054838  8463 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.055262  8463 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.080412  9067 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:48.096038  8463 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.083745 11892 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:48.141613 11892 tablet_bootstrap.cc:492] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:48.142437 11892 ts_tablet_manager.cc:1403] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.299s	user 0.030s	sys 0.006s
I20260709 13:02:48.114977  8292 catalog_manager.cc:5697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:48.150345 11892 raft_consensus.cc:359] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:48.151293 11892 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:48.149996  8543 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:48.158919  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:48.159571  8393 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.160398 11892 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:48.162766 11892 ts_tablet_manager.cc:1434] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:02:48.163358  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:48.163929  8536 raft_consensus.cc:3055] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:48.164193  8536 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:48.158354  8463 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:48.166486  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-6595c51b9ae043699167a92b109f328e received from {username='slave'} at 127.0.0.1:60598
I20260709 13:02:48.166929  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-6595c51b9ae043699167a92b109f328e on tablet 6595c51b9ae043699167a92b109f328e with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:48.167347  9067 raft_consensus.cc:1217] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:02:48.168154  8536 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.170532  8536 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:48.178149  8393 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:48.192652  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:48.193459 11900 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:48.194046 11900 raft_consensus.cc:697] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:48.194940 11900 consensus_queue.cc:237] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.222239  8536 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:02:48.276348 11945 raft_consensus.cc:993] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:48.276908 11870 raft_consensus.cc:1081] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:48.334070  8461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:48.334733  8461 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.343813  9067 raft_consensus.cc:1217] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 13:02:48.347455  8461 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.348721 11945 raft_consensus.cc:993] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:48.349295 11945 raft_consensus.cc:1081] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:48.352746 11870 raft_consensus.cc:993] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:48.353286 11931 raft_consensus.cc:1081] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:48.355636  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:48.356178  8393 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.359556  8393 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.362092  8461 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.370085  8388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:48.370741  8388 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.371093  8388 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.408371  8393 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.429574  8461 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:48.432729  9067 raft_consensus.cc:1217] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:02:48.435376  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:48.436084  8390 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.442137  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:48.445761  8462 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.450587  8390 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:48.463495  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:48.464944  8393 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:48.462515  8388 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.472936  8462 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:48.474355  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:48.475087  8543 raft_consensus.cc:3055] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:48.475452  8543 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:48.474965  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:48.476343  8463 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.477205  8388 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:48.478652  8543 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.471659 11911 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:48.491140 11911 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:48.492251 11911 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.511907  8463 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:48.513748  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:48.521390  8536 raft_consensus.cc:3055] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:48.521754  8536 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:48.523129  8543 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.526270  8359 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:48.530339 11953 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:48.530882 11953 raft_consensus.cc:697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:48.531829 11953 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.535218  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:48.537077 11917 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:48.537624 11917 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:48.539022 11931 raft_consensus.cc:993] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:48.539606 11945 raft_consensus.cc:1081] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:48.539852  8543 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:48.525882  8388 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:48.545142  8462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:48.545778  8462 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.528450  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:48.546862  8535 raft_consensus.cc:3055] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:48.547631  8462 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.547991  8536 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.547204  8535 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:48.554344  8535 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.555951  8535 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.538957 11917 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.577343  8536 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.584910  8462 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.588487  9064 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:48.595027 11915 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:48.596228  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:48.596915  8393 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.598625  8470 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:48.602918 11915 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:48.608119  8393 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:48.609447 11918 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index 7 to 8, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:48.616123  8536 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:48.619504  8470 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:48.615706  8462 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:48.626017  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:48.611088  9064 raft_consensus.cc:2955] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:48.649255 11967 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:48.650063 11967 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:48.650408  8535 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:48.651507 11967 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.666641  8289 catalog_manager.cc:5697] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 4 to 5, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 5 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.668460  8289 catalog_manager.cc:5697] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.678059  8290 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 7 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.685240  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6de9f8d6e504e40b0a5e555abe5c0c0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:48.687412  8290 catalog_manager.cc:5697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.717166  8288 catalog_manager.cc:5697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 7 to 8, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:48.744248  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:48.746313  8538 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:48.746668  8538 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:48.747493  8538 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:48.748771  8538 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.750737  8290 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 11, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.754465  8531 tablet_service.cc:1558] Processing DeleteTablet for tablet c6de9f8d6e504e40b0a5e555abe5c0c0 with delete_type TABLET_DATA_TOMBSTONED (TS c45599d1dc3b4823b857cf77f276dc7b not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:49310
I20260709 13:02:48.759809  8388 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:48.761902 11967 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:48.772790 11969 raft_consensus.cc:1064] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:48.776567 11969 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:48.794015  8538 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:48.797993  8536 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:48.801115 11900 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:48.810160 11977 tablet_replica.cc:333] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:02:48.811630 11977 raft_consensus.cc:2243] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:48.816577 11977 raft_consensus.cc:2272] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:48.834767 11977 ts_tablet_manager.cc:1916] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:48.836228  9064 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:48.839309 11945 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:48.847440  8393 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:48.850469  8462 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:48.859193 11944 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:02:48.865417 11945 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:48.873308 11917 raft_consensus.cc:1064] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:48.899714 11977 ts_tablet_manager.cc:1929] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.7
I20260709 13:02:48.900465 11977 log.cc:1199] T c6de9f8d6e504e40b0a5e555abe5c0c0 P c45599d1dc3b4823b857cf77f276dc7b: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/wals/c6de9f8d6e504e40b0a5e555abe5c0c0
I20260709 13:02:48.902403  8277 catalog_manager.cc:5028] TS c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): tablet c6de9f8d6e504e40b0a5e555abe5c0c0 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:48.915096 11917 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:48.981446  8538 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:48.983861  9064 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:48.986060 11915 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:48.990226  8462 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:48.994976  8462 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:48.993497 11918 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:02:49.005734  8388 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.010697  8462 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.009943 11915 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:02:49.006335 11931 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.018193 11918 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:02:49.055428  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:49.129908  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 105791us
I20260709 13:02:49.133134  8535 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:02:49.139382  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 72593.6us
W20260709 13:02:49.143819  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 57378.7us
I20260709 13:02:49.158914  8535 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:49.166509 11992 raft_consensus.cc:1064] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:49.183342 11953 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:49.187084  9067 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.169492 11992 consensus_queue.cc:237] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 3, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:49.183447  8288 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.230427  8468 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:49.250245  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 86784us
I20260709 13:02:49.275764  8388 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:49.276707 11953 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.281702  8538 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:49.285584 11917 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:49.286921  8386 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:49.303154 11999 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:49.319463  8462 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:49.321942 11969 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:49.332003 11999 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:49.333233  8543 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:49.337193  9067 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:49.339691  9067 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:49.355700 11999 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:49.373019 11965 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:49.380887  8535 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:49.387401  9067 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.388994  8462 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.462520  8393 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:49.470898  8290 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.528573  8393 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:49.527406 11944 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:02:49.527251 11970 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:02:49.570356 11998 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.584807  9067 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.619767 11953 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:49.624053  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45828us
I20260709 13:02:49.675472  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b79a5acddc004781bbeac307ae4e58d1 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:02:49.660301  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 73242.5us
I20260709 13:02:49.689755 11995 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:49.695402  8290 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 10 to 11, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.714507  8394 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:49.722246  9067 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:49.725147 11953 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:49.730194 11970 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:49.734951  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 190136us
I20260709 13:02:49.747776 11993 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.755996  9067 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.755489  8386 raft_consensus.cc:2955] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.797578  8289 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 8 to 9, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.806167  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet b79a5acddc004781bbeac307ae4e58d1 with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:47224
W20260709 13:02:49.895323  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 100714us
I20260709 13:02:49.895785  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:49.904417  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 99557.6us
I20260709 13:02:49.919662 11970 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.935650  8531 tablet_service.cc:1558] Processing DeleteTablet for tablet 6595c51b9ae043699167a92b109f328e with delete_type TABLET_DATA_TOMBSTONED (TS c45599d1dc3b4823b857cf77f276dc7b not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:49310
I20260709 13:02:49.938017  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6595c51b9ae043699167a92b109f328e with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:49.947283  8390 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:49.968190  8465 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:02:49.981657  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 65245us
I20260709 13:02:50.020915 12025 tablet_replica.cc:333] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:02:50.022203 12025 raft_consensus.cc:2243] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.023167 12025 raft_consensus.cc:2272] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.028553  8538 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:50.039463 11953 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:50.055047  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.060357 12025 ts_tablet_manager.cc:1916] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:50.027231  8463 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:50.120253  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 59193.4us
I20260709 13:02:50.131264  8288 catalog_manager.cc:5697] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.140779  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "448878eafac247d592f6889cb1e26a56"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:50.141428  8536 raft_consensus.cc:606] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:50.157153  8461 raft_consensus.cc:2955] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:50.166456  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:50.167129  8535 raft_consensus.cc:606] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:50.235432 12026 tablet_replica.cc:333] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:02:50.274438  9067 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:50.321938  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 44905.9us
I20260709 13:02:50.336568 12026 raft_consensus.cc:2243] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.344929 12026 raft_consensus.cc:2272] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:50.418884  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 51051.8us
I20260709 13:02:50.424670  8538 consensus_queue.cc:237] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:50.443877 12026 ts_tablet_manager.cc:1916] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:50.446872  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 63588us
I20260709 13:02:50.456044 12025 ts_tablet_manager.cc:1929] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:02:50.456633 12025 log.cc:1199] T b79a5acddc004781bbeac307ae4e58d1 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/wals/b79a5acddc004781bbeac307ae4e58d1
I20260709 13:02:50.500747  9067 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:50.502771 11970 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.507462  8468 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:50.497628 12020 raft_consensus.cc:993] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:50.514546 12020 raft_consensus.cc:1081] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:50.517729 11995 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.523332  9067 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:50.527840  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet b79a5acddc004781bbeac307ae4e58d1 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:50.519454 12020 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:50.545485  8392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "448878eafac247d592f6889cb1e26a56"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:50.540189  8461 raft_consensus.cc:2955] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:50.546175  8392 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:50.546598  8392 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.572927  8392 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.583236  8290 catalog_manager.cc:5697] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 6 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:50.593384  8468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:48738
I20260709 13:02:50.594147  8468 raft_consensus.cc:606] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:50.599046  8392 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:50.600147  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:50.601099  8538 raft_consensus.cc:3055] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:50.601483  8538 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:50.604357  8538 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.607230  8538 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.612558 12026 ts_tablet_manager.cc:1929] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:02:50.613266 12026 log.cc:1199] T 6595c51b9ae043699167a92b109f328e P c45599d1dc3b4823b857cf77f276dc7b: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/wals/6595c51b9ae043699167a92b109f328e
I20260709 13:02:50.618072  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:50.619169  8465 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.619875  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fdd8533706064dd78b4e61de0beb5255 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:50.631865  8277 catalog_manager.cc:5028] TS c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): tablet 6595c51b9ae043699167a92b109f328e (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:50.638346 11995 raft_consensus.cc:993] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:50.638949 11995 raft_consensus.cc:1081] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:50.642241  8391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:50.642954  8391 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:50.643391  8391 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.675974  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c257a516245f4698b8937b228b23d23a"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:50.676643  8543 raft_consensus.cc:606] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:50.679680  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:50.680322  8394 raft_consensus.cc:606] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:50.682648 11970 raft_consensus.cc:993] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:50.683154 11970 raft_consensus.cc:1081] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:50.683777  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ded976982870447482c4b84286e6340b"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:50.684430  8542 raft_consensus.cc:606] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:50.685859  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:50.686067  8465 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:50.688720  8394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c257a516245f4698b8937b228b23d23a"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:50.690456  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:50.689576  8394 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:50.705930  8394 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:50.708352  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:50.710304 11997 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:50.703722  8538 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:02:50.704631  8391 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.713856 11997 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:50.716046 11997 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.719759  8391 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:50.724915  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:50.725553  8538 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:50.725878  8538 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:50.726770  8538 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.727900  8538 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.735018  8538 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:02:50.738416  8358 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:50.742473 11996 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:50.746524  8394 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.749886  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:50.754318  8468 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.754889 12013 raft_consensus.cc:993] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: : Instructing follower c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:50.743185 11996 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:50.759279  8394 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:50.759611  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:50.761397 12013 raft_consensus.cc:1081] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Signalling peer c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:50.763302  8465 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:50.762413  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:50.764667  8538 raft_consensus.cc:3055] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:50.765101  8538 raft_consensus.cc:740] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:50.767979 11996 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.773654  8543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:49334
I20260709 13:02:50.774326  8543 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:50.774698  8543 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.775444  8538 consensus_queue.cc:260] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.776553  8538 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:50.783385  8468 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:02:50.787358  8543 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.790640  8543 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:50.791481  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:50.792102  8392 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.794294  8538 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:50.795653  8358 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:50.797025  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:50.797722 12036 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:50.799149  8381 tablet_service.cc:1558] Processing DeleteTablet for tablet fdd8533706064dd78b4e61de0beb5255 with delete_type TABLET_DATA_TOMBSTONED (TS 2122d8c723e84e3da22f81f7eeb4b1a9 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34302
I20260709 13:02:50.801069  8292 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 7 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.805289  8465 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:02:50.808514  8468 raft_consensus.cc:3055] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:50.811978  8468 raft_consensus.cc:740] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:50.812623  8468 consensus_queue.cc:260] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.819422  8468 raft_consensus.cc:3060] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.829885  8468 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:02:50.838599  8508 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:50.839857 11870 raft_consensus.cc:2804] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:50.840440 11870 raft_consensus.cc:697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:50.818600 12036 raft_consensus.cc:697] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:50.847575 12036 consensus_queue.cc:237] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.859683  8392 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:02:50.841452 11870 consensus_queue.cc:237] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:50.877626 12041 tablet_replica.cc:333] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:02:50.890079 12041 raft_consensus.cc:2243] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.916356 12041 raft_consensus.cc:2272] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.932675 11877 raft_consensus.cc:993] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:50.933229 11877 raft_consensus.cc:1081] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:50.936821  8468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:02:50.937465  8468 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:50.937894  8468 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.929667  8292 catalog_manager.cc:5697] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 11 to 12, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.942752  8288 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 11 to 12, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.946035  8288 catalog_manager.cc:5697] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 5 to 6, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 6 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.956465  8468 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:50.967304  8468 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:50.968426  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:50.969414  8394 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:50.969696  8394 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:50.970481  8394 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:50.971639  8394 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.977550  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:50.978235  9067 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.985357  8394 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:02:50.985560  9067 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:02:50.988721  8433 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:50.989566 12017 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:50.990139 12017 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:50.990842 12041 ts_tablet_manager.cc:1916] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:50.990907 12017 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:51.025358 12041 ts_tablet_manager.cc:1929] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260709 13:02:51.025941 12041 log.cc:1199] T fdd8533706064dd78b4e61de0beb5255 P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/wals/fdd8533706064dd78b4e61de0beb5255
I20260709 13:02:51.027750  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet fdd8533706064dd78b4e61de0beb5255 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:51.056008  8288 catalog_manager.cc:5697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 12 to 13, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 13 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.130185 12027 raft_consensus.cc:993] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:51.130718 12027 raft_consensus.cc:1081] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:51.132882  8468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ded976982870447482c4b84286e6340b"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:02:51.133528  8468 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.133922  8468 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.142277  8468 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:51.145437  8468 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:51.148209  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:51.148895  8538 raft_consensus.cc:3055] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:51.149211  8538 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:51.150007  8538 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:51.151245  8538 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.155679  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:51.156468  8392 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.175885  8392 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:51.176968  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:51.177878 11900 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:51.178437 11900 raft_consensus.cc:697] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:51.179486 11900 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:51.185379  8538 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:02:51.215683  8288 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.223757  8538 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:51.225668 12044 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:51.241333  8468 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:51.243294 11993 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:51.271688  8538 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:51.273346 11993 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:51.307156  8465 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:51.310539 11996 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:51.335103  8465 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:51.341971 11944 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:51.349045  8392 raft_consensus.cc:1275] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:51.353114 12020 consensus_queue.cc:1048] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:51.411113  8536 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:51.419890  9067 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:51.420869 12036 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:51.436796 12013 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:51.446417  8465 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:51.458813 12057 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:51.529302  8392 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:51.561165 12013 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:02:51.568928  8392 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:51.589293 12037 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:51.706342  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:51.733829  8538 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:51.747094 12037 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:52.107744  8463 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:02:52.122979  8435 consensus_peers.cc:597] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58f1670d75c14f7588691908d7b2f1cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.128410  8392 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:52.130544 12067 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:52.135882  8538 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:52.142778 12037 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:52.177318 12067 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.192831  8535 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.211663  8391 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.250061  8465 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:52.256208  8288 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:02:52.289084  8435 consensus_peers.cc:597] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a8845af07904ef3b3861c0999f3cd1b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.290663  8535 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:52.292285  8391 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:52.294193 12067 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:52.300495 12037 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:52.319324 11900 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.331996  8535 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.338155  8392 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.381098  8535 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:52.418437  8289 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.479928  8392 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:52.483778 12061 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:52.565932  8468 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:02:52.571784  8509 consensus_peers.cc:597] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2321e967e3f4695a2563f5d8dacc658. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.579504 12020 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:52.623862 12020 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.634641  8394 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.658705 12090 ts_tablet_manager.cc:933] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:52.659871  8463 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:02:52.666175  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 47983.7us
I20260709 13:02:52.671361  8292 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.679158  8468 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:52.702685 12090 tablet_copy_client.cc:323] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.194:32851
I20260709 13:02:52.705648  8480 tablet_copy_service.cc:140] P d2a645dcec4c479ba4c94d075b1bc98c: Received BeginTabletCopySession request for tablet 58f1670d75c14f7588691908d7b2f1cf from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:48784)
I20260709 13:02:52.706362  8480 tablet_copy_service.cc:161] P d2a645dcec4c479ba4c94d075b1bc98c: Beginning new tablet copy session on tablet 58f1670d75c14f7588691908d7b2f1cf from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:48784: session id = 92314b14f5554885a80c3dc87f4beed4-58f1670d75c14f7588691908d7b2f1cf
I20260709 13:02:52.739277  8480 tablet_copy_source_session.cc:215] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:52.742772 12090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f1670d75c14f7588691908d7b2f1cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:52.765472  8435 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ded976982870447482c4b84286e6340b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.769307  8538 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:52.771214  8394 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:52.773192 12017 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:52.774539 12089 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:52.801635 12017 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.803680  8394 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.844929  8292 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.858335  8543 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:52.845017 12090 tablet_copy_client.cc:806] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:52.866397 12090 tablet_copy_client.cc:670] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:52.877446 12090 tablet_copy_client.cc:538] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:52.893759 12097 ts_tablet_manager.cc:933] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:52.902220 12097 tablet_copy_client.cc:323] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:02:52.904510  8553 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet d2321e967e3f4695a2563f5d8dacc658 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:02:52.905107  8553 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet d2321e967e3f4695a2563f5d8dacc658 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-d2321e967e3f4695a2563f5d8dacc658
I20260709 13:02:52.912176 12099 ts_tablet_manager.cc:933] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:52.921684  8553 tablet_copy_source_session.cc:215] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:52.922943  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:52.944517 12097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2321e967e3f4695a2563f5d8dacc658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:52.925710 12099 tablet_copy_client.cc:323] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.194:32851
I20260709 13:02:52.962889  8480 tablet_copy_service.cc:140] P d2a645dcec4c479ba4c94d075b1bc98c: Received BeginTabletCopySession request for tablet 9a8845af07904ef3b3861c0999f3cd1b from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:48784)
I20260709 13:02:52.963492  8480 tablet_copy_service.cc:161] P d2a645dcec4c479ba4c94d075b1bc98c: Beginning new tablet copy session on tablet 9a8845af07904ef3b3861c0999f3cd1b from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:48784: session id = 92314b14f5554885a80c3dc87f4beed4-9a8845af07904ef3b3861c0999f3cd1b
I20260709 13:02:52.971668 12090 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:52.993533  8480 tablet_copy_source_session.cc:215] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.002993 12099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8845af07904ef3b3861c0999f3cd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.029938 12097 tablet_copy_client.cc:806] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.032886 12097 tablet_copy_client.cc:670] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.052392 12099 tablet_copy_client.cc:806] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.053133 12099 tablet_copy_client.cc:670] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.053289 12097 tablet_copy_client.cc:538] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.060626 12099 tablet_copy_client.cc:538] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.147773 12099 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
W20260709 13:02:53.166669  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 76532.6us
I20260709 13:02:53.187009 12090 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:53.188066 12090 tablet_bootstrap.cc:492] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:53.190419 12090 ts_tablet_manager.cc:1403] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.219s	user 0.046s	sys 0.004s
I20260709 13:02:53.198228 12090 raft_consensus.cc:359] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:53.199120 12090 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:53.199819 12090 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:53.219686  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:53.220314  8538 raft_consensus.cc:606] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:53.235409  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:53.236037  8394 raft_consensus.cc:606] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:02:53.260732  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 45694.8us
I20260709 13:02:53.277635 12097 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:53.311707  8465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:48738
I20260709 13:02:53.312418  8465 raft_consensus.cc:606] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:53.282193 12090 ts_tablet_manager.cc:1434] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.091s	user 0.004s	sys 0.004s
I20260709 13:02:53.315101  8480 tablet_copy_service.cc:342] P d2a645dcec4c479ba4c94d075b1bc98c: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-58f1670d75c14f7588691908d7b2f1cf received from {username='slave'} at 127.0.0.1:48784
I20260709 13:02:53.315560  8480 tablet_copy_service.cc:434] P d2a645dcec4c479ba4c94d075b1bc98c: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-58f1670d75c14f7588691908d7b2f1cf on tablet 58f1670d75c14f7588691908d7b2f1cf with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:53.327524 12090 ts_tablet_manager.cc:933] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:53.352802 12090 tablet_copy_client.cc:323] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.194:32851
I20260709 13:02:53.355197  8480 tablet_copy_service.cc:140] P d2a645dcec4c479ba4c94d075b1bc98c: Received BeginTabletCopySession request for tablet ded976982870447482c4b84286e6340b from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:48784)
I20260709 13:02:53.355515  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:53.355854  8480 tablet_copy_service.cc:161] P d2a645dcec4c479ba4c94d075b1bc98c: Beginning new tablet copy session on tablet ded976982870447482c4b84286e6340b from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:48784: session id = 92314b14f5554885a80c3dc87f4beed4-ded976982870447482c4b84286e6340b
I20260709 13:02:53.356259  8394 raft_consensus.cc:606] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:53.359016 12084 raft_consensus.cc:993] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:53.359668 12084 raft_consensus.cc:1081] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:53.370889  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:53.371542  8535 raft_consensus.cc:606] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:53.372365 12085 raft_consensus.cc:993] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:53.372874 12085 raft_consensus.cc:1081] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Signalling peer c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:53.373068  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:53.374262  8465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:02:53.374806  8465 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:53.374948  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:53.375174  8465 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.379383  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:02:53.380052  8535 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:53.380427  8535 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.384173  8465 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:53.391052  8465 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:53.389349  8535 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:53.401854  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:02:53.402518  9067 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.406662  8480 tablet_copy_source_session.cc:215] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.406749  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:53.415482  8394 raft_consensus.cc:3055] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:53.415803  8394 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:53.410187  9067 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:53.400856  8535 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:02:53.414407  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51130.7us
I20260709 13:02:53.417124  9064 raft_consensus.cc:1240] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:53.422211  8394 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:53.423233  8394 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.423683  8509 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:53.428278 12020 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:53.428844 12020 raft_consensus.cc:697] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:53.429733 12020 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:53.430189  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:53.433835  8393 raft_consensus.cc:3055] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:53.434243  8393 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:53.435132  8393 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:53.436412  8393 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.442811  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:53.443429  8535 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.449139 12090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded976982870447482c4b84286e6340b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.452782  8535 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:53.470245  8394 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:02:53.479095  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:53.480057 12037 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:53.480532 12037 raft_consensus.cc:697] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:53.481406 12037 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:53.491747  8393 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:53.526711  8292 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 7 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:53.529927  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 105292us
I20260709 13:02:53.548574 12099 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:02:53.589725  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 82561.1us
I20260709 13:02:53.590862 12099 tablet_bootstrap.cc:492] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:53.637434 12099 ts_tablet_manager.cc:1403] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.551s	user 0.042s	sys 0.008s
I20260709 13:02:53.639885  8289 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.669457  9067 raft_consensus.cc:1217] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.6->[11.7-11.7]   Dedup: 11.7->[]
W20260709 13:02:53.679139  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 91856.1us
I20260709 13:02:53.657226 12117 raft_consensus.cc:993] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: : Instructing follower c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:53.673197 12099 raft_consensus.cc:359] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:53.682955 12117 raft_consensus.cc:1081] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Signalling peer c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:53.693778 12090 tablet_copy_client.cc:806] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.698982 12090 tablet_copy_client.cc:670] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.703332 12090 tablet_copy_client.cc:538] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.709724  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:49334
I20260709 13:02:53.710378  8535 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:53.710747  8535 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.715914 12090 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:53.716511 12099 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:53.724249  8535 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:02:53.727506  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 140442us
I20260709 13:02:53.729490  8535 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:02:53.728587  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 58972.3us
I20260709 13:02:53.730985  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:53.731685  8470 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:53.732066  8470 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:53.733099  8470 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:53.734855  8470 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.744319  8470 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:02:53.748761  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:53.749593 12087 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:53.750157 12087 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:53.751060 12087 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:53.742869 12099 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:53.766779 12099 ts_tablet_manager.cc:1434] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.126s	user 0.005s	sys 0.004s
I20260709 13:02:53.768525  8480 tablet_copy_service.cc:342] P d2a645dcec4c479ba4c94d075b1bc98c: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-9a8845af07904ef3b3861c0999f3cd1b received from {username='slave'} at 127.0.0.1:48784
I20260709 13:02:53.769012  8480 tablet_copy_service.cc:434] P d2a645dcec4c479ba4c94d075b1bc98c: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-9a8845af07904ef3b3861c0999f3cd1b on tablet 9a8845af07904ef3b3861c0999f3cd1b with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:53.798470  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:53.799105  8393 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.793215 12097 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:53.818586 12097 tablet_bootstrap.cc:492] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:53.817878 12119 raft_consensus.cc:993] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:53.819626 12097 ts_tablet_manager.cc:1403] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.542s	user 0.045s	sys 0.025s
I20260709 13:02:53.835084  8393 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:02:53.858250 12119 raft_consensus.cc:1081] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:53.920833 12027 raft_consensus.cc:993] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:53.921371 12027 raft_consensus.cc:1081] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:53.931659 12097 raft_consensus.cc:359] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:53.937849  9064 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:53.955403  8393 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:53.957551 12114 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:53.933889 12097 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:53.962569 12097 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:53.965327 12097 ts_tablet_manager.cc:1434] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.000s
I20260709 13:02:53.985692  8390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:53.986356  8390 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:53.986752  8390 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.989382  8394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:53.990222  8394 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:53.990625  8394 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.991793  8553 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-d2321e967e3f4695a2563f5d8dacc658 received from {username='slave'} at 127.0.0.1:56998
I20260709 13:02:53.992254  8553 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-d2321e967e3f4695a2563f5d8dacc658 on tablet d2321e967e3f4695a2563f5d8dacc658 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:53.990782  8289 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 11 to 12, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.007283  9064 raft_consensus.cc:1217] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:02:54.017331  8394 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:54.001084  8390 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:54.024111  8390 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:54.028945  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:54.030000  8465 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.036458  8394 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:54.049880  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:54.054143  8470 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.055325 12132 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:54.063894  8393 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:54.068110  8470 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:54.071731  8359 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:54.075121  8465 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:54.077119  8463 raft_consensus.cc:1240] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:54.081086  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:54.084005  8536 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:54.090521 12129 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:54.102805  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:54.103685  8538 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:54.104094  8538 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:54.104236  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:54.104895  8536 raft_consensus.cc:3055] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.105219  8536 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:54.109256  8536 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:54.111011  8536 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.082784 12118 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:54.119693 12118 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:54.120678 12118 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:54.128257 12117 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:02:54.111416 12120 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:54.105479  8538 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:54.147854  8538 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.150628 12120 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:54.151647 12120 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:54.156975 12092 raft_consensus.cc:1064] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:54.176000  8470 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:54.196658  8536 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:02:54.227434  8538 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
W20260709 13:02:54.231736  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 93011.4us
I20260709 13:02:54.196259 12125 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:02:54.249667 12092 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:54.351763  9067 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:54.355317  8390 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:54.363704 12061 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:54.373696 12102 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:54.376004  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:54.390269  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 147678us
W20260709 13:02:54.397320 12146 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:02:54.405105  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 77369.8us
I20260709 13:02:54.392544 12090 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.411652  8386 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:54.429126 12090 tablet_bootstrap.cc:492] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:54.429936  8543 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:54.473380 12090 ts_tablet_manager.cc:1403] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.758s	user 0.045s	sys 0.001s
I20260709 13:02:54.487465 12090 raft_consensus.cc:359] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:54.487233  8292 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.462206 12102 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:02:54.503269 12090 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:54.504660 12090 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:54.513890 12090 ts_tablet_manager.cc:1434] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:02:54.532789  8480 tablet_copy_service.cc:342] P d2a645dcec4c479ba4c94d075b1bc98c: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-ded976982870447482c4b84286e6340b received from {username='slave'} at 127.0.0.1:48784
I20260709 13:02:54.533257  8480 tablet_copy_service.cc:434] P d2a645dcec4c479ba4c94d075b1bc98c: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-ded976982870447482c4b84286e6340b on tablet ded976982870447482c4b84286e6340b with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:54.561961 12103 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:54.601716  9067 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Advancing to term 9
I20260709 13:02:54.640705 12037 raft_consensus.cc:1064] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:54.643643 12037 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:54.653631  8290 catalog_manager.cc:5697] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 9 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 10 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.677464  9064 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:54.678941 12102 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:54.683635  8394 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:54.682891 12102 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:54.686581  9067 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:54.690481 12118 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:54.702962  8388 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:54.707284 12117 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:54.707316  8535 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:54.767372 12113 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:54.770915  9066 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:54.794258  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 65358.2us
I20260709 13:02:54.833498  8465 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:54.842902  8465 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:54.864682  8542 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:54.868093  8290 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.872741 12120 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:54.876224 12120 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:54.940351  8538 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:54.940979 12147 raft_consensus.cc:1064] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:02:54.942549 12147 raft_consensus.cc:1068] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Unable to promote non-voter 92314b14f5554885a80c3dc87f4beed4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:02:54.984634 12117 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.000273  9065 raft_consensus.cc:1217] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:02:55.003130  8535 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.032152  8535 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.032518  8394 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.065112 12120 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:55.078528  9065 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.092586  8290 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:55.104218  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 49929.7us
W20260709 13:02:55.129423  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 78358.9us
W20260709 13:02:55.130285  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 65548.7us
I20260709 13:02:55.150628  8465 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:55.158077 12120 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:55.194657  9065 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:55.202783  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 46970.2us
I20260709 13:02:55.246752  8462 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:55.254184 12146 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.005s
W20260709 13:02:55.276746  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 76882.2us
W20260709 13:02:55.292869  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 96802.1us
I20260709 13:02:55.293167 12117 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:55.310453  8389 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:55.354765  8543 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:55.370141  9064 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:02:55.410887  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 103569us
W20260709 13:02:55.437374  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 124389us
I20260709 13:02:55.488767 12179 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:55.515110  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 60011.1us
W20260709 13:02:55.489917  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 71014.3us
W20260709 13:02:55.544629  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 229557us
I20260709 13:02:55.583709 12113 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:55.585073 12103 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.592139 12117 raft_consensus.cc:1064] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:55.595485 12117 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:02:55.597560  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 62036.9us
I20260709 13:02:55.601181 12139 raft_consensus.cc:1064] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:55.605755 12139 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:55.608215 12092 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:02:55.623210  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 371000us
I20260709 13:02:55.637691  9065 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.637656  9064 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.748085  8288 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 8 to 9, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:55.802825  9064 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:55.808355 12164 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:55.844653 12103 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:55.890661  9064 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEARNER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:55.894543 12103 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:02:55.917908  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.923909  8535 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:55.932679  8278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58f1670d75c14f7588691908d7b2f1cf with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:55.934026  8278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a8845af07904ef3b3861c0999f3cd1b with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:55.987916  8393 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:56.010370  8537 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:56.008888  8536 raft_consensus.cc:2955] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.019721 12139 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:56.022861 12092 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:56.036144  8393 raft_consensus.cc:2955] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.054324  8465 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:56.089214 12184 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 7 to 9, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.116367 12177 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:56.135318  8289 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index 10 to 11, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.137701  8536 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 7 to 9, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.145731 12103 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:56.163276  8381 tablet_service.cc:1558] Processing DeleteTablet for tablet 58f1670d75c14f7588691908d7b2f1cf with delete_type TABLET_DATA_TOMBSTONED (TS 2122d8c723e84e3da22f81f7eeb4b1a9 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:34302
I20260709 13:02:56.172700  9064 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 7 to 9, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.187178 12190 tablet_replica.cc:333] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:02:56.186839  8470 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 7 to 9, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.203176  8531 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a8845af07904ef3b3861c0999f3cd1b with delete_type TABLET_DATA_TOMBSTONED (TS c45599d1dc3b4823b857cf77f276dc7b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:49310
I20260709 13:02:56.205499 12139 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:02:56.206161 12139 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:56.215896  8292 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 7 to 9, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.217036  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:02:56.220278 12139 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:02:56.235756  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:02:56.238775 12191 tablet_replica.cc:333] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:02:56.246649  8358 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:56.262956 12176 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:56.271185 12190 raft_consensus.cc:2243] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.272287 12190 raft_consensus.cc:2272] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.273710  8386 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:56.316989  9064 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:56.319998 12191 raft_consensus.cc:2243] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.321175 12191 raft_consensus.cc:2272] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.326314 12184 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:56.329577  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 55020.2us
I20260709 13:02:56.336367 12191 ts_tablet_manager.cc:1916] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.338111  8536 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:56.337419 12184 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.353937 12179 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.366153  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:02:56.341708  9064 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.377106 12190 ts_tablet_manager.cc:1916] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.353969 12176 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:02:56.425019  8535 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.429262  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d2321e967e3f4695a2563f5d8dacc658 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.437739  8536 raft_consensus.cc:2955] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.444257  9064 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.453393  8393 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.456192  8290 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 9 to 10, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.473457  8386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "278b4d554f0647ff885c963daff7931d"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:56.474298  8386 raft_consensus.cc:606] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:56.498519 12191 ts_tablet_manager.cc:1929] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:02:56.499264 12191 log.cc:1199] T 9a8845af07904ef3b3861c0999f3cd1b P c45599d1dc3b4823b857cf77f276dc7b: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/wals/9a8845af07904ef3b3861c0999f3cd1b
I20260709 13:02:56.500602  8288 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.510473  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:56.511114  8535 raft_consensus.cc:606] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:56.509691  8277 catalog_manager.cc:5028] TS c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): tablet 9a8845af07904ef3b3861c0999f3cd1b (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:56.526181 12190 ts_tablet_manager.cc:1929] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:02:56.530658  8537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:56.535307  8537 raft_consensus.cc:606] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:56.543154 12190 log.cc:1199] T 58f1670d75c14f7588691908d7b2f1cf P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/wals/58f1670d75c14f7588691908d7b2f1cf
I20260709 13:02:56.545390  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet d2321e967e3f4695a2563f5d8dacc658 with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:47224
I20260709 13:02:56.545416  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet 58f1670d75c14f7588691908d7b2f1cf (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:56.551810  8468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:48738
I20260709 13:02:56.552469  8468 raft_consensus.cc:606] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:56.558202  8393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:56.558838  8393 raft_consensus.cc:606] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:56.560560  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:56.562290  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:56.567011  8468 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:56.576375  9064 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:56.577704  8393 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:56.580046 12179 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:56.582355 12176 raft_consensus.cc:993] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:56.582914 12176 raft_consensus.cc:1081] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Signalling peer c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:56.589488  8537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "278b4d554f0647ff885c963daff7931d"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:02:56.590147  8537 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:56.590480  8537 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.594769 12103 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.596125 12193 tablet_replica.cc:333] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:02:56.597461 12193 raft_consensus.cc:2243] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.598268  8537 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.601415  9064 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.614856 12193 raft_consensus.cc:2272] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.638494  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:56.639184  8393 raft_consensus.cc:3055] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:56.639505  8393 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:56.639810  8537 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:56.640358  8393 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.646248  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:56.645401  8393 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.646981  8470 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.652237  8288 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 8 to 9, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.663990  8393 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:56.665571  8531 tablet_service.cc:1558] Processing DeleteTablet for tablet ded976982870447482c4b84286e6340b with delete_type TABLET_DATA_TOMBSTONED (TS c45599d1dc3b4823b857cf77f276dc7b not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:49310
I20260709 13:02:56.666497 12193 ts_tablet_manager.cc:1916] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:56.666846 12191 tablet_replica.cc:333] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:02:56.667095  8507 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:56.668237 12191 raft_consensus.cc:2243] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.668329 12171 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:56.669385 12171 raft_consensus.cc:697] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:56.670639 12171 consensus_queue.cc:237] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.669554 12191 raft_consensus.cc:2272] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.679333  8278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ded976982870447482c4b84286e6340b with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:56.685626  8470 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:56.691659 12191 ts_tablet_manager.cc:1916] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:56.678474 12183 log.cc:927] Time spent T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.073s	user 0.003s	sys 0.004s
I20260709 13:02:56.684926 12103 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:02:56.723562 12087 raft_consensus.cc:993] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:56.724167 12087 raft_consensus.cc:1081] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:56.726293  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:56.726933  8393 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:56.727357  8393 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:56.731359  8386 raft_consensus.cc:2955] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:02:56.732136  8288 catalog_manager.cc:5697] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 10 to 11, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.740707  8393 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.753168 12193 ts_tablet_manager.cc:1929] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.9
I20260709 13:02:56.753705 12193 log.cc:1199] T d2321e967e3f4695a2563f5d8dacc658 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/wals/d2321e967e3f4695a2563f5d8dacc658
I20260709 13:02:56.759341 12191 ts_tablet_manager.cc:1929] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:02:56.759796 12191 log.cc:1199] T ded976982870447482c4b84286e6340b P c45599d1dc3b4823b857cf77f276dc7b: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/wals/ded976982870447482c4b84286e6340b
I20260709 13:02:56.765323 12117 raft_consensus.cc:993] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: : Instructing follower c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:56.765885 12117 raft_consensus.cc:1081] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Signalling peer c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:56.776952  8537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:49334
I20260709 13:02:56.777527  8537 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:56.777918  8537 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.757946  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet d2321e967e3f4695a2563f5d8dacc658 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:56.762348  8277 catalog_manager.cc:5028] TS c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): tablet ded976982870447482c4b84286e6340b (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:02:56.791527  8393 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:56.792295  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:56.792871  8535 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:56.793182  8535 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:56.793893  8535 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.795159  8535 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:56.809584  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:56.810279  8463 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:56.818137  8463 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:56.829671  8535 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:02:56.830941  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:56.832187 12176 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:56.829594  8537 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.832666 12176 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:56.838442 12176 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.845713  8537 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:56.847512  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:56.848176  8463 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:56.848066  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:56.848558  8463 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:56.848851  8393 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.849366  8463 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.850931  8463 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.855861  8393 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:56.863142  8463 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:56.870668  8507 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:56.871825 12119 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:56.872372 12119 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:56.873270 12119 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.881727  8292 catalog_manager.cc:5697] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 6 to 7, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.929320 12184 raft_consensus.cc:993] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:56.929870 12184 raft_consensus.cc:1081] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:56.933416  8465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:02:56.934058  8465 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:56.934419  8465 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:56.943411  8465 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.945106  8465 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:56.952612  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:56.953231  8386 raft_consensus.cc:3055] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:56.953528  8386 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:56.954383  8386 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:56.955807  8386 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:56.960570  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:56.961306  8537 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:56.961629 12171 raft_consensus.cc:993] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:56.962280 12171 raft_consensus.cc:1081] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:56.964361  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:56.964946  8393 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:56.965314  8393 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.974645  8292 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 10 to 11, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.999493  8537 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:57.001343  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:57.002677 12148 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:57.003230 12148 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:57.004187 12148 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:57.007586  8386 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:02:57.012915  8393 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:57.024891  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:57.025594  8468 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.039742  8468 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:02:57.043848  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:57.044497  8537 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:57.044817  8537 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:57.045493  8393 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:57.046226  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:57.049271  8537 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:57.050414 12184 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:57.051231  8537 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.052174 12184 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:57.053194 12184 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:57.049611  8292 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.059320  8537 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:02:57.108439  8292 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 12 to 13, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 13 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.142835  8386 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:57.144785 12061 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:57.214916  8465 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:57.222289 12171 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:57.233858  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67179us
W20260709 13:02:57.311203  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 52493.2us
I20260709 13:02:57.319540  8537 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:02:57.377171  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 59381.5us
I20260709 13:02:57.395918 12176 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:57.454273  8465 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:57.475952 12204 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:57.550496  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 45370.1us
I20260709 13:02:57.563519  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:57.586659  8393 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:57.586661  8463 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:57.589987 12207 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:57.604161  8393 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:57.609042  8468 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:57.611534 12207 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:57.615862 12092 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:57.621457 12087 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:57.635449  8537 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:57.659373  8537 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:57.688979 12211 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:57.699131 12179 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:57.843066  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 57387us
I20260709 13:02:57.968000  8393 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:57.988025  8535 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:57.990648  8360 consensus_peers.cc:597] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 936de44ff6404ac7b9d585ab45c933f9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:57.991819 12207 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:58.032662  8461 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:58.056627 12208 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.104795  8537 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:02:58.130978  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 93833.3us
I20260709 13:02:58.142448 12210 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:58.167775  8543 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:58.139896  8288 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.252956  8463 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:02:58.330322  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 90508.7us
I20260709 13:02:58.344879  8461 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:58.346933 12204 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:02:58.413583  8389 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:58.416661 12221 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:58.429466 12234 ts_tablet_manager.cc:933] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:02:58.489705 12234 tablet_copy_client.cc:323] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
I20260709 13:02:58.492782  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet 936de44ff6404ac7b9d585ab45c933f9 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
I20260709 13:02:58.493639  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet 936de44ff6404ac7b9d585ab45c933f9 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-936de44ff6404ac7b9d585ab45c933f9
I20260709 13:02:58.502334 12125 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.505643  8394 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.536734  8405 tablet_copy_source_session.cc:215] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:58.563513 12234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936de44ff6404ac7b9d585ab45c933f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:58.611732  8465 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.627378  8394 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:02:58.629407  8509 consensus_peers.cc:597] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fcda97cc34546609f91a249f74d8f85. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.673472 12234 tablet_copy_client.cc:806] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:58.690546 12234 tablet_copy_client.cc:670] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:58.696316 12234 tablet_copy_client.cc:538] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:58.665776  8289 catalog_manager.cc:5697] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index -1 to 5, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.719784 12234 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:58.749130  8543 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:58.750926  8462 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:58.752724 12211 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:58.755473  8360 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4e26f5f342c48648f0433b885576c00. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.762367 12211 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:58.785568 12205 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.811726  8462 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.821666  8537 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.847898  8292 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index -1 to 6, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:58.862402  8462 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:58.915051  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:58.922587 12234 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:58.923727 12234 tablet_bootstrap.cc:492] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:02:58.925123 12234 ts_tablet_manager.cc:1403] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.206s	user 0.030s	sys 0.008s
I20260709 13:02:58.933140 12234 raft_consensus.cc:359] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:58.934038 12234 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:02:58.934690 12234 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:02:58.947705 12234 ts_tablet_manager.cc:1434] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:02:58.955506  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-936de44ff6404ac7b9d585ab45c933f9 received from {username='slave'} at 127.0.0.1:60598
I20260709 13:02:58.956219  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-936de44ff6404ac7b9d585ab45c933f9 on tablet 936de44ff6404ac7b9d585ab45c933f9 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:58.976770 12234 ts_tablet_manager.cc:933] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:02:59.025847  8435 consensus_peers.cc:597] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac2457ce91f84cd3860bea5672ef0ab8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.027001  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:59.027660  8394 raft_consensus.cc:606] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:59.031296  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157886d313c14dff8294260f4377baf4"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:59.032030  8394 raft_consensus.cc:606] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:02:59.037026 12234 tablet_copy_client.cc:323] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:02:59.037125  8537 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:59.040153  8386 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:59.041913 12217 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:59.037353  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:59.043154  8543 raft_consensus.cc:606] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:59.046195  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7219cc411cf6498f8f250f689007874f"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "92314b14f5554885a80c3dc87f4beed4"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:02:59.046842  8394 raft_consensus.cc:606] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Received request to transfer leadership to TS 92314b14f5554885a80c3dc87f4beed4
I20260709 13:02:59.051867  8537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:02:59.052496  8537 raft_consensus.cc:606] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:02:59.054177  8553 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet 0fcda97cc34546609f91a249f74d8f85 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:02:59.054869  8553 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet 0fcda97cc34546609f91a249f74d8f85 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-0fcda97cc34546609f91a249f74d8f85
I20260709 13:02:59.059806  8462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:48738
I20260709 13:02:59.060920  8462 raft_consensus.cc:606] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:02:59.043835 12217 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:02:59.064527  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:59.066326  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:59.080180 12218 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:59.082093  8553 tablet_copy_source_session.cc:215] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:59.085834 12234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcda97cc34546609f91a249f74d8f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:59.090267  8537 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:59.109550  8292 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.120534 12125 raft_consensus.cc:993] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:59.121086 12125 raft_consensus.cc:1081] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:59.123042  8386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:59.123649  8386 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.124002  8386 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.137705  8386 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.155862  8386 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:59.156711  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:59.157892  8537 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:59.158252  8537 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:59.159540  8537 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.160853  8537 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.164165 12219 raft_consensus.cc:993] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: : Instructing follower c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:59.176899 12219 raft_consensus.cc:1081] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Signalling peer c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:02:59.170315  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:59.178107  8461 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.179242 12234 tablet_copy_client.cc:806] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:59.181190  8543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:49334
I20260709 13:02:59.181726  8543 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.182101  8543 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.188710  8543 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.179862 12234 tablet_copy_client.cc:670] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:59.204607  9068 raft_consensus.cc:1217] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:02:59.208352  8461 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:02:59.209981  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:59.213649 12234 tablet_copy_client.cc:538] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:59.215415  8543 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:59.215044  8394 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:02:59.217542  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:59.218482 12210 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:59.218963 12210 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:59.219883 12210 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.228703  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:59.210623  8386 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.229897  8461 raft_consensus.cc:3055] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:59.234227  8461 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:59.235600 12211 raft_consensus.cc:993] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower 92314b14f5554885a80c3dc87f4beed4 to start an election
I20260709 13:02:59.236222 12211 raft_consensus.cc:1081] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Signalling peer 92314b14f5554885a80c3dc87f4beed4 to start an election
I20260709 13:02:59.239439  8461 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.241098  9068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7219cc411cf6498f8f250f689007874f"
dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
 from {username='slave'} at 127.0.0.1:58882
I20260709 13:02:59.242019  9068 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.241008  8537 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:02:59.242529  9068 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.242148  8461 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.257637  8461 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:59.263634  8386 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:02:59.268586  8507 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:59.272962  8288 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 11 to 12, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.278249 12249 ts_tablet_manager.cc:933] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:02:59.261704 12234 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:02:59.273300 12125 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:59.326551  9068 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:59.330943  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:59.331552  8394 raft_consensus.cc:3055] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:59.331887  8394 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:59.332515  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:59.332644  8394 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:59.333268  8537 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.334025  8394 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.343560  8537 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:02:59.348119  9032 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:02:59.349337 12182 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:59.349979 12182 raft_consensus.cc:697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:02:59.352325 12182 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:02:59.344139  9068 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:59.359460  8394 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:02:59.388108 12125 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:59.402199 12249 tablet_copy_client.cc:323] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
I20260709 13:02:59.404440  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet e4e26f5f342c48648f0433b885576c00 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
I20260709 13:02:59.405227  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet e4e26f5f342c48648f0433b885576c00 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-e4e26f5f342c48648f0433b885576c00
I20260709 13:02:59.412221 12125 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.428254  8288 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 7 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 8 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.431782 12253 raft_consensus.cc:993] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:59.432322 12253 raft_consensus.cc:1081] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:02:59.445258  8405 tablet_copy_source_session.cc:215] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:02:59.484331  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 80410.2us
I20260709 13:02:59.506619 12249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e26f5f342c48648f0433b885576c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:59.516842  8394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:02:59.519528  8394 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.520092  8394 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.536747  8394 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.540745  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:02:59.541051  8394 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:59.542420  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:59.543087  8537 raft_consensus.cc:3055] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:59.541414  8463 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.543454  8537 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:02:59.544376  8537 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.545444  8537 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:59.550933  8463 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:59.552387  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:59.566845 12207 raft_consensus.cc:993] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:59.567344  8537 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:02:59.574644 12261 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:59.590051 12211 raft_consensus.cc:1081] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:59.599490  8462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "157886d313c14dff8294260f4377baf4"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:02:59.600219  8462 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.600610  8462 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:59.606144 12210 raft_consensus.cc:993] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:59.606694 12210 raft_consensus.cc:1081] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:02:59.610574  8468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:02:59.611174  8468 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.611637  8468 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.610196  8462 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.639369 12263 ts_tablet_manager.cc:933] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:02:59.641573 12261 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:59.642313 12263 tablet_copy_client.cc:323] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.194:32851
I20260709 13:02:59.642869 12261 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.657200  8480 tablet_copy_service.cc:140] P d2a645dcec4c479ba4c94d075b1bc98c: Received BeginTabletCopySession request for tablet ac2457ce91f84cd3860bea5672ef0ab8 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:48784)
I20260709 13:02:59.657855  8480 tablet_copy_service.cc:161] P d2a645dcec4c479ba4c94d075b1bc98c: Beginning new tablet copy session on tablet ac2457ce91f84cd3860bea5672ef0ab8 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:48784: session id = 92314b14f5554885a80c3dc87f4beed4-ac2457ce91f84cd3860bea5672ef0ab8
I20260709 13:02:59.669539  8462 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:59.671274  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:59.672163  8543 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:59.671844  8468 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:59.687170  8288 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 10 to 11, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.693774 12211 raft_consensus.cc:1064] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:02:59.695012  8543 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:59.696045  8542 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:59.697639  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:59.704311  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:59.704946  8386 raft_consensus.cc:3055] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:59.705240  8386 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:59.715960 12223 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:59.723762  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:02:59.723621  8386 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.724680  8393 raft_consensus.cc:3055] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:59.725087 12207 consensus_queue.cc:1059] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:59.725391  8393 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:02:59.714820  8468 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:02:59.732576 12223 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:59.733671 12223 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:02:59.739190  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:02:59.739817  8543 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.741513  8480 tablet_copy_source_session.cc:215] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:59.753127  8386 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:59.779240  8536 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:59.769352  8465 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:59.761427 12249 tablet_copy_client.cc:806] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:59.783699 12249 tablet_copy_client.cc:670] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:59.786757  8543 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:59.794190  8393 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:59.795614  8393 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.796751  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:02:59.798813 12207 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:59.798952  8292 catalog_manager.cc:5697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.801725 12210 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:59.807514 12263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2457ce91f84cd3860bea5672ef0ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:59.809245 12249 tablet_copy_client.cc:538] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:59.817410  8393 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:02:59.820917 12247 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:59.821471 12247 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:02:59.818254  8386 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:02:59.837531 12247 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:02:59.874514  8389 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:59.884958  8537 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:59.887351 12258 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:59.888700 12234 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:59.889742 12234 tablet_bootstrap.cc:492] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
W20260709 13:02:59.918274  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 91254.7us
W20260709 13:03:00.002503  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 97649.4us
I20260709 13:02:59.892432 12211 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:00.012363 12234 ts_tablet_manager.cc:1403] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.749s	user 0.057s	sys 0.028s
I20260709 13:02:59.912324 12259 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:03:00.070374  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:00.085273  8386 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:00.111531  8535 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:00.136462 12249 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:03:00.138384 12260 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:03:00.191203  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 103285us
I20260709 13:03:00.235111  9068 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:00.237380 12280 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:00.266996  8542 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:00.271070 12284 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:03:00.286000 12234 raft_consensus.cc:359] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:00.302134 12234 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:03:00.302976 12234 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:00.313449 12263 tablet_copy_client.cc:806] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:00.315173 12263 tablet_copy_client.cc:670] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:00.318145 12234 ts_tablet_manager.cc:1434] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.285s	user 0.008s	sys 0.005s
I20260709 13:03:00.319496 12274 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:03:00.290509  8462 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:00.361483  8553 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-0fcda97cc34546609f91a249f74d8f85 received from {username='slave'} at 127.0.0.1:56998
I20260709 13:03:00.362015  8553 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-0fcda97cc34546609f91a249f74d8f85 on tablet 0fcda97cc34546609f91a249f74d8f85 with peer 92314b14f5554885a80c3dc87f4beed4
W20260709 13:03:00.371470  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 378677us
I20260709 13:03:00.409938 12263 tablet_copy_client.cc:538] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:00.486915 12266 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:00.490116  9064 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:00.499588  8468 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:03:00.516075  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45349.4us
I20260709 13:03:00.559118  8461 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:00.561124  8537 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:00.572539 12297 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:03:00.591532  8292 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:00.612144  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46712.7us
I20260709 13:03:00.630304  8542 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:00.643239  8536 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:00.633277  8288 catalog_manager.cc:5697] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 6, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 6 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.646175  8288 catalog_manager.cc:5697] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 11, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 11 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.684084  9064 raft_consensus.cc:1217] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:03:00.697907 12265 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:00.697635 12263 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
W20260709 13:03:00.790828  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 105026us
I20260709 13:03:00.810528 12249 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:00.826481 12261 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:00.894239 12249 tablet_bootstrap.cc:492] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:03:00.897470 12249 ts_tablet_manager.cc:1403] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.761s	user 0.060s	sys 0.030s
I20260709 13:03:00.928051 12218 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:03:00.925983 12233 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:03:00.939299 12250 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:03:00.931727 12308 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:00.943279 12308 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:00.959830 12306 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.004s
I20260709 13:03:00.968271  8386 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:00.976697 12249 raft_consensus.cc:359] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:00.969641  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:00.980556  8386 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:03:00.992591  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 81416.9us
I20260709 13:03:00.982870 12249 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:03:00.969374 12308 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:00.999068  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:01.034740  8470 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:01.045938 12250 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:01.104308  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:01.039342 12249 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:01.105779 12219 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:03:01.120782 12281 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:01.156827 12263 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.005s
I20260709 13:03:01.179442  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:01.264153  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 140434us
I20260709 13:03:01.354954 12249 ts_tablet_manager.cc:1434] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.457s	user 0.008s	sys 0.002s
I20260709 13:03:01.365319 12251 raft_consensus.cc:1064] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:03:01.380587 12322 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:03:01.395843  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 75596.7us
I20260709 13:03:01.414664  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-e4e26f5f342c48648f0433b885576c00 received from {username='slave'} at 127.0.0.1:60598
I20260709 13:03:01.426230  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-e4e26f5f342c48648f0433b885576c00 on tablet e4e26f5f342c48648f0433b885576c00 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:01.429004  8390 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:01.445502  9064 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:01.461409  8542 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:01.486941 12251 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:01.461949 12308 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:03:01.505522 12307 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:01.507136 12263 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:01.508183 12263 tablet_bootstrap.cc:492] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:03:01.508939 12263 ts_tablet_manager.cc:1403] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.812s	user 0.024s	sys 0.036s
I20260709 13:03:01.547603 12303 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:01.548249 12303 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:01.550210  8537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:01.552074  8537 raft_consensus.cc:606] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:01.566080 12303 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:01.572850  9064 raft_consensus.cc:1217] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
W20260709 13:03:01.573022  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 100464us
I20260709 13:03:01.577188  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:01.584019  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 148111us
I20260709 13:03:01.590443 12281 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:01.612954  8535 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:01.621649  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:01.631475 12303 raft_consensus.cc:993] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:01.651290 12286 raft_consensus.cc:1081] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:01.658135  8465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:48738
I20260709 13:03:01.659039  8465 raft_consensus.cc:606] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:01.680862  8394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:01.681586  8394 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:01.682015  8394 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.678185  8507 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:01.698629  9068 raft_consensus.cc:2955] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:01.708319 12282 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:01.732317 12263 raft_consensus.cc:359] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:01.733273 12263 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
W20260709 13:03:01.740480  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 43788.1us
I20260709 13:03:01.747555  8394 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:01.753566  9064 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:01.755369  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:01.760161  8388 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:01.758914  8470 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.762665 12332 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:01.763908 12253 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:01.767042  8463 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:01.771414  8288 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 7 to 8, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:01.773898  8394 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:01.780081  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:01.833937  8535 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:01.836817 12253 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:03:01.873710  8535 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:01.828909 12263 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:01.881692 12263 ts_tablet_manager.cc:1434] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.372s	user 0.009s	sys 0.002s
I20260709 13:03:01.866101  8470 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:01.866287  8386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:01.870187  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 936de44ff6404ac7b9d585ab45c933f9 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:01.883191  8386 raft_consensus.cc:606] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:01.885310  8480 tablet_copy_service.cc:342] P d2a645dcec4c479ba4c94d075b1bc98c: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-ac2457ce91f84cd3860bea5672ef0ab8 received from {username='slave'} at 127.0.0.1:48784
I20260709 13:03:01.885861  8480 tablet_copy_service.cc:434] P d2a645dcec4c479ba4c94d075b1bc98c: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-ac2457ce91f84cd3860bea5672ef0ab8 on tablet ac2457ce91f84cd3860bea5672ef0ab8 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:01.889917  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:01.891402  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:01.893838  8535 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:01.907732  9064 raft_consensus.cc:1217] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 13:03:01.899187  8535 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.947283 12332 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:01.963841  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:01.967041  8535 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:01.971989 12266 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:01.988451 12266 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:01.989374 12266 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:01.968282  8388 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.017707 12287 raft_consensus.cc:993] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:02.018327 12287 raft_consensus.cc:1081] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:02.011126  8465 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.041069 12307 raft_consensus.cc:993] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:03:02.041630 12307 raft_consensus.cc:1081] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Signalling peer c45599d1dc3b4823b857cf77f276dc7b to start an election
I20260709 13:03:02.043661  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:03:02.044274  8535 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.044677  8535 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.058106  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44080
I20260709 13:03:02.058895  8393 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.059304  8393 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.061816  8535 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:02.076107  8393 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:02.068377  9064 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.077049  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:02.079587  8388 raft_consensus.cc:3055] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:02.079923  8388 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:02.080682  8388 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:02.082584  8388 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.084283  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:02.082736  8535 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:02.085034  8463 raft_consensus.cc:3060] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.090422  8388 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:02.091748  8507 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:02.093719  8463 raft_consensus.cc:2468] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:02.099061  8393 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:02.097580 12253 raft_consensus.cc:2804] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:02.124419 12253 raft_consensus.cc:697] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:02.125613 12253 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:02.102712  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:02.131605  9064 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.104646  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:02.134110  8463 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:02.134617  8463 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:02.135614  8463 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:02.136865  8463 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.141328  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet 936de44ff6404ac7b9d585ab45c933f9 with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:47224
I20260709 13:03:02.155438  9064 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:02.167806  8463 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:02.172410  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:02.176263 12266 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:02.184895 12266 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:02.194689 12261 raft_consensus.cc:1064] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:03:02.200709 12266 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:02.229420  8289 catalog_manager.cc:5697] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 5 to 6, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.249390  8290 catalog_manager.cc:5697] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 11 to 12, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.197775 12261 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:02.270712 12345 tablet_replica.cc:333] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:02.271880 12345 raft_consensus.cc:2243] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.272861 12345 raft_consensus.cc:2272] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.272342  8288 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 11 to 12, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.293905  8537 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:02.295531 12275 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:02.301720 12283 raft_consensus.cc:1064] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:03:02.303301  8537 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:02.304513 12283 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:02.307682  9064 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:02.309981 12261 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:02.313585  9064 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:02.315438 12253 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:02.317138 12345 ts_tablet_manager.cc:1916] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:02.311776  8290 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 11 to 12, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.323347 12298 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.336010  8465 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:02.339493  9068 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEARNER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:02.340128  9065 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.344660 12266 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.345938 12283 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:02.347786 12275 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:02.351738  8393 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:02.355216 12330 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:02.357702  8470 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:02.360131  9069 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.364254 12332 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:02.372341  8535 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:02.422516  8290 catalog_manager.cc:5697] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 6 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.440851  8465 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.544538  8470 raft_consensus.cc:2955] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:02.546504  8535 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:02.547600  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 97452.6us
I20260709 13:03:02.550423  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0fcda97cc34546609f91a249f74d8f85 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:02.563658  8290 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index 6 to 7, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.568390  8537 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:02.603579  8381 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fcda97cc34546609f91a249f74d8f85 with delete_type TABLET_DATA_TOMBSTONED (TS 2122d8c723e84e3da22f81f7eeb4b1a9 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34302
W20260709 13:03:02.646862  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 46949.9us
W20260709 13:03:02.657121  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 55319.1us
I20260709 13:03:02.666863 12359 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:02.687868  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 59956us
I20260709 13:03:02.641683 12261 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:03:02.702891  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 147829us
I20260709 13:03:02.731045  8470 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:02.732963  8463 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:02.759591 12361 tablet_replica.cc:333] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:02.760885 12361 raft_consensus.cc:2243] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.767767 12361 raft_consensus.cc:2272] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.784461  9068 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:02.786720 12275 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:02.809291 12361 ts_tablet_manager.cc:1916] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:02.816679 12265 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:02.819763  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 161885us
I20260709 13:03:02.871659 12250 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:02.874702  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 53946.9us
I20260709 13:03:02.822377 12265 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:02.938949  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:02.990599  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 122527us
I20260709 13:03:03.003830 12345 ts_tablet_manager.cc:1929] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:03:03.004400 12345 log.cc:1199] T 936de44ff6404ac7b9d585ab45c933f9 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/wals/936de44ff6404ac7b9d585ab45c933f9
W20260709 13:03:03.027676  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 78153.1us
I20260709 13:03:03.066788  8393 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:03.077577  9068 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.041188  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet 936de44ff6404ac7b9d585ab45c933f9 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
W20260709 13:03:03.093191  8278 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 53168.4us
I20260709 13:03:03.098676  8386 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.104210  8393 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:03.133132  9068 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:03.134714 12361 ts_tablet_manager.cc:1929] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:03:03.136106 12266 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:03.146176  8470 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:03.151994  8290 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.138537 12358 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:03.159619 12361 log.cc:1199] T 0fcda97cc34546609f91a249f74d8f85 P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/wals/0fcda97cc34546609f91a249f74d8f85
I20260709 13:03:03.161679  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet 0fcda97cc34546609f91a249f74d8f85 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:03:03.162492 12381 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:03.170207  9068 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.166837 12261 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.212845  8466 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:03.222883 12266 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:03.246644  8462 raft_consensus.cc:2955] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:03.309377 12382 log.cc:927] Time spent T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:03:03.420892  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 53997.2us
W20260709 13:03:03.455740  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 101811us
W20260709 13:03:03.463343  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 87013.3us
I20260709 13:03:03.476526  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4e26f5f342c48648f0433b885576c00 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:03:03.482435 12389 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:03:03.622530  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 64886.5us
I20260709 13:03:03.674455  8293 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 7 to 8, VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) evicted. New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.691078  8535 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.698155  8531 tablet_service.cc:1558] Processing DeleteTablet for tablet e4e26f5f342c48648f0433b885576c00 with delete_type TABLET_DATA_TOMBSTONED (TS c45599d1dc3b4823b857cf77f276dc7b not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:49310
I20260709 13:03:03.714128 12400 tablet_replica.cc:333] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:03.715408 12400 raft_consensus.cc:2243] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.716297 12400 raft_consensus.cc:2272] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.719609 12400 ts_tablet_manager.cc:1916] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:03.783967 12400 ts_tablet_manager.cc:1929] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:03:03.785470 12400 log.cc:1199] T e4e26f5f342c48648f0433b885576c00 P c45599d1dc3b4823b857cf77f276dc7b: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/wals/e4e26f5f342c48648f0433b885576c00
I20260709 13:03:03.792989  8277 catalog_manager.cc:5028] TS c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): tablet e4e26f5f342c48648f0433b885576c00 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:03:03.810259  8461 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:03.819381  9068 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:03.822460 12396 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:03.830353  8535 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:03.835822  9065 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.832672 12360 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.894035 12396 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:03.925311  8535 raft_consensus.cc:2955] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.952503  8289 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 8 to 9, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:03.971354  8278 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac2457ce91f84cd3860bea5672ef0ab8 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:03.979043  8381 tablet_service.cc:1558] Processing DeleteTablet for tablet ac2457ce91f84cd3860bea5672ef0ab8 with delete_type TABLET_DATA_TOMBSTONED (TS 2122d8c723e84e3da22f81f7eeb4b1a9 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:34302
I20260709 13:03:04.014629 12401 tablet_replica.cc:333] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:04.040342 12401 raft_consensus.cc:2243] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.041374 12401 raft_consensus.cc:2272] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.070202 12401 ts_tablet_manager.cc:1916] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:04.557843  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:04.911118  8393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "448878eafac247d592f6889cb1e26a56"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:04.911885  8393 raft_consensus.cc:606] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:04.979038  8393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:05.038690 12401 ts_tablet_manager.cc:1929] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:03:04.979890  8393 raft_consensus.cc:606] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:05.039333 12401 log.cc:1199] T ac2457ce91f84cd3860bea5672ef0ab8 P 2122d8c723e84e3da22f81f7eeb4b1a9: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/wals/ac2457ce91f84cd3860bea5672ef0ab8
I20260709 13:03:05.040954 12401 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34302 (request call id 13) took 1062 ms. Trace:
W20260709 13:03:05.215227  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08003111a0 after lost signal to thread 7286
W20260709 13:03:05.217257  8324 debug-util.cc:398] Leaking SignalData structure 0x7b080031bcc0 after lost signal to thread 8327
I20260709 13:03:05.308238 12397 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:05.308899 12397 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:05.041419 12401 rpcz_store.cc:276] 0709 13:03:03.978668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.978855 (+   187us) service_pool.cc:224] Handling call
0709 13:03:04.014251 (+ 35396us) ts_tablet_manager.cc:1151] Deleting tablet ac2457ce91f84cd3860bea5672ef0ab8
0709 13:03:04.014335 (+    84us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:04.094100 (+ 79765us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:05.038488 (+944388us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:05.040861 (+  2373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24487,"tablet-delete.queue_time_us":34586,"thread_start_us":16404,"threads_started":1}
I20260709 13:03:05.408171  8393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "92314b14f5554885a80c3dc87f4beed4"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:05.410014  8393 raft_consensus.cc:606] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Received request to transfer leadership to TS 92314b14f5554885a80c3dc87f4beed4
W20260709 13:03:05.591153  8508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.007s	sys 0.022s
W20260709 13:03:05.598043  8508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.008s	sys 0.022s
I20260709 13:03:05.602840  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:05.625988  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:05.552649 12397 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:05.626960  8537 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:03:05.586695 12272 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:05.595376 12359 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:05.693984 12363 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:05.694774 12363 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:05.695619 12359 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:05.687065 12272 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:05.660339 12397 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:05.707746 12286 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:05.722957 12397 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:05.723502 12359 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:05.723410 12286 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:05.724143 12359 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:05.724625 12359 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:05.712903 12360 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:05.726526 12360 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:05.726989 12359 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:05.728662 12359 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:05.728855 12360 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:05.725633 12286 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:05.730607 12286 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:05.731279 12363 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:05.731092 12286 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:05.725458 12397 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:05.733326 12286 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:05.729233 12359 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:05.867357  8359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.014s	sys 0.023s
W20260709 13:03:05.868466  8359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.014s	sys 0.023s
W20260709 13:03:05.878569  8434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.009s	sys 0.019s
W20260709 13:03:05.879257  8434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.010s	sys 0.019s
I20260709 13:03:05.912344 12286 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:05.914281 12286 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:05.915608 12272 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:05.919081 12286 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:05.919766 12272 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:05.920037 12286 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.066915 12272 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.098701 12359 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.099299 12286 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.099989 12397 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.101140 12397 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.104684 12397 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:06.105458  8435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.003s	sys 0.017s
I20260709 13:03:06.133352 12433 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:03:06.181085  8433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.015s	sys 0.002s
W20260709 13:03:06.181667  8433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.016s	sys 0.002s
I20260709 13:03:06.182731 12415 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.160073 12397 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.188521 12397 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.138605 12359 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.183682 12415 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.278998 12363 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.280143 12363 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.290620 12415 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.290391 12397 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.293772  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.280179  9068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58882 (request call id 317) took 1360 ms. Trace:
I20260709 13:03:06.314301  9067 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:06.335331 12439 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.336645 12363 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.336458 12439 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.337334 12415 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.338027 12356 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.338320 12415 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.338912 12356 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.341276 12415 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.338050 12417 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.342716 12455 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.343072 12417 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.343734 12455 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.344537 12265 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.314389  9068 rpcz_store.cc:276] 0709 13:03:04.920143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.181265 (+1261122us) service_pool.cc:224] Handling call
0709 13:03:06.214831 (+ 33566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.279543 (+ 64712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.279585 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.279654 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:06.279709 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.279786 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.279960 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.346472 12437 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.347524 12454 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.347429 12437 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.348019 12442 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.348501 12454 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.348897 12442 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.350020 12412 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.350925 12455 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.350745 12412 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.351647 12455 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.352603 12455 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:06.353650 12452 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.293933 12433 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.354671 12452 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.356668 12433 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.357352 12452 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.357941 12286 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.358235 12414 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.358925 12423 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.359602 12435 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.360404 12415 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:06.361627 12439 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.363685 12404 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.279080 12359 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.365031 12446 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.391983 12363 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.393088 12363 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.385558 12298 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.394577 12298 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.364413 12356 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.345408 12265 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.325511 12397 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.395954 12363 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.469249 12360 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.405915 12423 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.470141 12360 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.480580 12298 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.480860 12360 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.483098 12429 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.483752 12446 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.484138 12429 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.485219 12405 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:06.486057 12405 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.486887 12446 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.487584 12446 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.488431 12446 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.490330 12464 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.491243 12464 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.494341 12425 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.494441 12448 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:06.495338 12422 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.495472 12448 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.496485 12407 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.497030 12458 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.497421 12417 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.497196 12407 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.498219 12443 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.498338 12437 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.499258 12443 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.499818 12407 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.500471 12407 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.502370 12450 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:06.503664 12447 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.503295 12450 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.496263 12422 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.395746 12286 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.501165 12407 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.407226 12435 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.489508 12420 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.410076 12461 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:03:06.522737  8324 debug-util.cc:398] Leaking SignalData structure 0x7b080003a6e0 after lost signal to thread 8419
I20260709 13:03:06.518553 12416 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.523782 12298 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:06.523815 12429 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.525635 12359 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.530099 12415 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.504943 12410 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.527779 12422 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.547821 12298 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:06.555336  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 154362us
I20260709 13:03:06.504621 12447 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.555683 12422 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.556529 12422 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.557952 12447 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.408824 12433 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.558826 12433 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.561265 12433 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.561837 12433 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.561957 12363 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.528201 12265 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.528868 12454 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.547668 12442 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.513056 12405 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.582722 12457 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.583133  9063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.584115  9063 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:06.583848 12457 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.529290 12446 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.542663  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.540760 12435 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.407624 12441 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.585611 12410 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.586475 12465 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:06.587260 12465 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.588236 12410 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.495347 12425 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.573840  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.589964 12287 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:06.562171  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.590873 12425 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.590734 12287 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.591660 12286 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.593181 12287 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.557499  8509 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:06.608693  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.562100  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.557497 12298 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.568869 12433 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.580533 12463 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:03:06.611564  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 106739us
I20260709 13:03:06.580003 12363 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.529209 12397 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.581904 12423 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.586126 12441 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.526273 12464 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.598081 12447 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.596957 12427 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.599355 12430 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.526439 12404 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.585668  8392 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:03:06.497773 12458 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.595115 12459 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.605963 12360 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:06.606449  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.615355 12405 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.611397 12442 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.611227 12265 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.617758 12409 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:06.396545 12414 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.642858 12409 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.643347 12409 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:06.644739 12414 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.593935 12453 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.645591 12453 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.619109 12463 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.648069 12453 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.648468 12463 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.620703 12441 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.597971 12359 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.651029 12449 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.651280 12359 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.652051  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50742 (request call id 220) took 1636 ms. Trace:
I20260709 13:03:06.651742 12449 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.652458  8293 rpcz_store.cc:276] 0709 13:03:05.015763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.015985 (+   222us) service_pool.cc:224] Handling call
0709 13:03:06.651852 (+1635867us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2434,"reported_tablets":1}
I20260709 13:03:06.653898 12359 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.600210 12436 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.654820 12436 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.606863  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.656832  8391 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:03:06.657841 12436 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.658059  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.600908 12420 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.659677  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:06.608839  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 51430.5us
I20260709 13:03:06.522114 12448 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.609414  8388 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
I20260709 13:03:06.551928 12443 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.619604  9068 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:06.599182 12416 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.594038 12461 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.596915 12422 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.633800  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.641400  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.638226  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.631882 12360 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.631904  8387 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
W20260709 13:03:06.669827  8324 debug-util.cc:398] Leaking SignalData structure 0x7b080003de80 after lost signal to thread 8494
I20260709 13:03:06.621040  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.621490 12447 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:06.621845 12427 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:06.782771  8358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.100s	user 0.012s	sys 0.010s
I20260709 13:03:06.754536  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:06.778810  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 136893us
I20260709 13:03:06.639297 12397 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.790385  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:06.789950  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:06.626744 12415 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.787902  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36664 (request call id 13) took 1467 ms. Trace:
I20260709 13:03:06.781016  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.620488 12433 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.629779 12407 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.834347  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.625190 12404 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.770404  9032 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:06.951926  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:06.758005  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 2144) took 1120 ms. Trace:
I20260709 13:03:06.630277 12455 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.631909 12363 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.997924  8390 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:06.998895  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.636912 12272 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.639922 12298 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.785358  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:06.631939 12458 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.633239  9063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:06.945461  8358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.378s	user 0.012s	sys 0.022s
I20260709 13:03:06.628204 12450 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:06.969256  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:06.631497 12459 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.996811  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:06.997169  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.639901 12265 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.952250  8463 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
W20260709 13:03:06.972319  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1a20 after lost signal to thread 8568
I20260709 13:03:06.642176 12424 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.998803  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.973047  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:06.977871  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.990574  8393 rpcz_store.cc:276] 0709 13:03:05.320107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.407837 (+ 87730us) service_pool.cc:224] Handling call
0709 13:03:06.787192 (+1379355us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b54002a65a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13464520 00007fbe134e1652 00007fbe184af60a 00007fbe11a357d4 00007fbe11a35762 00007fbe11a35691 00007fbe11a3560c 00007fbe11a348c2 00007fbe1182248c 00007fbe118218c6
0709 13:03:06.787647 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119479680}
I20260709 13:03:06.987941  8543 rpcz_store.cc:276] 0709 13:03:05.634061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.634216 (+   155us) service_pool.cc:224] Handling call
0709 13:03:05.650085 (+ 15869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.650390 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.650417 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.650464 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:05.650491 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.650572 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.744610 (+1094038us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5400040e50. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:06.754577 (+  9967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35550464}
I20260709 13:03:07.006525  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.780907 12416 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.003430  8536 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:03:06.949131 12286 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.853191 12457 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:07.008628  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 339387us
I20260709 13:03:06.976963 12210 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:06.828867 12412 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.766919 12465 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.024386  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:06.781309 12466 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.953644  8435 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:06.792591 12359 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.013824  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.014135  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.016546 12404 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:06.830497 12462 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.038126 12378 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.037827 12298 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.038614 12378 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.038573 12462 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.014171  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.035121  8389 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:07.040320 12298 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.974329  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:06.974741  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:06.637497 12442 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:06.830585 12396 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:06.832612 12460 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:06.787178 12420 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:06.847215 12449 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:06.825258 12461 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.022688  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.026320  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.047952  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:06.622259 12430 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.029997  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.036770 12404 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.031637 12459 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.032531  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.033764  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:06.974051 12427 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.035032  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.056326  8392 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:06.767773  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:07.036417  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08003277c0 after lost signal to thread 9093
W20260709 13:03:07.060438  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5cc0 after lost signal to thread 12207
W20260709 13:03:07.037036  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 87358.1us
I20260709 13:03:07.039230 12378 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.035008  8466 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
I20260709 13:03:07.044082 12465 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.031585 12210 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.027210 12450 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.026364  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.031082  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.052852  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.052335  8462 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:06.637012 12405 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.059872  8277 catalog_manager.cc:5028] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): tablet ac2457ce91f84cd3860bea5672ef0ab8 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:03:07.057559  9032 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.054802 12404 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:07.065481  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc860 after lost signal to thread 12334
W20260709 13:03:07.068213  8324 debug-util.cc:398] Leaking SignalData structure 0x7b0800338040 after lost signal to thread 12354
I20260709 13:03:07.057467 12423 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:07.071702  8324 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4a40 after lost signal to thread 12377
I20260709 13:03:07.070112  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:07.070828  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.077636  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.044070 12424 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.088690  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.078387  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.090058 12414 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:07.090448  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.090739 12414 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.055289 12466 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.091471  8462 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:07.069514 12409 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.058166 12359 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.093644  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.097971  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.096786  8391 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 11.
I20260709 13:03:07.096834  9032 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:07.077028 12423 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.091450 12414 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.070341 12462 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.097429 12275 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.064977 12461 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.074920 12416 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.109035  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.110769  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.111502  8464 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:07.114091 12360 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.115532  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.116262  8468 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:07.117019 12415 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.117604 12415 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.119776 12415 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.120589  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.107323 12407 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.124837  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.068565 12396 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.070443 12420 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.071135 12460 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.130261  8543 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:07.106344 12423 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.134924  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.108359 12412 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:07.139461  8386 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:03:07.139737 12443 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.140338  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.141227 12455 raft_consensus.cc:993] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower 92314b14f5554885a80c3dc87f4beed4 to start an election
I20260709 13:03:07.141659  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.100284 12450 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.144212  8542 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:07.156461  8465 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:07.158850  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.151700 12455 raft_consensus.cc:1081] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Signalling peer 92314b14f5554885a80c3dc87f4beed4 to start an election
I20260709 13:03:07.160446  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.109169 12275 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.163543 12463 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.132284 12465 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.143004 12412 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.137351 12407 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.163326 12443 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.164685  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.177090  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.161580 12447 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.176573 12407 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.184147 12418 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.164188 12446 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.187948  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.181106 12458 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.188901 12418 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.193948  8543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:07.194581 12210 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.194777  8543 raft_consensus.cc:606] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:07.189231  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.191416 12463 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.196228  8538 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:03:07.196071 12460 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.187377  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.198078 12463 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.192605 12275 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.199177 12378 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.192310 12458 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.173094  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.203807 12458 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.193207 12446 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.206472 12446 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.207645 12458 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.208304 12458 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.180573 12412 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.210666 12458 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.211755 12465 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.213260  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.213431 12414 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.214534  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.214811  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.213771  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.216774  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.215327  8465 raft_consensus.cc:2468] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:07.218586 12414 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.179744 12443 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.216614  8469 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:03:07.222872 12359 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.222646 12466 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.178265 12461 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.223410 12450 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.224210  8544 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:07.224447  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.164862 12420 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.228404 12396 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.231134  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.231508  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.231891  8542 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:07.234675  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.236461  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.237058  8538 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:07.237916  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.238428  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.238531  8543 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:07.238992  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.240000  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.240124  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.240619  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.240749  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.241933  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.242035  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.242674  8468 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:07.244134  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.174157 12265 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.248242  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.251894  9033 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:07.252630  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 104045us
I20260709 13:03:07.253443 12406 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:07.253839 12406 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.254202 12406 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.254781  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.254086  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.255985  9033 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.257108  9033 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.258011  9033 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:07.258948  8465 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:07.196171 12418 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.215988 12442 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.263321 12441 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:07.263530  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.260187 12416 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:07.263859 12455 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.264333  8544 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:03:07.264468 12416 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.264932 12416 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.264674 12455 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.265434 12405 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.267015 12455 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.268343  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.268441 12455 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.268640  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.269101 12455 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.269459  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.269735  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.261220 12414 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.270803  8467 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.274262  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.247860 12378 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.263818 12441 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.280949  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.250248 12424 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.288640 12461 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.289707 12420 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.290546 12455 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.291736 12405 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.291891 12443 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.292403 12265 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.306572 12405 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.306898 12265 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.309072 12405 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.309132 12265 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:07.296118  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 130965us
W20260709 13:03:07.304414  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46483.3us
I20260709 13:03:07.303692 12441 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.316239 12430 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.293413 12409 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:07.306646 12443 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.319305 12443 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.320425  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.320715  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.321116  8544 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:07.321357  8540 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:07.322499  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.323843  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.325654  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.325969  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.326789  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.329103  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.330791  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.331030  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.331650  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.332779  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.333799  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.334875  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:07.336272  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.336488  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.341735  9032 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.342474 12412 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.343957 12469 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:07.344412 12469 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.344956 12412 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.345000 12469 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.347831  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.349087 12416 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.349577  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.351318 12416 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.352857  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.353171  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.354591  8544 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:07.354373  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.353024 12406 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.359200  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.361585  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.363377  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.363888  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.366395 12406 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.366380 12441 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.367425  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.367578  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:07.368746 12441 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.367277  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.369978 12423 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.371531  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.372056 12423 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.373163  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.373517  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:07.373812  8544 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:07.374147  8540 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.374238  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.374743  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.375129  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.375433  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.376277  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.377233  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.377647  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.376351  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.377871  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.378636  8539 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:03:07.378919  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.379691  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.378919  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.382148  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.382390 12466 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:07.382786 12466 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.383180 12466 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.386181  8391 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:07.388142  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.389480  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.391131  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.391928 12460 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:07.392343 12460 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.392706 12460 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.394151  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:07.394838  9066 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.399097  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.399701  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.398592  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.400688  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.401715  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.402140  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.402736 12424 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.403165 12420 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:07.403370 12418 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.403836 12420 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.403911 12418 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.404392 12420 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.404501 12418 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.404901  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.405524  8389 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 5.
I20260709 13:03:07.403192 12424 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.406288 12424 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.407474  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.409094  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.410277  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.410279  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.412346  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.414180  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.414568  9062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9"
dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
 from {username='slave'} at 127.0.0.1:58882
I20260709 13:03:07.414875  8389 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:03:07.415086  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.415261  9062 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.415318  9032 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.415828  9062 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.416395  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.371690 12404 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.353565 12469 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.402518  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:07.448211  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 45783.6us
I20260709 13:03:07.449223 12396 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:07.449823 12396 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.450470 12396 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.450673  8508 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.416623  9032 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.417534  8540 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:07.452282  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:07.453536  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.444402 12420 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.427085  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.455008  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.426998  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.422266  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.455897  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.457773  8544 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 5.
I20260709 13:03:07.457938  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.456969  8508 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.456278  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.458640  8386 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.462275  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.403252  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:07.465638 12461 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:07.466588  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.481248 12461 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.481741 12461 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.444197  9066 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:07.482031 12466 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.482736  9064 raft_consensus.cc:1240] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.483142  8435 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.484068 12359 raft_consensus.cc:2804] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:07.484189 12465 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:07.484596 12359 raft_consensus.cc:697] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:07.462374 12414 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.485682 12359 consensus_queue.cc:237] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.452008 12458 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.476392  8539 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:07.474272  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.487375  8543 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:07.488094  8386 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:07.458037 12406 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.488837  8387 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:07.489197  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.471489 12460 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.489114 12406 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.490658 12406 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.474588  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.475526  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.474915  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.477492  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.491883  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.475211  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.472774  9062 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.479538  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.494958 12423 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.496074  9062 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.484653 12465 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.497610 12465 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.499047  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.499150  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.500535  9032 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.477319  8509 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:07.503427  9065 raft_consensus.cc:1240] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:07.498169  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.509091  9033 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:07.507296  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.433717 12441 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.508158  8389 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:07.512122  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:07.517982  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:07.518384  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.519093  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.526417  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.527099  8387 raft_consensus.cc:3055] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:07.509434 12463 raft_consensus.cc:2764] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:03:07.508337 12378 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.538703 12378 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.539229 12469 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.539641  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.539674  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.540416  8393 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:07.540851  8394 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:03:07.541352  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.541496 12406 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.543236  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.543834 12406 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.526930 12470 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.526755 12443 consensus_queue.cc:1059] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:03:07.545063  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.531154 12460 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.545725 12443 raft_consensus.cc:3055] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.546146 12443 raft_consensus.cc:740] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:07.547022 12443 consensus_queue.cc:260] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.548223 12443 raft_consensus.cc:3060] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.529770 12412 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:07.533059 12396 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.527441  8387 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:07.537774  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:07.530447 12450 consensus_queue.cc:1059] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:03:07.539913 12424 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.539994  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.516597 12423 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.533161  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.549435  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.539147 12378 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.484284 12466 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.529184  8509 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.549875  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.551076  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.552990  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.527148 12441 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.553529 12430 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.553016  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.557353  8387 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.557024  9062 raft_consensus.cc:1240] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:07.558507 12412 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:07.563395 12412 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.564776 12441 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.565526  8387 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.566179 12468 raft_consensus.cc:3055] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:07.566560 12468 raft_consensus.cc:740] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:07.567535 12468 consensus_queue.cc:260] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.567986  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:07.568836 12468 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.572597 12396 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.574097 12420 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.576555 12418 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.577718  8387 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:03:07.559118 12461 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:07.578476  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.585286 12461 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.585367 12424 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:07.578313  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 49198.8us
I20260709 13:03:07.586995  8509 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.588301  8509 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.578830 12420 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.589102 12430 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.589435 12463 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:07.589561 12430 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.590067 12430 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.590312 12463 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.579540 12404 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.580708  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.582647  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:07.592667  8540 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:07.595119  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.596033 12396 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:07.596371  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:07.596686 12396 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.597219 12466 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:07.597666 12466 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.597648 12396 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.598402 12466 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.602161 12465 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.612944  8509 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.620697  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.621126  9062 raft_consensus.cc:1240] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:07.622246  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.619760 12461 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.625111  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.626905  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.628605  9062 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:07.631441  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 102473us
I20260709 13:03:07.635087 12378 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.637248 12378 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.638373  9065 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:07.638271 12298 consensus_queue.cc:1059] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:07.639544 12424 raft_consensus.cc:3055] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:07.645516  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:07.645658  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:07.646008  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.647575  9065 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:07.647673 12265 consensus_queue.cc:1059] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:07.648672 12396 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.651717  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.649153 12405 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:07.656072  9032 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:07.644115 12424 raft_consensus.cc:740] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:07.643669 12455 consensus_queue.cc:1059] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:03:07.658422  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.659062  9032 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.643869 12409 consensus_queue.cc:1059] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:03:07.662976  8540 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 11.
I20260709 13:03:07.665777  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.668174  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:07.668697  9032 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.668942  8387 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:03:07.671720  9032 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.672253 12406 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.673770 12396 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.665870 12404 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:07.677979  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.678297  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.679401  8387 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 9: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:03:07.676074 12409 consensus_queue.cc:1243] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer 92314b14f5554885a80c3dc87f4beed4 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:07.656543 12405 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:07.680480  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.681535 12405 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.683008 12405 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.685920  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.663044 12414 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:07.678086 12423 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.675302  9032 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.687861  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.686650 12418 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.665619 12424 consensus_queue.cc:260] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.693427 12424 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.694226  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.696378  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:07.698722  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.701249  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.701958  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:07.702276 12465 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.704119  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.706130  9032 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.708442 12406 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:07.708922  8507 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.709084 12406 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:07.709210 12404 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:07.709776 12404 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.710197 12404 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.710510  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.710326 12406 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:07.713410  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.713967 12461 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.714480 12414 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:07.715564 12414 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.712890 12465 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:07.733749 12465 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.734503 12465 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.738104 12463 raft_consensus.cc:3055] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:07.725291 12461 raft_consensus.cc:993] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:07.725860  8507 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.727236  8542 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:07.739027 12461 raft_consensus.cc:1081] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:07.739809 12418 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:07.740250 12418 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.740617 12418 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:07.741642  8507 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:07.742849 12461 consensus_queue.cc:1059] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:07.744043 12358 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.744758 12455 raft_consensus.cc:3055] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:07.745237 12455 raft_consensus.cc:740] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:07.745667  8507 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.728236 12404 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.738598 12463 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:03:07.746486  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.741364  8293 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 7 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 8 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.750862  8507 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.752020  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.753465  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.755503  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:07.756273  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.756772  8507 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.758289  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.760694 12358 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:07.761158 12358 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.763167  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.754849 12420 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:07.759343 12433 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:07.766808 12433 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.767091 12286 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.767294 12433 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.752719 12442 consensus_queue.cc:1059] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:03:07.759054  8360 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48eb2b2d1e724640bdcade4f8baa0375. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:07.747963 12455 consensus_queue.cc:260] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.770476 12455 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.765326  8507 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.759131 12298 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.774577 12298 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.775020 12298 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.764453 12409 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.777182 12409 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.761577 12358 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:07.780025 12463 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.787834  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.788944 12409 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.789541  8507 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.790674 12409 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.791047  8507 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.795328 12286 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.795441  8507 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.797181 12420 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.797212  8507 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.798033 12463 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.798626 12286 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.799229  8507 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.800209 12286 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.800726  8507 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.762771 12430 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.803335 12430 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.804112 12286 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:07.804605 12286 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.805073 12286 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:07.810560  8507 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.811830 12420 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:07.760000 12461 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.813910  8507 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
W20260709 13:03:07.816458  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 54215.6us
I20260709 13:03:07.817853  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.751788 12424 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.835331  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.819202 12461 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.815371  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.819329 12442 raft_consensus.cc:3055] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:07.818275 12404 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.818605  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:07.840166  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.852860  8540 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.854478  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.856213 12461 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.856276 12424 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.840901 12420 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:07.854941 12430 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:07.859814 12298 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.865387 12418 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.877252 12298 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.878862  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.840737 12442 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:07.871090  9065 raft_consensus.cc:1240] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:07.880688 12442 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.881562  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.869879 12430 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.856812  8507 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.886523 12430 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.887086 12298 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.882149 12468 consensus_queue.cc:1059] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:03:07.889513 12460 raft_consensus.cc:3055] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:07.891045  8358 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.892882 12433 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.893323 12405 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.894932  8358 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:07.891196 12460 raft_consensus.cc:740] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:07.909375 12460 consensus_queue.cc:260] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.910732 12460 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.874191 12286 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.897495 12358 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.915686 12286 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:07.880961  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 45709us
I20260709 13:03:07.916234 12358 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.896843 12298 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:07.947600 12405 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:07.947577 12298 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:07.948634  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 53790.7us
I20260709 13:03:07.872154 12466 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.881158 12418 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.898339 12465 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.903214 12430 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.950798  8469 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:07.903752 12433 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.951647 12466 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.898312  8540 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 12.
I20260709 13:03:07.916873  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.917181  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.903791 12442 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.918023  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.896258  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:03:07.945456  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.948283 12405 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:07.956598 12405 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.957671  9032 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:07.958597 12406 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:07.959081 12406 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:07.958976 12418 consensus_queue.cc:1059] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:07.960307 12418 raft_consensus.cc:3055] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:07.960119 12406 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:07.960726 12418 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:07.951815 12430 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:07.961779 12430 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:07.962195 12430 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.962548 12430 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.951712 12465 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.964495 12298 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:07.961728 12418 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:07.966719 12418 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:07.967387  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.873325  8462 raft_consensus.cc:2468] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:07.968369  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:07.972447  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:07.973664 12460 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.974216 12460 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:07.974701 12460 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:07.978822  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.980513  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:08.008291  9062 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.000397  9033 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:08.011982 12460 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.012548 12406 raft_consensus.cc:2804] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:07.989642  8293 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 8 to 9, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 9 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.990067  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:07.997882  9065 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:03:08.013124 12406 raft_consensus.cc:697] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:08.015303 12468 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:08.015937  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.016531 12405 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.015391 12406 consensus_queue.cc:237] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:08.017257 12468 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:08.019327  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:08.021241 12424 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:08.022420  8358 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:08.022538 12465 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:08.023038 12465 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:08.023236 12468 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.023684 12468 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:08.024416 12468 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.024076 12465 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:08.025707 12465 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.008301 12430 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.032044 12430 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:08.033252 12405 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:08.034457  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:08.036754  8293 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 11 to 12, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 12 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.038726  8293 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 9 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 10 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.044617  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:08.046355 12466 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:08.046893 12466 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:08.047329 12466 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.045055 12468 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.052175 12468 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:08.054380  8358 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:08.055757 12442 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:08.055894  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:08.056207 12442 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:08.056641 12442 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.056751 12443 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:08.057538 12443 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:08.057878 12443 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:08.057950 12455 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:08.058261 12443 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.058419 12455 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:08.058903 12455 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.057974  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:08.060714  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.062244  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.064436  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.067373  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.070057  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.070880  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.069447  8358 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:08.071781  8391 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:08.067992 12443 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.134984  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.136678 12443 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:08.140631  8391 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:03:08.141886  8359 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.194:32851 timed out after 1.556s (SENT) [suppressed 21 similar messages]
I20260709 13:03:08.142530 12406 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:08.144556  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.144851  8542 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:08.145385  8535 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:08.141270 12466 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.142542 12405 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.141384  8293 catalog_manager.cc:5697] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 12 to 13, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 13 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:08.147296 12442 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.148080 12466 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:08.147964  8293 catalog_manager.cc:5697] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 9 to 10, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 10 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.149471 12460 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:08.152701  8462 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:08.154680 12424 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:08.155771  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.140807 12455 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.157160 12286 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:08.157618 12286 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:08.158563 12286 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.159726 12286 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.160526  8535 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.149639 12442 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:08.162673  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.163275  8542 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:03:08.164776  8540 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:08.168824 12412 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:08.171566 12404 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:08.180034  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.182193  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.187444 12455 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:08.199517 12490 ts_tablet_manager.cc:933] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
I20260709 13:03:08.210597  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.211557  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.212406  8544 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:03:08.212432  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.215812  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.217113  8395 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:08.218302  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.219270  8391 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:08.218317  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.231557 12406 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:08.233428  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 158226us
I20260709 13:03:08.237082  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.251569  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.258639  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.259744  8535 raft_consensus.cc:2393] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:08.261361  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.262161  8544 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:08.264258  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.266708  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.276435  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.277072  8543 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:08.277376  8539 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:08.280440  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.281814  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.279009 12443 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:03:08.287088  8544 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.287303 12443 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:08.287669 12443 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:08.288223  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.289546  8544 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:08.290055  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.290664  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.291039  8395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:08.292392  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.299626  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.299772  8395 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.299908  8393 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.293682  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.300400  8395 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.303834  8387 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:08.305727  8394 raft_consensus.cc:2393] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:08.305737  8538 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:08.306192  8541 raft_consensus.cc:2393] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:08.307813  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.308280  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.351342  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.352540  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.353235  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.354593  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.355710  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.356190  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:08.358000 12490 tablet_copy_client.cc:323] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.193:35967
I20260709 13:03:08.354727  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.374251  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:08.375818  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.445777  8390 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:08.448365  8392 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:08.447715  8543 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:08.447290  8538 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.454896  8537 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:08.463039  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:08.455662  8394 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 6: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:08.466866  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.470955  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.463177  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.453756  8391 raft_consensus.cc:2468] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:08.475167  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.476526  8543 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:08.482729  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.488251  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.486912  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.497367  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.491709  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.498730  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.502154  8387 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:08.506444  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.507773  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.505807  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:08.517329  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.519282 12405 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.514981  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:08.524665  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.525820  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.527890  8542 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:03:08.528599  8543 raft_consensus.cc:1240] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:08.526278  8395 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.530844  8391 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:08.532270  8542 raft_consensus.cc:1240] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:08.534049  8544 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:08.535385  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 73815.7us
I20260709 13:03:08.530320 12358 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:08.540597  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:08.563864  8538 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:08.567746  8405 tablet_copy_service.cc:140] P 2122d8c723e84e3da22f81f7eeb4b1a9: Received BeginTabletCopySession request for tablet 48eb2b2d1e724640bdcade4f8baa0375 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:60598)
I20260709 13:03:08.568397  8405 tablet_copy_service.cc:161] P 2122d8c723e84e3da22f81f7eeb4b1a9: Beginning new tablet copy session on tablet 48eb2b2d1e724640bdcade4f8baa0375 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:60598: session id = 92314b14f5554885a80c3dc87f4beed4-48eb2b2d1e724640bdcade4f8baa0375
I20260709 13:03:08.570174  8539 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:08.571861  8393 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:08.573058  8392 raft_consensus.cc:2468] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:08.573690  8386 raft_consensus.cc:1240] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:08.580410  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.586623  8390 raft_consensus.cc:2468] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:08.598224  9065 raft_consensus.cc:1240] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:08.601647  8462 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:03:08.603518  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 88637.6us
I20260709 13:03:08.604441  8507 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:08.605693  8391 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:03:08.609417  8391 raft_consensus.cc:3060] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:08.618018  8462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
new_leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
 from {username='slave'} at 127.0.0.1:48738
W20260709 13:03:08.614739  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 151786us
I20260709 13:03:08.717835  8462 raft_consensus.cc:606] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Received request to transfer leadership to TS c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:08.610152 12298 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:08.722750  8391 raft_consensus.cc:1275] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:08.727957  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:08.729286  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:08.729368  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:03:08.737682  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 69490.2us
I20260709 13:03:08.736783 12442 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:03:08.747066  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:08.747561  8470 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.749020  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:08.746098 12498 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:08.620381 12500 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:03:08.614369 12502 consensus_queue.cc:1059] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.133s
I20260709 13:03:08.730851 12496 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:08.775967  8358 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:08.776916 12502 raft_consensus.cc:3055] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:08.777374 12502 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:08.782454  8395 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:08.786094  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.807461 12488 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:03:08.818421  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:08.818619  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:08.819702  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:08.821321  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:08.822408 12504 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:08.822856 12504 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:08.823227 12504 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.827531 12506 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.828022 12506 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:08.828399 12506 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.834043  8463 raft_consensus.cc:1240] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.834719  8468 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:08.837733 12502 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:08.839149 12502 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.840495 12443 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.841593 12443 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:08.858361  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.861099  8539 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:08.862540 12420 consensus_queue.cc:1059] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:08.863745 12286 raft_consensus.cc:3055] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:08.864162 12286 raft_consensus.cc:740] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:08.865096 12286 consensus_queue.cc:260] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:08.906487  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 85230.4us
I20260709 13:03:08.908690 12430 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:08.909802 12430 consensus_queue.cc:1059] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:08.911392 12378 raft_consensus.cc:3055] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:08.911885 12378 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:08.912940 12378 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:08.914870  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:03:08.922560  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 58487.9us
W20260709 13:03:08.922753  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 204648us
I20260709 13:03:08.927105  8507 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:08.928313 12286 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.930047 12465 consensus_queue.cc:1059] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:08.934451  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 322108us
W20260709 13:03:08.935109  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 217862us
I20260709 13:03:08.936820  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:08.967160  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:08.968109  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.965415  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:08.961028 12358 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:08.990398  9065 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.975531 12265 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:08.959165 12466 consensus_queue.cc:1059] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:03:08.998715  8507 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:08.963692 12497 consensus_queue.cc:1059] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:03:08.966014 12405 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:03:08.966341 12495 consensus_queue.cc:1048] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:03:09.013538  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 237660us
I20260709 13:03:08.992789 12378 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:09.000026 12460 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:09.022272  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45302.7us
W20260709 13:03:09.024886  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 59611.9us
I20260709 13:03:09.028491  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:09.036432  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 69388.3us
I20260709 13:03:09.037618  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.037467  8537 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:03:09.083590  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 55197.8us
W20260709 13:03:09.049957  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.038877 12265 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:09.198956  8470 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:09.200551  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:09.218081  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 202037us
W20260709 13:03:09.222409  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 184887us
I20260709 13:03:09.039587 12501 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:09.224768  8539 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:09.035396 12420 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:09.225831  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 188646us
W20260709 13:03:09.235472  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 196206us
I20260709 13:03:09.024886 12460 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:09.242214  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 201076us
I20260709 13:03:09.242770  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:09.082296 12515 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:09.243521  8540 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:09.245910  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 45459.7us
I20260709 13:03:09.247722  8540 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:09.250736 12513 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:09.254617  8359 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:09.046136 12472 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.208s
I20260709 13:03:09.243005 12460 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:09.243497 12524 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:09.246919 12503 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.293346  8540 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:09.303435  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 54116.3us
I20260709 13:03:09.229660 12500 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:03:09.284969 12518 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.284487 12501 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:09.247605 12515 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:09.308542  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54075.3us
I20260709 13:03:09.286167 12505 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.317025  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.319347 12527 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.331185  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 100349us
I20260709 13:03:09.238883 12519 consensus_queue.cc:1059] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
W20260709 13:03:09.345602  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.347929  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.323287 12515 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:09.352726 12523 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.357350  8405 tablet_copy_source_session.cc:215] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:09.383111 12519 consensus_queue.cc:1243] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer 92314b14f5554885a80c3dc87f4beed4 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:09.363636 12515 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.333868 12527 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.367811 12530 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:09.315133 12518 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.387044 12530 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:09.387660 12530 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:09.388104 12516 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:09.341241 12504 consensus_meta.cc:287] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:03:09.388739 12516 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:09.388965 12504 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.339213 12405 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:09.390038 12405 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:09.390506 12515 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.388276 12518 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:09.314659 12465 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:03:09.390587 12405 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.391396 12504 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.383697 12524 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:09.394098  8467 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:09.394706  8467 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:09.396265 12424 raft_consensus.cc:3055] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:09.396713 12424 raft_consensus.cc:740] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:09.342379 12412 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.395746  8467 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.415989 12405 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.393301 12524 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:09.351091 12500 raft_consensus.cc:3055] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:09.331278 12505 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.324719 12265 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.399940 12499 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:09.330056 12503 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.421209 12412 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.425002 12490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48eb2b2d1e724640bdcade4f8baa0375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.424751 12405 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:09.446509 12506 consensus_meta.cc:287] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.004s
I20260709 13:03:09.414223 12516 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.398339 12530 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.452865  8470 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:09.479409  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 172109us
W20260709 13:03:09.493268  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 256559us
I20260709 13:03:09.478868 12501 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.502723  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:09.505738  8391 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:03:09.477849 12500 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:09.509357  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.506705  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:09.491292 12499 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:09.509712  9032 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
W20260709 13:03:09.513972  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 181500us
I20260709 13:03:09.478404 12524 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.499887 12420 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:09.523510  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:09.526026  9064 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:09.518960  8507 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:09.519464  8468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.010s
I20260709 13:03:09.517603  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:09.538932  8468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.002s	sys 0.010s
I20260709 13:03:09.515693 12298 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:09.522198 12522 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:09.544513  8507 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.542457  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:09.545904  8470 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:09.495872 12506 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.511686 12502 consensus_queue.cc:1059] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:03:09.548732  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:09.549801  8390 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:09.522395 12511 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.527195 12530 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.555198  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:09.558736  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:09.516207 12501 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.525449 12536 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:09.562942  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.573740  8509 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:09.544485 12527 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:09.562863 12543 raft_consensus.cc:2804] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:09.524336 12460 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.580821 12405 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:09.581432 12405 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.581492 12420 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.582515 12460 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:09.583628 12405 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.583779 12527 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.584205 12405 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:09.584549 12527 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.579926  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.559177 12519 consensus_queue.cc:1059] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:03:09.541091 12466 consensus_queue.cc:1059] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:03:09.589406  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 63745us
I20260709 13:03:09.554857 12511 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.590814  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:09.590415  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:09.593226  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:09.599563  8470 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:09.594535  8538 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:09.600970  9033 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:09.577633 12418 raft_consensus.cc:2804] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:09.570360 12522 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:09.553155 12430 consensus_queue.cc:1059] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:03:09.554114 12534 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.603852  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.626916  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:09.596330 12443 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:09.590147 12286 consensus_meta.cc:287] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.661s	user 0.015s	sys 0.000s
I20260709 13:03:09.630316  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:09.596567 12511 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.638630  8387 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:03:09.552625 12298 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.608208 12538 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.640239  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.594491 12543 raft_consensus.cc:697] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:09.599426 12536 raft_consensus.cc:697] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:09.678584  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:09.622224 12358 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.631304 12423 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:09.698580  9032 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:09.599645 12412 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.712874  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:09.701579  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:09.637547 12418 raft_consensus.cc:697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:09.675041  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:09.677608 12514 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.594298 12537 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:03:09.560217 12499 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:03:09.708853  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 118629us
I20260709 13:03:09.719731  8544 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:09.677601 12443 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:09.703270 12420 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:09.696751 12503 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.708261 12423 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.708287 12358 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.745563  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:09.746289  8391 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:09.705578 12526 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.736796  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:09.706467 12533 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.725430 12496 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.723768 12539 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:09.700603 12442 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:03:09.731900 12405 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:09.760653  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:09.753235  8388 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:09.753223  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:09.754187  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:09.747663  8462 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:09.762079  8387 raft_consensus.cc:1275] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:03:09.733371 12505 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:09.760813  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:03:09.759037  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.752135  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:09.718940 12534 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:09.791422 12490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58882 (request call id 334) took 1607 ms. Trace:
I20260709 13:03:09.791666 12534 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.792223 12490 rpcz_store.cc:276] 0709 13:03:08.183706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.185303 (+  1597us) service_pool.cc:224] Handling call
0709 13:03:08.200202 (+ 14899us) ts_tablet_manager.cc:934] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
0709 13:03:09.423378 (+1223176us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:09.778685 (+355307us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:09.778864 (+   179us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:09.790302 (+ 11438us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:09.790759 (+   457us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:09.791210 (+   451us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:09.791306 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":88056,"tablet-copy.queue_time_us":13621,"thread_start_us":76636,"threads_started":2}
I20260709 13:03:09.794727 12490 tablet_copy_client.cc:806] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:09.795495 12490 tablet_copy_client.cc:670] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:09.761749  8392 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:09.758425  8394 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:09.796586  8391 raft_consensus.cc:1240] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:09.757616  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:09.756381 12430 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:03:09.736303 12527 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.765391  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:09.770465  8389 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:09.755043 12358 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:09.770947 12544 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:03:09.821185 12545 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:03:09.775146 12298 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:09.778785 12504 raft_consensus.cc:3055] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:09.780079 12529 raft_consensus.cc:3055] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:09.782229  8540 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:09.829993 12549 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.830181 12298 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.830931 12298 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:09.831753 12535 log.cc:927] Time spent T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:03:09.832197  8538 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:03:09.720603 12512 consensus_queue.cc:1059] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:03:09.761722 12533 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.833478 12298 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:09.830030 12504 raft_consensus.cc:740] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:09.835318 12533 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:09.835399 12504 consensus_queue.cc:260] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.836052  8470 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 11.
I20260709 13:03:09.835815 12358 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.836746 12504 raft_consensus.cc:3060] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:09.837239  8541 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 13: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:09.830173 12529 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:09.839259 12529 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.840379  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:09.789826 12539 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:09.839211 12358 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:09.840991  9064 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.755748 12496 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.768052 12532 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.795140 12536 consensus_queue.cc:237] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.763684  8387 raft_consensus.cc:1240] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:09.750067 12423 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:09.865975  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:09.866604  8539 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:09.817515  8535 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:09.769369 12522 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:09.871187 12546 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:03:09.872257  8358 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:09.873091 12405 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:09.873598 12405 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:09.861977 12496 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.874065 12501 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.874547 12405 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.877095 12460 raft_consensus.cc:3055] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:09.758661 12526 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.878248 12497 raft_consensus.cc:3055] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:09.878690 12497 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:09.879406 12526 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.879601 12497 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.790387 12543 consensus_queue.cc:237] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.880982 12497 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:09.786187 12418 consensus_queue.cc:237] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.861865  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:09.767491 12537 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.798904 12499 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.767078 12465 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.735754 12420 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:09.864010  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 152661us
I20260709 13:03:09.865434  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:09.869443 12506 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.840544 12529 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:09.863554 12533 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.864571 12539 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:09.862612  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 97311.3us
I20260709 13:03:09.884495  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:09.904227  8535 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:03:09.847816  8540 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:09.900488  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:09.899163  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:09.898247  8538 raft_consensus.cc:606] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:09.905802  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:09.877539 12460 raft_consensus.cc:740] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:09.902540  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:09.904414  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:09.839671 12443 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.908355  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:09.881042 12511 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.906667  8462 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:09.908355  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:09.911090  8463 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:09.911055  8358 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:09.914801  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:09.915686  8358 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:09.916397  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:09.917340  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 277171us
I20260709 13:03:09.919827  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:09.920315  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.909827  9032 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:09.924218  8433 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:09.922451 12442 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:09.925567 12442 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.926028 12442 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:09.927127 12505 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.927532 12505 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.927877 12505 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.929275  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:09.931775  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:09.935201 12420 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:09.935488 12424 consensus_queue.cc:260] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.936986 12424 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:09.937258 12511 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:09.939920  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.940461  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:09.943715  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
W20260709 13:03:09.944348  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.943745  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.950127  9064 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:09.953617  8509 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:09.940778 12378 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.958047 12560 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.942008 12430 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.948596 12554 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:09.963143 12554 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.963550 12507 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.964190  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:09.965389 12554 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:09.966889 12534 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:09.888294 12532 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.924129 12506 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:09.969143  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:09.903296 12496 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:09.971544  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:09.903452 12465 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:09.984659  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.989734  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 46100.7us
I20260709 13:03:09.994995  8469 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:09.922305 12549 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:09.991199 12552 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.181s	user 0.004s	sys 0.000s
I20260709 13:03:09.996395  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:09.897493 12537 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:09.948662 12515 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:10.000504  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 47005.2us
W20260709 13:03:09.990096  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46442.3us
I20260709 13:03:10.003737  8359 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.980793 12443 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.980531 12560 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.985301 12506 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:10.011034  8543 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 11: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:09.980645 12378 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:10.005834  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.988368 12554 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.007870 12507 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.005369 12420 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:10.017308  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:09.981845 12460 consensus_queue.cc:260] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.020882  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.021981  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.018435 12358 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:10.028003 12549 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.028538  8387 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:10.025223 12358 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.037919 12556 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.039125 12516 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:10.047056  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.051749  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.019546 12405 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:10.013404 12506 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:10.057579  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.062040  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.065333  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.014479 12554 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:10.067149  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.070356  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.071367 12556 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:10.073115  8359 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.060763 12501 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.074257 12556 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.075659 12560 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.075510 12558 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.075481 12564 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:10.076911  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.077302  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.078116 12564 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.078141 12556 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:10.078842 12532 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.079348 12509 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.079804 12509 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.080170 12509 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.019861 12515 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.084797  8359 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.079514  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:10.089270  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.088933  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.119702 12531 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.120172 12521 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:10.120817 12521 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
W20260709 13:03:10.121413 12562 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:10.069105 12507 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:10.124292  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:10.124943  8389 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:10.065923 12524 consensus_meta.cc:287] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
W20260709 13:03:10.125329  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 45893.7us
I20260709 13:03:10.064672 12378 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:10.048424 12420 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:10.130285  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:10.130908  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 116184us
I20260709 13:03:10.069823 12554 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.130746 12524 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.131515 12555 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:10.119453  8393 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:10.069309 12499 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:03:10.132812  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 48129.7us
I20260709 13:03:10.082864 12460 raft_consensus.cc:3060] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:10.082333 12553 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:10.134130  8508 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:10.134765  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.135857 12531 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.144825  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.146441  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.148743 12496 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.133689 12507 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.152765 12533 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.154901  8389 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:10.144207  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:10.160867  9032 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:10.161018  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:10.161593  8386 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.140305 12490 tablet_copy_client.cc:538] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:10.162166  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:10.146026 12548 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:10.139866 12442 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.143100 12555 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.178665 12543 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:10.177995 12534 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:10.163584 12423 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.168673  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.160332 12553 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:10.194821 12404 raft_consensus.cc:2804] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:10.194953 12521 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.189998 12420 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.146219 12465 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.146366 12497 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:10.159641 12430 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.162608 12496 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.252342 12496 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.252740 12496 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.254944 12490 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:03:10.208046 12509 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:10.214251 12551 log.cc:927] Time spent T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.409s	user 0.000s	sys 0.007s
I20260709 13:03:10.259248 12465 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:10.259922 12465 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.219091  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.220896 12505 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.184574 12500 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.262504 12358 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.262655 12500 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:10.239423 12534 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.266582 12534 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:10.228415  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 66323us
I20260709 13:03:10.229722  8463 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:10.232242  8391 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:10.268121 12524 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:10.239709 12418 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:10.269186 12418 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.270171  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.271755 12418 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.272032  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.272678 12524 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:10.168073  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.273880  8463 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:10.274194  8462 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:10.270164  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.276356 12505 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:10.276585 12506 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.236675  8386 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:10.162395 12378 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:10.243273  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:10.243973  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.243496 12553 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.279227  8468 raft_consensus.cc:3060] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.280534  8469 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:10.245546 12442 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:10.245935 12423 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:10.246414  9062 raft_consensus.cc:2368] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:03:10.227485 12543 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:10.241068  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:10.249436 12555 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.250078 12404 raft_consensus.cc:697] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:10.250958 12537 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:10.226272  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 61978us
I20260709 13:03:10.234035 12460 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:10.297753  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.298933  8465 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.237964  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.304415  8464 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.279253  9064 raft_consensus.cc:2393] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:03:10.285115  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.286273  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.305471  8538 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:10.306800  8539 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:10.287073  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:10.263749 12466 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:10.289117  8541 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:03:10.263789  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.295164  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:10.297254  9032 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.313341  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:10.313853  8542 raft_consensus.cc:2393] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:10.314241  9065 raft_consensus.cc:2368] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13.
I20260709 13:03:10.244346 12568 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.308646  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:10.315429  8539 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:10.309422  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:10.310671  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.316849  8466 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:10.321957  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.322687  8470 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.323532  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:10.290947 12543 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.327093  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:10.259281 12509 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.280781 12554 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.312608 12466 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:10.348224  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.320518 12568 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.350831  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.357311  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.358024  8389 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:10.351016  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:10.359256  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.322023 12511 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.311487 12524 consensus_queue.cc:1059] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:03:10.330683 12537 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:10.345026 12424 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.380177 12424 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.380632 12424 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.335881 12358 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:10.382398 12358 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.362875  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.382894  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:10.383347  8395 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:10.383545  8540 raft_consensus.cc:3060] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:10.373899 12537 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.384702 12537 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.365643  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.386307  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.367971  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.368654  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.388721  8468 raft_consensus.cc:2468] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:10.369808  8507 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.370599  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.390456  8391 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:10.372095  8536 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:03:10.393671  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:10.393981  8466 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:03:10.394387  8543 raft_consensus.cc:3060] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.361270  8387 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:10.378818 12524 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:10.378939  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.379437 12405 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:10.324791 12430 consensus_queue.cc:1048] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:03:10.367249  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:10.429574  8394 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.382906 12358 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:10.420859  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:10.449398  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:10.418210  8540 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
W20260709 13:03:10.419641  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 49937.3us
I20260709 13:03:10.442646 12465 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.427214 12524 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:10.452989  8465 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
W20260709 13:03:10.454715  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.455732  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:10.363641 12502 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:03:10.464887  8469 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:10.416241  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.456832  8465 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:10.426925 12534 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.473014  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:10.472909  8462 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:10.474587  8387 raft_consensus.cc:2368] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
W20260709 13:03:10.467053  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 148019us
I20260709 13:03:10.430080 12522 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:10.470382  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 51901.6us
I20260709 13:03:10.455487 12460 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:10.483520  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.484414  8466 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:10.484830 12568 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.382495 12466 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.487521 12559 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.487884 12466 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.488104 12559 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.469627 12496 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.425438 12501 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:03:10.491601  8469 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:10.492586  8465 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:10.497095  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.493736  8539 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:10.494758  8464 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:10.499346  8387 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:10.470098 12506 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:10.520444  8543 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 12.
W20260709 13:03:10.499564  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 171048us
I20260709 13:03:10.502084  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.422838 12404 consensus_queue.cc:237] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:10.536477  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.523487  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.540716  8507 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.523949  8465 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:03:10.543244  8470 raft_consensus.cc:2468] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 12.
I20260709 13:03:10.543349  8507 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.501616  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.518092  8469 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:10.518460 12553 raft_consensus.cc:3055] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:10.524405  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.531450  8435 leader_election.cc:400] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:03:10.550853  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.548885  8394 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:10.544428  8463 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 6: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:10.551117  8435 leader_election.cc:403] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:03:10.552275  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 52126.5us
I20260709 13:03:10.552960  8462 raft_consensus.cc:2393] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:10.538776 12509 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.554695  8507 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.554888  8463 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:10.544401  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.557163  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.558041  8469 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:10.561682  8470 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:10.563668  8470 raft_consensus.cc:1275] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:10.556030 12418 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.566882 12418 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:10.567826 12509 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:10.495941 12378 consensus_queue.cc:1175] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:10.495239 12559 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.512984 12460 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:10.559669 12536 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9.
I20260709 13:03:10.594504  8467 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.594710  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:10.594969 12460 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.575325  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.477764 12534 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.596572  8465 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:10.575642  9033 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:10.551376 12518 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.573629 12525 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.608458  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 50369.9us
I20260709 13:03:10.609433  8467 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:10.610162  9032 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
W20260709 13:03:10.577220  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.577809  8469 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:10.577961 12572 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:03:10.531509 12496 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:10.560667 12512 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.553016 12521 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:10.550508 12553 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:10.583900  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.538854 12524 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.517685 12554 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.584791 12543 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.589152 12537 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.604158  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:10.615651  8465 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:10.616163 12527 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:10.616518 12358 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.621307  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 598) took 1637 ms. Trace:
I20260709 13:03:10.640100  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:10.640949  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 83350.9us
I20260709 13:03:10.621129  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:10.570811 12509 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.620784  8360 leader_election.cc:400] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13.
I20260709 13:03:10.643626  8360 leader_election.cc:403] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:10.639894  8467 rpcz_store.cc:276] 0709 13:03:08.973167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.973562 (+   395us) service_pool.cc:224] Handling call
0709 13:03:08.973865 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.393978 (+420113us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b540008f5a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe1345edc0 00007fbe134e91c0 00007fbe134ea231 00007fbe134e6d8f 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c
0709 13:03:09.956084 (+562106us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b540008f5a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe1345ca1d 00007fbe134431a4 00007fbe134c5447 00007fbe134ddfe7 00007fbe134df7de 00007fbe134e9b49 00007fbe134ea416 00007fbe134e6d8f 00007fbe134e683e 00007fbe184ab419
0709 13:03:10.594150 (+638066us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b58004a15d0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134430aa 00007fbe134c5447 00007fbe134ddfe7 00007fbe134df7de 00007fbe134e9b49 00007fbe134ea416 00007fbe134e6d8f 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4
0709 13:03:10.609941 (+ 15791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.610182 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892143872}
I20260709 13:03:10.644675  8470 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:03:10.622684 12468 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:03:10.637243  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 61674.5us
I20260709 13:03:10.642241  8394 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.642644  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.646997  8386 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:10.647614  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:10.628261  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 2203) took 1073 ms. Trace:
I20260709 13:03:10.644833  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.650060  8536 rpcz_store.cc:276] 0709 13:03:09.554704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.554937 (+   233us) service_pool.cc:224] Handling call
0709 13:03:10.628055 (+1073118us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400030554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:10.628175 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687709568}
I20260709 13:03:10.650673  8387 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:10.654652  8535 raft_consensus.cc:1240] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:10.666450  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.712872  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.713722  8391 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:03:10.621639 12525 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.715314  8433 leader_election.cc:400] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:03:10.643380 12466 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:10.722756  8433 leader_election.cc:403] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:03:10.729341  8394 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:10.735890  8507 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:03:10.736181  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 68038.2us
I20260709 13:03:10.737335  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.741232  8466 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:10.742075  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:10.650681 12527 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:10.653272 12519 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.712862 12556 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.713485 12572 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.713430 12512 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.752180  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.740887 12532 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.742105 12539 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10.
I20260709 13:03:10.714996 12424 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.749728 12406 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:10.773360 12443 consensus_queue.cc:1059] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:10.774801 12443 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:10.742789  8507 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:10.650720 12581 raft_consensus.cc:2804] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:10.775260 12443 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:10.775902 12581 raft_consensus.cc:697] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:10.776229 12443 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.778311 12527 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.779035 12525 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:10.763065 12358 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.760097 12534 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:10.782344 12582 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:03:10.783321 12424 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.754128 12572 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.786000 12572 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.746063 12553 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.788362 12406 raft_consensus.cc:697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:10.789386 12406 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.756953 12512 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.792028 12512 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.755261 12532 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.799103 12532 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.802806 12537 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.747368 12500 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:03:10.804494 12500 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:10.804984 12500 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:10.805990 12500 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.807575 12500 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.811059 12543 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:10.798430 12443 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:10.833802  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67300.1us
I20260709 13:03:10.842686 12405 consensus_queue.cc:1059] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:10.834888  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.863240 12516 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:10.863425  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:10.866900  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:10.867770  8391 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:10.870069 12584 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:10.870657 12584 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.874002  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:10.875121  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 132364us
I20260709 13:03:10.777084 12581 consensus_queue.cc:237] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:10.879812  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:10.859391 12405 raft_consensus.cc:3055] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:10.871064 12584 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.892625 12534 consensus_queue.cc:1059] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:03:10.906769 12534 raft_consensus.cc:3055] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:10.907270 12534 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:10.908321 12534 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.893893 12507 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:03:10.894070 12549 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.911067 12549 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.911599 12549 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.878419 12442 consensus_queue.cc:1059] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:03:10.914717 12442 raft_consensus.cc:3055] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:10.915184 12442 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:10.885162 12516 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:10.884914 12405 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:10.917503 12405 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:10.919224 12405 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.902637  8391 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:10.892542  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:10.936062  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 43732.6us
W20260709 13:03:10.937139  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.937496  8467 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:10.936667  9032 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:03:10.956568  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.983637  8507 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:10.963366  8465 raft_consensus.cc:1275] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:10.941674  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:10.963917  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.013345  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:11.014025  8468 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:11.015015  8539 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:11.016882  8539 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:11.017735  8542 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:11.019052  8542 raft_consensus.cc:1240] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:11.019134  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:11.019385  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:11.019964  8544 raft_consensus.cc:2393] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:03:11.020334  8542 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:10.972891 12502 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:11.021749  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:11.025369  8541 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.938282 12534 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.943492  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.939543 12515 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:11.030360 12549 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.029605  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:10.948202 12406 raft_consensus.cc:2804] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:10.985770 12521 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.046417  8465 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.072194  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.940713 12537 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:10.942051 12554 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.077891  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:11.079272  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:11.079857  8391 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.080250  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:11.034039  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.049469 12556 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13.
I20260709 13:03:11.052390 12584 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.054569  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:10.938057 12536 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:03:11.044672 12502 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:11.082878  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49058.6us
I20260709 13:03:11.082942  8468 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:11.083657  8541 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:11.043576  8461 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:03:11.021574 12358 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:11.086141  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:11.105288  8538 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:11.105734  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:11.059871 12549 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:11.106469  8395 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:11.034008 12565 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:10.962692 12507 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:03:11.096493  8391 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:11.091326  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:11.098424  8462 raft_consensus.cc:2393] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:11.104417  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:11.087666  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:11.109723  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.085665 12406 raft_consensus.cc:697] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:10.970206 12442 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.090417 12509 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.116886  8544 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:11.122507  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.118808  8433 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:11.090342 12554 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.126684  8392 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:11.107427 12556 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.091521 12537 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:11.112528 12565 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.142890  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:11.168320 12584 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:11.169338 12406 consensus_queue.cc:237] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:11.171290 12565 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.142437 12556 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:11.143657 12586 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:11.139519 12430 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:11.147854 12500 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:11.149106  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:11.150604 12537 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:11.152864  8465 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:11.132139 12549 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:11.158449 12298 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:11.159874 12532 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.113070 12521 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:11.172819  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 231255us
I20260709 13:03:11.127323 12512 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:11.177537  8544 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:11.180493  8542 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:11.133761 12515 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:11.109457 12358 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:11.192519  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 43584.5us
I20260709 13:03:11.131539 12572 consensus_queue.cc:1048] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:03:11.199640  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.201676  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:11.215256  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.205420 12521 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:11.218784 12521 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.219937 12358 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:11.193382 12442 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.222587  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:11.226615  8388 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:11.196173 12557 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.230396  8358 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.231736  8462 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:11.242093 12515 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.223016 12549 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:11.265246  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 118140us
I20260709 13:03:11.249166 12502 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:11.272444 12500 consensus_queue.cc:1059] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:03:11.274425 12598 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:11.275063 12598 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.277335 12598 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:11.279245 12405 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:11.280179  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:11.280997  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:11.281272  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.281277  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:11.282195 12591 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:11.286614 12358 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:11.287153 12468 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.287220 12358 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:11.281440 12598 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:11.287842 12468 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.288399 12358 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.265028 12597 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:11.289812  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:11.292404 12506 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.292929 12506 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.293992 12298 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:11.294828  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:11.294571 12298 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:11.305346  8387 raft_consensus.cc:2393] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:11.259065 12549 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:11.263017 12556 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:11.316591  8462 raft_consensus.cc:1275] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:11.318634  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:11.319435  8387 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.291263 12597 raft_consensus.cc:697] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:11.334556 12597 consensus_queue.cc:237] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.306248 12599 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:03:11.326467 12490 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:11.349398  8387 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:11.353426 12549 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.355036 12586 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:11.357227 12506 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:11.307009 12518 consensus_queue.cc:1048] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:03:11.340201 12468 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:11.366909 12554 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:11.374465 12532 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:11.351716 12599 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:11.383145 12298 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:11.390033  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:11.394713 12571 raft_consensus.cc:993] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:11.404139  8391 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:03:11.412112  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 102899us
I20260709 13:03:11.372316 12565 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.419378  8388 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:11.438691  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:11.439669  8462 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:11.443511  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:11.446265 12571 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:11.446997 12571 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:11.448212 12571 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.451614 12581 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:11.453665 12591 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:11.454097 12591 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:11.455051  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:11.455814  8467 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:11.458065  9062 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:11.460141 12567 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:11.462437 12524 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.461501  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:11.466131  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:11.467559  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:11.478454  8391 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:11.482370  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.485929  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:11.486130  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:11.487452  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.488090  8388 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:11.488435  8541 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:11.489259  8391 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:11.490260 12557 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:11.490460 12553 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:11.492010  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:11.492331  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:11.492889  8465 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:11.497625  8393 raft_consensus.cc:1275] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:11.498766  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.500238  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.500867  8470 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:11.501622  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.502285  8391 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:11.526064  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.508821  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:11.503232  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:11.533340  8388 raft_consensus.cc:3060] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:03:11.534503  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 91053.4us
I20260709 13:03:11.504765  8395 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:11.507684  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.550956 12567 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:11.551941  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 44339.8us
I20260709 13:03:11.552681  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.553474 12567 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:11.555666  8537 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:11.560913  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:11.527420  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:11.564962 12468 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:11.566100 12557 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:11.566555 12557 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:11.567495 12557 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.527247  8293 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 9 to 10, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 10 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:11.578055  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 98989.5us
I20260709 13:03:11.578711  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.412519 12516 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:11.580818  8433 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:11.584810  8462 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:11.454842 12591 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.587446  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.588603 12443 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:03:11.632304  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 911705us
W20260709 13:03:11.633430  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46101.9us
I20260709 13:03:11.581835 12501 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:03:11.421312 12298 raft_consensus.cc:1081] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:11.580366  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.599676 12531 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:11.612622  8394 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:11.581944 12518 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:11.643273  8508 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:11.643615  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:11.653041  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 72869.6us
W20260709 13:03:11.644028 12534 consensus_meta.cc:287] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.595s	user 0.004s	sys 0.004s
I20260709 13:03:11.595063  8388 raft_consensus.cc:2468] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:11.664515 12597 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:11.634048 12557 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.654600 12525 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:11.673866  8507 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:11.651712 12595 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:11.696336  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 282077us
I20260709 13:03:11.657272 12571 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:11.700804  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.738730  8507 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:11.666640 12424 raft_consensus.cc:2804] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:11.744527  8507 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.674588 12597 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.696393 12506 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:11.740021 12537 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.797068  8507 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:11.675463 12420 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
W20260709 13:03:11.806562  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 391203us
I20260709 13:03:11.751296 12521 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:11.772819 12597 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.748939 12571 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:11.697752 12518 consensus_queue.cc:1048] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:03:11.742709 12600 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:11.832428  8391 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:11.800613 12532 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:11.829308 12613 log.cc:927] Time spent T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:03:11.799854 12424 raft_consensus.cc:697] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:11.856048  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:11.868872  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 225308us
I20260709 13:03:11.861153  8544 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:11.887804  8391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:11.888406  8391 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.888767  8391 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.841389 12554 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:11.892616  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:11.837954 12600 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:11.893327  8395 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.828132 12543 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:03:11.899883 12516 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.901165  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:11.843533 12537 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:03:11.885066 12612 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.145s	user 0.000s	sys 0.002s
I20260709 13:03:11.913720  8465 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:11.915146  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 162698us
I20260709 13:03:11.887101 12565 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:11.910961 12608 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.287s	user 0.002s	sys 0.000s
I20260709 13:03:11.940258  8544 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:11.902486 12600 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.902714 12599 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:11.930148 12512 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:03:11.959518  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 104826us
W20260709 13:03:11.947222 12609 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.316s	user 0.002s	sys 0.000s
W20260709 13:03:11.991403 12618 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:03:11.953984 12424 consensus_queue.cc:237] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:11.997922 12512 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.000180 12512 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:12.008188 12616 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:03:12.011986 12622 log.cc:927] Time spent T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:03:12.014564 12619 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:03:11.930392 12537 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.018095 12537 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:11.975020  8465 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:11.841969 12526 consensus_queue.cc:1048] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
W20260709 13:03:12.033105  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 50851.1us
I20260709 13:03:11.966334  8391 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.045641  8395 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:12.047572  8508 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:11.931267 12516 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.064652 12543 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:11.987691 12628 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:03:12.071887  8391 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.072767 12624 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:12.075590 12516 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:11.959892 12571 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:12.132133  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.107278 12553 consensus_meta.cc:287] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.007s
I20260709 13:03:12.100868 12543 raft_consensus.cc:697] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:12.155014  8390 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:12.144100 12625 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:03:12.156626 12630 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.167840 12630 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.168641  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 1923) took 1298 ms. Trace:
I20260709 13:03:12.169072  8394 rpcz_store.cc:276] 0709 13:03:10.869747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.933122 (+ 63375us) service_pool.cc:224] Handling call
0709 13:03:10.933456 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.655255 (+721799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.168368 (+513113us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400118ad4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:12.168559 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547541248}
W20260709 13:03:12.155517  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 69802.2us
I20260709 13:03:12.132578 12378 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.148191 12539 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:12.143373 12536 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.132570 12430 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.172447  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 120690us
I20260709 13:03:12.178598  8390 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:12.184962 12430 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.178129 12536 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.177224 12539 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:12.177714 12378 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:12.189549 12637 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:03:12.198096  8543 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:12.208675 12430 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.192385 12543 consensus_queue.cc:237] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.211337  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:12.211869 12536 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.149379 12631 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:12.222636 12527 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:12.232770  8465 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:03:12.204610 12442 consensus_meta.cc:287] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.970s	user 0.011s	sys 0.002s
I20260709 13:03:12.205681 12630 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.243147  8393 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:12.244971 12536 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:12.245564 12516 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.246119 12516 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.255028  8360 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:12.278283  8461 raft_consensus.cc:1275] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:12.253924 12500 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.300541  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:12.300937  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.301805  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:12.302309  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.302601  8535 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:12.303447  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.304200  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:12.305305  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.306164  8387 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:12.304356  8395 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:12.312630  8469 raft_consensus.cc:1275] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:12.290692 12597 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:12.261893 12442 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:12.318504  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:12.332211 12525 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:12.332902 12638 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.333925 12646 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:03:12.318369 12539 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:12.235270 12631 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:12.392442  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 143039us
W20260709 13:03:12.393289  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55970.5us
W20260709 13:03:12.394145  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 72167.9us
I20260709 13:03:12.396085  8389 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:12.403558 12656 log.cc:927] Time spent T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:03:12.336469 12423 consensus_queue.cc:1048] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:03:12.406862 12490 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:12.426223  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:12.396894 12525 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.430027 12586 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:12.408795 12638 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.319552 12500 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:12.449949 12515 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.450003 12556 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.450659 12515 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.450763 12556 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.453194 12556 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:12.430056 12611 log.cc:927] Time spent T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.623s	user 0.004s	sys 0.000s
W20260709 13:03:12.476670  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 59555.8us
I20260709 13:03:12.453734 12515 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.496778  8462 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:12.492422  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:12.500025 12597 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.502007 12641 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.502872 12641 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.503153 12525 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.472271 12651 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.454828 12556 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:03:12.522145 12638 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.523136 12511 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:12.528066 12572 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:12.528644 12572 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:12.531276 12631 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:12.531587 12572 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:12.535420  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:12.538940  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 46650.9us
I20260709 13:03:12.571401  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.570611  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:12.575191  9033 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:12.538583 12539 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:12.542896  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:12.546128 12557 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:12.567812 12600 consensus_meta.cc:287] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.001s
I20260709 13:03:12.566776 12556 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.594014  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:12.582388 12557 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.583546 12526 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:12.600555 12668 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:12.538252 12651 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.607324 12466 raft_consensus.cc:3055] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:12.605518  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3164) took 1110 ms. Trace:
I20260709 13:03:12.587687 12600 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.595235 12556 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.623939 12466 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:12.585320 12539 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.616065 12557 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:12.621831 12549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.021s	sys 0.029s
I20260709 13:03:12.631681 12506 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:12.624624  8393 rpcz_store.cc:276] 0709 13:03:11.495398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.498508 (+  3110us) service_pool.cc:224] Handling call
0709 13:03:12.605330 (+1106822us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400335c54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:12.605432 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710435712}
I20260709 13:03:12.619760 12668 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.745245 12500 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:12.754084 12630 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:12.754750 12630 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.756615 12507 raft_consensus.cc:3055] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:12.743536 12549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.022s	sys 0.029s
I20260709 13:03:12.757206 12507 raft_consensus.cc:740] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:12.762018  8462 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:12.762240  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.767060  8462 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:12.759142  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:12.770397  8463 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:12.739962 12442 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.792575  8468 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:12.795631  8468 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:12.798409  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.799278  8466 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 12: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:12.786057  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.746151 12668 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:12.758371 12507 consensus_queue.cc:260] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.821132 12507 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.800166 12641 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.801075 12442 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:12.838455 12490 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
I20260709 13:03:12.846324 12600 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:12.802688 12298 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:03:12.804975 12466 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.856048 12539 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.812857 12636 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:03:12.858671 12651 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.809888 12633 consensus_queue.cc:1048] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:03:12.800873 12420 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:03:12.817692 12525 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:12.873951  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 125191us
I20260709 13:03:12.879168  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:12.884100  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.884853  8393 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:12.887902  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.888885  8393 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:12.889423  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.889906  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.871490 12501 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:12.895036  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.894852  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:12.896544  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:12.900193  8394 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.903894  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:12.904567  8463 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:12.878625 12466 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:12.905043  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.908326  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.909139  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:12.910501  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 107148us
I20260709 13:03:12.908964  8468 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:12.913811  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.914435  8468 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:12.894224 12539 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:12.916066 12539 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:12.916461 12539 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.916808 12539 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:12.917446  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:12.915323  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.923341  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:12.923961  8468 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.934072  8466 raft_consensus.cc:1275] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:12.894531 12525 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.928009 12539 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:12.935334  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 137258us
I20260709 13:03:12.902434 12556 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:12.909884 12490 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:03:12.904194 12506 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:12.950094  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:12.950822  8466 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:12.950336  8468 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 15.
W20260709 13:03:12.957819  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 141752us
I20260709 13:03:12.958117  8394 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:12.903743 12501 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.980715  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:12.981624  8536 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:12.986924  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:12.987581  8537 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:12.987936  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:12.989967  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:12.990619  8537 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:03:12.959766 12636 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:03:12.944589 12525 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:12.982396 12490 tablet_bootstrap.cc:492] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:03:13.018309  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:12.984619 12629 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.020558  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 103392us
I20260709 13:03:12.985533  8282 maintenance_manager.cc:419] P 9c29a936330e465e8f9c7de5c6f8056b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033335
I20260709 13:03:13.023104  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:12.955972 12506 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.027989  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:12.996951 12651 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.005012 12641 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:13.032943  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.030582 12655 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:13.036602  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:13.033605 12651 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.025576 12420 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:03:13.047358  8359 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.040129 12490 ts_tablet_manager.cc:1403] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 2.785s	user 0.070s	sys 0.009s
W20260709 13:03:13.039266 12672 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:03:13.038179 12651 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:13.064497 12671 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:03:13.068344 12516 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.075209 12501 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.076071 12539 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:13.076318 12664 log.cc:927] Time spent T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:03:13.077778  8386 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:13.081003 12506 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.085593  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3172) took 1198 ms. Trace:
I20260709 13:03:13.041050 12500 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.090301  8463 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:13.038322 12556 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:13.041190 12523 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:13.035866 12442 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:13.026691 12629 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:13.063944 12676 log.cc:927] Time spent T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:03:13.094897  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:13.035465 12641 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.097608 12525 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.097903 12686 consensus_queue.cc:1048] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:13.098382 12507 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.128006 12507 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.128404  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:13.129072 12629 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.130553 12685 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:13.130852 12525 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:13.131016 12685 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.131425 12685 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:13.128436 12507 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.118316 12298 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.041285 12655 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:03:13.111543  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 149356us
I20260709 13:03:13.113070  8389 rpcz_store.cc:276] 0709 13:03:11.887544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.889697 (+  2153us) service_pool.cc:224] Handling call
0709 13:03:11.890047 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.415961 (+525914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.085324 (+669363us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540035a554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:13.085524 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163312896}
W20260709 13:03:13.124985  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 77751.2us
I20260709 13:03:13.040804  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:13.135040  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:13.136238  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.119833 12523 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.119999 12556 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.101688 12557 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.137292  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.139037  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.139206  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.145166  8389 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 5.
I20260709 13:03:13.145364  8359 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.114967 12668 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.146404 12525 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.144136 12523 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.144289 12556 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.147583 12655 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.138413  8508 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:13.130596 12641 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.154829  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.162424  8464 raft_consensus.cc:2368] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14.
I20260709 13:03:13.156157  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.163584  8463 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:13.160835 12525 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.156388  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.158298 12509 raft_consensus.cc:493] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.165961 12509 raft_consensus.cc:515] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:13.167544  8461 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:13.168656  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:13.169314  8391 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.159013  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.169503  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.163275 12679 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.159597 12686 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:13.155167 12629 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:13.139690 12298 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.166424 12525 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.167178  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.170329  8389 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:13.172617  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:13.182461  8463 raft_consensus.cc:2368] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11.
I20260709 13:03:13.182924  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.162114 12668 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.188576 12442 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:13.189065 12442 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.189430 12442 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:13.184062 12629 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:13.177436 12679 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:13.195366 12679 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.198948  8391 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:13.198048 12506 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.199357  8463 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:13.204345 12679 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:13.179625 12686 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:13.221760 12687 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:13.223549 12687 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:13.205127 12506 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.231000 12506 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.203913 12298 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:13.204632 12509 leader_election.cc:290] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:13.230072 12687 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:13.269222  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:13.269093  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.271714  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 64880.5us
I20260709 13:03:13.281020  8508 leader_election.cc:400] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11.
I20260709 13:03:13.281464  8508 leader_election.cc:403] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:03:13.282068 12298 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:13.287823  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.289346  8507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.193:35967 timed out after 1.806s (SENT) [suppressed 2 similar messages]
I20260709 13:03:13.292367  8540 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:03:13.294653  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.295331  8391 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:13.295394  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:13.296530 12670 log.cc:927] Time spent T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.558s	user 0.003s	sys 0.000s
I20260709 13:03:13.291086 12679 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:03:13.300253  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 508) took 1045 ms. Trace:
I20260709 13:03:13.276576 12430 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:13.300663  8392 rpcz_store.cc:276] 0709 13:03:12.254572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.256487 (+  1915us) service_pool.cc:224] Handling call
0709 13:03:12.256910 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.471354 (+214444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.471390 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.472993 (+  1603us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.571462 (+ 98469us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:12.571504 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.071749 (+500245us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540010ca54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:13.071806 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.295823 (+224017us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:03:13.300085 (+  4262us) raft_consensus.cc:1685] finished
0709 13:03:13.300100 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.300208 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5710,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":17416,"spinlock_wait_cycles":498241792,"thread_start_us":27251,"threads_started":1,"wal-append.queue_time_us":107267}
I20260709 13:03:13.305294  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.300964  8435 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:13.290349 12378 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:13.310344  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:13.310910 12667 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.745s	user 0.002s	sys 0.000s
I20260709 13:03:13.311686  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.312654  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 625) took 1037 ms. Trace:
I20260709 13:03:13.314183  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:13.313014  8465 rpcz_store.cc:276] 0709 13:03:12.275335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.275525 (+   190us) service_pool.cc:224] Handling call
0709 13:03:12.275917 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.397520 (+121603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.397575 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.407500 (+  9925us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.564881 (+157381us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:12.579492 (+ 14611us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.602150 (+ 22658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.602240 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.310254 (+708014us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:03:13.312368 (+  2114us) raft_consensus.cc:1685] finished
0709 13:03:13.312480 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.312603 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124646,"prepare.queue_time_us":11062,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":87058,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":49385,"spinlock_wait_cycles":12961024,"thread_start_us":189951,"threads_started":2,"wal-append.queue_time_us":141548}
I20260709 13:03:13.314764  8393 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.316972 12630 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.318611  8359 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.320658 12430 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:13.306018  8392 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:13.321192  8508 leader_election.cc:400] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14.
I20260709 13:03:13.284905 12686 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.195701 12629 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:13.302894 12501 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:13.338155  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:13.373276  8392 raft_consensus.cc:2368] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11.
I20260709 13:03:13.341449  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.298995 12651 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.330170  8508 leader_election.cc:403] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:13.329717  8393 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:13.378787 12430 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.341595 12378 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:13.381723  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.402066  8392 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:13.384229  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.391175 12500 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.405017 12500 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.405452 12500 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:13.376132  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 86807.7us
W20260709 13:03:13.404479  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 81059.9us
I20260709 13:03:13.411578  8393 raft_consensus.cc:1275] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:03:13.413563  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 92503.7us
I20260709 13:03:13.416847  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.424510 12532 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.410409 12692 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.437099  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 97096.3us
I20260709 13:03:13.439105 12507 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.442215 12507 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.444566 12507 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:13.446417  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:13.452310  8461 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 12: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:13.447662  8463 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:13.385897 12501 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.454622  8388 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:13.430481 12641 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:13.424021 12500 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.476225  8469 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:13.478790 12557 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.451159 12490 raft_consensus.cc:359] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 12 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.462405 12701 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:13.467391 12641 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:13.470598 12543 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:03:13.490607 12641 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.491154 12543 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:13.491564 12543 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:13.492416 12543 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.493372 12543 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.455790 12507 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.450903 12692 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.507097  8465 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:13.505056 12496 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:13.509843 12496 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:13.512065  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:13.513103  8393 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:13.517342 12496 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.519651  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.521026  8393 raft_consensus.cc:2368] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12.
I20260709 13:03:13.476016 12442 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.524086  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.482093 12685 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.493973 12701 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.486048 12567 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:13.526429  8469 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:13.517418 12501 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.550478 12490 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:03:13.551486 12490 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:13.554886 12298 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11.
I20260709 13:03:13.558128  8467 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:03:13.561285  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.564388 12591 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.568699 12698 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:13.556377 12501 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.580614  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:13.553527 12523 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.560316 12651 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.594857 12692 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:13.598382 12507 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.588114 12501 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.599722  8387 raft_consensus.cc:2393] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:13.599229 12523 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.601171 12500 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:13.602560 12706 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:13.569388 12698 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:13.612316  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.613044  8463 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:13.614243  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.616098 12501 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.618299  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.620559 12490 ts_tablet_manager.cc:1434] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.529s	user 0.012s	sys 0.003s
W20260709 13:03:13.621011 12490 ts_tablet_manager.cc:1467] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Tablet startup took 529ms
I20260709 13:03:13.615475  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:03:13.644697  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.660840  8463 raft_consensus.cc:2393] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:03:13.607548 12704 log.cc:927] Time spent T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:03:13.585453 12686 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:13.651947  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 222397us
I20260709 13:03:13.610898 12655 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.682585 12695 log.cc:927] Time spent T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:03:13.687778 12701 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.689881  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.691020  8468 raft_consensus.cc:2410] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:13.691164 12567 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:13.691059 12687 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.698086  8464 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:13.692691 12567 consensus_queue.cc:1243] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer 2122d8c723e84e3da22f81f7eeb4b1a9 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:13.608733 12698 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:13.660226 12692 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:03:13.671892 12556 consensus_meta.cc:287] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.016s
I20260709 13:03:13.668474 12679 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:13.716434  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:13.718066  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.716643  8507 leader_election.cc:400] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11.
I20260709 13:03:13.677981 12686 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.721866 12686 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:13.725164 12673 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.742s	user 0.000s	sys 0.002s
I20260709 13:03:13.732388 12442 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.714674 12298 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:03:13.735157 12597 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.726266 12556 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.735884 12597 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.740128  8433 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:13.742166 12532 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14.
I20260709 13:03:13.743129  8391 raft_consensus.cc:2368] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 12. Current term is 13.
I20260709 13:03:13.742972 12466 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:13.743721 12466 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:13.747105 12466 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.747598 12687 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:13.621400 12490 ts_tablet_manager.cc:1469] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Trace:
0709 13:03:08.183706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.185303 (+  1597us) service_pool.cc:224] Handling call
0709 13:03:08.200202 (+ 14899us) ts_tablet_manager.cc:934] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967)
0709 13:03:09.423378 (+1223176us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:09.778685 (+355307us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:09.778864 (+   179us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:09.790302 (+ 11438us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:09.790759 (+   457us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:09.791210 (+   451us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:09.791306 (+    96us) inbound_call.cc:177] Queueing success response
0709 13:03:10.254561 (+463255us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:03:13.091068 (+2836507us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:03:13.205287 (+114219us) tablet_replica.cc:261] Starting instrumentation
0709 13:03:13.272594 (+ 67307us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":88056,"raft.queue_time_us":3039,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"tablet-copy.queue_time_us":13621,"tablet-download-pool.queue_time_us":30527,"tablet-download-pool.run_cpu_time_us":1358,"tablet-download-pool.run_wall_time_us":305510,"thread_start_us":76636,"threads_started":2}
I20260709 13:03:13.709234 12655 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.753293 12655 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:13.754074 12506 consensus_meta.cc:287] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.522s	user 0.014s	sys 0.001s
I20260709 13:03:13.754544 12506 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.755290 12556 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:13.755359 12705 log.cc:927] Time spent T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:13.755717  8461 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 12: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:13.763865  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:13.764554  8461 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.757083 12506 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.757203 12509 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:13.760912 12466 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.776015  8461 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:13.744385 12679 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.774664 12567 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:13.788921  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:13.775699 12509 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:13.789953  8461 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:13.744632 12692 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.787420 12679 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:13.791909 12707 log.cc:927] Time spent T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:03:13.813135  8461 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
W20260709 13:03:13.823424  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.826325 12692 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:13.834551 12698 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.792533 12522 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:13.836961  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.798200 12567 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:13.844765 12698 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.844966 12567 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:13.844537 12509 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.848321  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 635) took 1353 ms. Trace:
I20260709 13:03:13.848915  8470 rpcz_store.cc:276] 0709 13:03:12.494977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.496280 (+  1303us) service_pool.cc:224] Handling call
0709 13:03:12.496751 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.596992 (+100241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.597044 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.531703 (+934659us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b2c00040298. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11de0a11 00007fbe11df0372 00007fbe13522a01 00007fbe134e743a 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:03:13.537841 (+  6138us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.661345 (+123504us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:13.661383 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.661451 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.847992 (+186541us) raft_consensus.cc:1685] finished
0709 13:03:13.848013 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.848246 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43027,"raft.queue_time_us":77221,"spinlock_wait_cycles":19688448,"thread_start_us":166374,"threads_started":2,"wal-append.queue_time_us":280130}
I20260709 13:03:13.851315  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:13.840240 12466 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:13.853986  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.841657 12522 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:03:13.852845  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 133163us
I20260709 13:03:13.856879  8507 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:13.862350 12710 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:13.850651 12698 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:13.854701 12509 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.886260 12522 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.887290 12522 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.868031  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.890267  8470 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:13.893049  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:13.896823  8389 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:13.897385  8468 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:13.894658 12692 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 13:03:13.897917  8390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3148) took 2684 ms (client timeout 2419 ms). Trace:
W20260709 13:03:13.900851  8390 rpcz_store.cc:269] 0709 13:03:11.212380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.294574 (+ 82194us) service_pool.cc:224] Handling call
0709 13:03:13.896373 (+2601799us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54003f7354. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:13.896467 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976921472}
I20260709 13:03:13.898159 12358 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:12.885933  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:13.888057 12698 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:13.913856 12698 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:13.920780 12689 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:13.921350 12689 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.923619 12689 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.924170 12689 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:13.924665 12689 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:13.928460 12689 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:13.931613  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49334 (request call id 1853) took 1631 ms. Trace:
I20260709 13:03:13.932547  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:13.942718  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:13.947870  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 53642.8us
I20260709 13:03:13.960063  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 247) took 3591 ms. Trace:
W20260709 13:03:13.970064  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 102095us
I20260709 13:03:13.970396  8507 leader_election.cc:400] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12.
I20260709 13:03:13.970705  8507 leader_election.cc:403] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:13.932085  8540 rpcz_store.cc:276] 0709 13:03:12.299921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.305656 (+  5735us) service_pool.cc:224] Handling call
0709 13:03:12.306084 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.292833 (+986749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.931325 (+638492us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b5400040e54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:13.931545 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267670400}
I20260709 13:03:13.977007  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:13.941468  8289 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 8 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 10 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.981774  8289 catalog_manager.cc:5697] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 8 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 10 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.987190 12720 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:03:13.989876 12672 log.cc:927] Time spent T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:13.993964  8395 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:13.995843  8386 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:13.996547  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:14.010206  8392 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:13.997272  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:13.997915  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:14.012408  8390 raft_consensus.cc:2376] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10. Re-sending same reply.
I20260709 13:03:13.998523  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:14.013603  8394 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
I20260709 13:03:13.955559 12549 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.000980  8405 tablet_copy_service.cc:342] P 2122d8c723e84e3da22f81f7eeb4b1a9: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-48eb2b2d1e724640bdcade4f8baa0375 received from {username='slave'} at 127.0.0.1:60598
I20260709 13:03:14.016798 12549 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.017351  8405 tablet_copy_service.cc:434] P 2122d8c723e84e3da22f81f7eeb4b1a9: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-48eb2b2d1e724640bdcade4f8baa0375 on tablet 48eb2b2d1e724640bdcade4f8baa0375 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:14.018541 12720 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:14.019057 12549 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:14.028563  8467 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:13.998605 12718 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:14.001194 12681 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.020828 12720 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:13.979348 12710 consensus_queue.cc:1048] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:03:13.960721  8293 rpcz_store.cc:276] 0709 13:03:10.315420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.324705 (+  9285us) service_pool.cc:224] Handling call
0709 13:03:13.906651 (+3581946us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:11.959450 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:12.019520 (+ 60070us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:12.019570 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:03:12.019591 (+    21us) tablet.cc:662] Decoding operations
0709 13:03:12.020029 (+   438us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:12.020103 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:12.020142 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:12.020335 (+   193us) tablet.cc:701] Row locks acquired
0709 13:03:12.020360 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:03:12.020557 (+   197us) write_op.cc:270] Start()
0709 13:03:12.020695 (+   138us) write_op.cc:276] Timestamp: P: 1783602192020479 usec, L: 0
0709 13:03:12.020727 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:03:12.021589 (+   862us) log.cc:844] Serialized 538 byte log entry
0709 13:03:12.310966 (+289377us) op_driver.cc:464] REPLICATION: finished
0709 13:03:12.519287 (+208321us) write_op.cc:301] APPLY: starting
0709 13:03:12.519412 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:12.519908 (+   496us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:12.520091 (+   183us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:12.520484 (+   393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:12.546258 (+ 25774us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:03:12.568079 (+ 21821us) write_op.cc:312] APPLY: finished
0709 13:03:12.593489 (+ 25410us) log.cc:844] Serialized 23 byte log entry
0709 13:03:12.613918 (+ 20429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.619878 (+  5960us) write_op.cc:454] Released schema lock
0709 13:03:12.622255 (+  2377us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:12.742438 (+120183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.746424 (+  3986us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":146,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":207991,"apply.run_cpu_time_us":4234,"apply.run_wall_time_us":213346,"num_ops":1,"prepare.queue_time_us":339811,"prepare.run_cpu_time_us":19884,"prepare.run_wall_time_us":258149,"raft.queue_time_us":64611,"raft.run_cpu_time_us":12596,"raft.run_wall_time_us":160104,"replication_time_us":290037,"thread_start_us":521300,"threads_started":4,"wal-append.queue_time_us":216860,"wal-append.run_cpu_time_us":42748,"wal-append.run_wall_time_us":1366640}]]}
I20260709 13:03:14.027040  8289 catalog_manager.cc:5697] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 7 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 9 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.025621 12420 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.025897 12522 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.036437  8289 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 8 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 10 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.026377 12358 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:03:14.033004  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 83297.5us
I20260709 13:03:14.010159 12679 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.051489  8289 catalog_manager.cc:5697] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 10 to 12, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 12 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:14.065673  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 91454.8us
I20260709 13:03:14.067564  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:14.054504 12522 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.079965 12522 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:14.082233 12679 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:14.034487 12718 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:14.062132 12358 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:14.088594  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 67842us
I20260709 13:03:14.099874  8507 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:14.102023  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:14.055368 12420 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:14.134361  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 112956us
I20260709 13:03:14.126945 12522 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:14.138854  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:14.128314 12543 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:14.141148  8394 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:14.141032  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:14.142086  8390 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:14.143584  8507 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:14.144019  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:14.144650  8394 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.150698 12715 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:14.151248 12715 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.151497  8394 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 15.
I20260709 13:03:14.151628 12715 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.155967 12420 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:14.115111 12679 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:03:14.153474  8470 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:14.159713  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:14.163795  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47242 (request call id 2241) took 1258 ms. Trace:
I20260709 13:03:14.164793 12715 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.170495  8465 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:03:14.170941 12358 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:14.170922  8465 pending_rounds.cc:85] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 7
I20260709 13:03:14.171572  8465 pending_rounds.cc:107] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:03:14.171953  8465 raft_consensus.cc:2889] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:14.170879 12715 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:14.138074 12522 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:14.172797 12522 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:14.174127  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:14.174753  8470 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.167227  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:14.177917 12731 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:14.178314  8462 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:14.164304  8466 rpcz_store.cc:276] 0709 13:03:12.904957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.956267 (+ 51310us) service_pool.cc:224] Handling call
0709 13:03:12.956676 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.027629 (+ 70953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.027663 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.028106 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.731625 (+703519us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b180015ece0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:03:13.865536 (+133911us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:13.878943 (+ 13407us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.879399 (+   456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.163443 (+284044us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b54002e8454. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:14.163500 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.163551 (+    51us) raft_consensus.cc:1685] finished
0709 13:03:14.163566 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.163729 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5980,"prepare.queue_time_us":14588,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":7699,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":2939,"spinlock_wait_cycles":191637632,"thread_start_us":133727,"threads_started":1,"wal-append.queue_time_us":866034}
I20260709 13:03:14.190683  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:14.196575  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:14.199605  8470 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 15.
I20260709 13:03:14.201534  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:14.202867  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:14.205523  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:14.225062  8536 raft_consensus.cc:606] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:14.208945  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:14.180289 12681 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12.
I20260709 13:03:14.193188 12700 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.218060 12543 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.225937 12685 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:14.217919  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2457ce91f84cd3860bea5672ef0ab8" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:14.238725 12733 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:03:14.239873 12700 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.249853  8540 raft_consensus.cc:1275] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:14.250239  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:14.251624  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:14.193434 12679 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:14.252379 12679 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:14.205430 12735 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:14.251905 12600 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:14.253194 12715 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:14.253733 12600 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.249975  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:14.252718 12636 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:14.257040 12636 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.252449  8535 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:14.253293 12735 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.253098  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:14.260985  8541 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:14.261837 12715 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.225721  8464 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.266903  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:14.268141  8542 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:14.271911  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:14.272995  8535 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:14.274444  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:14.283252  8543 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
W20260709 13:03:14.298645  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 230876us
I20260709 13:03:14.310503  8464 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
I20260709 13:03:14.286880 12543 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:14.319371 12655 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:14.321949 12655 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:14.359489  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.319727 12468 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:14.887792  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.402971  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 258169us
W20260709 13:03:14.438377  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 370938us
I20260709 13:03:14.478467  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:15.105152  8394 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:14.387462  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3179) took 1083 ms. Trace:
I20260709 13:03:14.366940  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.001103  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.109997  8544 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:15.000427  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3175) took 1706 ms. Trace:
I20260709 13:03:15.111127  8389 rpcz_store.cc:276] 0709 13:03:13.293544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.293664 (+   120us) service_pool.cc:224] Handling call
0709 13:03:13.896504 (+602840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.897198 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.000113 (+1102915us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54003f7350. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e68ad 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:15.000332 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385649024}
I20260709 13:03:14.478969  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.112635  8390 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:03:15.108402  8391 rpcz_store.cc:276] 0709 13:03:13.304067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.305050 (+   983us) service_pool.cc:224] Handling call
0709 13:03:14.387161 (+1082111us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54002675d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:14.387375 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004903168}
I20260709 13:03:14.366343 12700 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:15.120257  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 66187.8us
W20260709 13:03:14.713691 12522 consensus_meta.cc:287] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.006s
I20260709 13:03:15.126170  8394 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:03:14.806574 12298 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:15.127512 12298 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:14.863518 12718 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:14.366302 12655 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:14.364128 12683 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:14.565711 12405 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:14.609969 12599 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:14.493058 12567 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:14.942761 12637 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:14.797900 12557 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:14.414707 12685 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:03:15.131974  8358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.006s	sys 0.015s
I20260709 13:03:14.602805 12679 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:15.179446  8358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.006s	sys 0.015s
I20260709 13:03:15.131021 12700 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:15.114020 12468 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.131562 12298 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.131582 12522 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.179072 12557 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.191625 12637 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:15.209617  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 104170us
I20260709 13:03:15.191197 12567 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.194478 12599 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.202044 12679 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:15.187121 12683 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.213092 12298 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.190929 12405 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.230366 12298 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.193274 12685 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.196779 12700 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.202306 12744 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:15.218426  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:15.207083 12742 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.218093 12745 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:15.232972 12405 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.233011 12298 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.237112 12637 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.240466 12745 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.250280 12567 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.242254 12518 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:15.240926 12742 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.251159 12518 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:15.251195 12745 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.250720 12683 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.247859 12405 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:15.257112 12557 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.256356 12745 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:15.260969 12468 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.241405 12744 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.271124 12522 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.263347 12405 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.262509 12518 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.268280 12745 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.276603 12742 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.295675 12597 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.292095 12742 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:15.297112 12742 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.299851 12742 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.283139 12599 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.319372  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.284929 12685 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.285653 12715 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.329634  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.330924  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.324342  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.332911  8464 raft_consensus.cc:2410] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:15.325769  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.326341  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.326587  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.327768  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:15.335856  8469 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
W20260709 13:03:15.337018  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 210205us
I20260709 13:03:15.337046  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6595c51b9ae043699167a92b109f328e"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:15.338079  8394 raft_consensus.cc:606] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.338526  8394 raft_consensus.cc:614] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:15.341291  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 69878.6us
W20260709 13:03:15.360605  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 234716us
I20260709 13:03:15.347255 12685 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.365573 12710 consensus_queue.cc:1059] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:15.366232  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:15.348212 12509 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:03:15.385963 12658 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:15.386554 12658 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.387836 12745 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.366496  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:15.370666  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.402964  8392 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:15.403873  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.404448  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.373595  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:15.405423  8392 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:03:15.406193  8394 raft_consensus.cc:606] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.406713  8394 raft_consensus.cc:614] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:15.370090 12358 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:03:15.355055 12683 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:15.365547  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:15.393088  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:15.393577  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.415952  8391 raft_consensus.cc:3060] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.392935  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.415825  8508 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:15.399351  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.405489  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.417563  8390 raft_consensus.cc:2410] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:15.416219  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.416947  8388 raft_consensus.cc:2410] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:15.397918  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.416273  8389 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:15.423611  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:15.425310  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 53424.4us
I20260709 13:03:15.426324  8391 raft_consensus.cc:2468] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
I20260709 13:03:15.427624  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:15.428597  8359 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:15.429437  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:15.364668 12700 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.431365  9032 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.435559  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.437916  8389 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:15.403056 12742 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.442739  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:15.402877 12599 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:15.447393  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.449261  9064 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Advancing to term 15
I20260709 13:03:15.420683 12748 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:15.450263  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.433640 12692 raft_consensus.cc:2804] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:15.452978  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:15.461526  8541 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:15.427744 12597 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:15.463815  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.442914 12637 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:15.466012  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:15.402441 12685 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.473541  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.474220  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:15.474936  8391 raft_consensus.cc:2368] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 13. Current term is 14.
I20260709 13:03:15.474411  8542 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:15.449234 12745 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:15.425343 12683 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.478374  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:15.488243  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.482286  8541 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:15.483201  8543 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:15.449100 12753 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:15.483829  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.485965  9064 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 15 LEARNER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:15.495218  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:15.495893  8543 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.498667  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:15.508080  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:15.512394  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.463857 12700 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:15.543458  8540 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:15.467239 12744 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:15.545912  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 58664.3us
I20260709 13:03:15.449494 12742 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:15.550268  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 57643.1us
I20260709 13:03:15.451090 12599 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.568699  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 656) took 1155 ms. Trace:
I20260709 13:03:15.569707  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:15.547998  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.549031  8543 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:15.511492  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:15.547156  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:15.553680  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.569278  8465 rpcz_store.cc:276] 0709 13:03:14.413757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.413920 (+   163us) service_pool.cc:224] Handling call
0709 13:03:14.414349 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.233363 (+819014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.233409 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.233477 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:15.233529 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.568362 (+334833us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b5400096ad4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:15.568428 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.568620 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883021056}
I20260709 13:03:15.493718 12298 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.576004  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:15.505553 12692 raft_consensus.cc:697] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:15.582211  8541 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.582684 12692 consensus_queue.cc:237] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.577818  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.578831  8393 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:15.586512  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 1978) took 1089 ms. Trace:
I20260709 13:03:15.586933  8393 rpcz_store.cc:276] 0709 13:03:14.497494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.497674 (+   180us) service_pool.cc:224] Handling call
0709 13:03:15.547021 (+1049347us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b5800010e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2e9c 00007fbe103c2a5b 00007fbe192dbc09 00007fbe18435ee0 00007fbe184ff0ab 00007fbe184ff131 00007fbe184ad0a0 00007fbe184ac984 00007fbe11a276d4 00007fbe11a27662
0709 13:03:15.586434 (+ 39413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7472000}
I20260709 13:03:15.587819  8507 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.537590 12749 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:15.588470  8535 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:15.481076 12597 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.464783 12748 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.544225 12468 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:15.592883  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:15.590718  8507 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.593829  8537 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:15.594718  8395 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:15.595721 12518 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:15.595604 12468 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.596148 12518 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:15.596662 12518 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.593284 12554 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:15.598834 12554 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:15.599203 12554 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:15.589959 12420 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.604599 12518 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.606463 12636 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.607028 12518 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.607949 12599 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.608714 12599 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:15.609081  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:15.610898 12683 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.611662 12683 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.612146 12683 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.568598  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:15.614574 12600 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.588943  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:15.588887 12565 consensus_queue.cc:1059] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:03:15.615099 12600 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:15.619148 12600 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.621358 12600 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.622689  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48784 (request call id 654) took 1321 ms. Trace:
I20260709 13:03:15.622956 12468 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.623920 12468 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:15.624583 12468 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.511425 12753 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.628680 12753 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.550019 12750 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:15.549520 12405 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.573634 12700 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:15.638790 12688 raft_consensus.cc:993] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:15.646260 12688 raft_consensus.cc:1081] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:15.647357 12655 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.648020 12655 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.650120 12735 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.651412 12554 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.652132 12685 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.654160 12742 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.640950 12749 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:15.657447 12749 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.573470 12658 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.663954  8541 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:15.666213  8393 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:15.687359  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.667429 12554 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.668108 12735 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.692788  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.695127  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.667513  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:15.692018 12742 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.640686 12468 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.643057 12543 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:15.697512 12742 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.699265 12509 raft_consensus.cc:3055] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:15.699685 12742 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.692026  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:15.703449  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.705497  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:15.641300 12750 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:15.681972  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:15.769346  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 63935.4us
I20260709 13:03:15.771347  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.774473  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.623108  8462 rpcz_store.cc:276] 0709 13:03:14.301517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.301780 (+   263us) service_pool.cc:224] Handling call
0709 13:03:15.095015 (+793235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.233869 (+138854us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:15.361467 (+127598us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.441386 (+ 79919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.441437 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:15.441478 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.622407 (+180929us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540040c254. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:15.622482 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.622632 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":198506,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3451,"raft.run_wall_time_us":17151,"spinlock_wait_cycles":338292352,"thread_start_us":205736,"threads_started":2,"wal-append.queue_time_us":109417}
I20260709 13:03:15.637758  8507 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.668356 12597 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:15.700043  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.700327  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.701141  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.789815  8537 raft_consensus.cc:2393] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:15.789983  8543 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:15.789875  8535 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:15.702430  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.642855 12700 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.702975  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.703292  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.802191  8538 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:03:15.680153  8390 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:15.672394 12748 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:15.804111  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.791298  8539 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:15.794399  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:15.795811  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 158137us
I20260709 13:03:15.768368  8541 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:15.809397  8507 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.811147  8507 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.817320  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.819105  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.819195  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:15.817404  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 103769us
W20260709 13:03:15.734063 12679 consensus_meta.cc:287] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.510s	user 0.003s	sys 0.007s
I20260709 13:03:15.824198  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.828542  8393 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
W20260709 13:03:15.834656  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 323793us
I20260709 13:03:15.699694 12509 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:03:15.844125  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 323571us
I20260709 13:03:15.768965 12468 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:03:15.936278  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 117170us
I20260709 13:03:15.595172 12298 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.818115 12518 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:15.940478  8507 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.936757  8536 raft_consensus.cc:2410] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:15.965648  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.830377 12688 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.703867 12735 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:15.837431 12748 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:15.968359  8507 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:15.939080 12679 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.020140  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:15.964210 12754 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.407s	user 0.008s	sys 0.000s
I20260709 13:03:15.942294 12597 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.028327  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 513614us
I20260709 13:03:16.029174  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:16.030768  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:15.962034 12742 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:16.095096  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.095876  8543 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:16.093739  8537 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:15.969318 12745 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:16.098634  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:15.976811 12655 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.026963 12747 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:16.185456  8391 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:16.192107  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:16.193431  8391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:16.195159  8391 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:16.195639  8391 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:16.189152  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 92401.3us
I20260709 13:03:16.018980 12658 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:15.973673 12710 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.197842  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.027295 12572 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:16.203675  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.206367  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.206427  8537 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:15.961750 12715 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:16.207314  8544 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:15.961313 12468 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.211422  9032 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:16.031416 12600 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:16.218182 12600 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:16.218886 12600 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.151629 12567 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:16.220705 12567 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:16.154085 12509 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.221839 12572 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:16.223845 12298 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:16.226217 12406 consensus_queue.cc:1059] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:16.227839 12735 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:16.204746 12718 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:16.228451 12766 log.cc:927] Time spent T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:03:16.229041 12683 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.229261 12414 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.193630 12737 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.297760 12737 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.209043 12655 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:16.119243 12597 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.230436 12658 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.035852 12748 raft_consensus.cc:697] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:16.154639 12742 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:16.249065  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.316228  8541 raft_consensus.cc:2393] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:16.249269  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.250001  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.249964  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.210572  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.295212  8535 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
W20260709 13:03:16.311102  8433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.005s
I20260709 13:03:16.237756  8537 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:16.299240 12768 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.247216 12715 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:16.328051  8433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.004s	sys 0.005s
W20260709 13:03:16.339128  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 569029us
I20260709 13:03:16.337833  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.340555  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.341087  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.342099  8541 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:16.348356  8433 leader_election.cc:400] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 13. Current term is 14.
I20260709 13:03:16.348812  8433 leader_election.cc:403] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:16.346215  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.376777  8538 raft_consensus.cc:2410] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:16.383570  8541 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:16.313827 12655 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.402786  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.392938 12750 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:16.406934  9035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.040s	sys 0.027s
I20260709 13:03:16.334975 12768 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:16.410694  9035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.041s	sys 0.027s
I20260709 13:03:16.410423  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.320564 12745 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.422026 12597 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.423130 12795 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:16.423753 12795 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:16.424564 12655 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.400259 12748 consensus_queue.cc:237] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.426450 12737 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:16.403174 12572 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:16.432745 12782 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:03:16.433341 12742 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:16.434563 12658 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.424507 12768 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.443290 12567 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:16.444217 12715 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:16.490217  8359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.001s	sys 0.001s
W20260709 13:03:16.491183  8359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.002s	sys 0.001s
W20260709 13:03:16.491632  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.03965e+06us
W20260709 13:03:16.493212  8388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.001s	sys 0.001s
W20260709 13:03:16.493757  8388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.001s	sys 0.001s
I20260709 13:03:16.495417  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3227) took 1070 ms. Trace:
I20260709 13:03:16.496482  8541 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:16.499881  8541 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:16.501058  8507 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:16.504172  8542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.007s
W20260709 13:03:16.504758  8542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.007s
I20260709 13:03:16.506582  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56998 (request call id 436) took 1025 ms. Trace:
I20260709 13:03:16.508010  8543 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:16.508831  8507 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:16.509361  8359 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:16.510844  8507 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:16.506620  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 158253us
I20260709 13:03:16.523375 12742 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:03:16.526297  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 159417us
I20260709 13:03:16.527451 12679 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.528765  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.529616 12735 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:16.529968  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 123887us
I20260709 13:03:16.530346 12735 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:16.531059 12735 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.534802 12737 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:16.496039  8388 rpcz_store.cc:276] 0709 13:03:15.425480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.425634 (+   154us) service_pool.cc:224] Handling call
0709 13:03:15.425942 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.426148 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:15.463902 (+ 37754us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.494450 (+1030548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.494607 (+   157us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:16.494750 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.494921 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.495268 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38402,"prepare.queue_time_us":246550,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":95076,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":51,"thread_start_us":1013049,"threads_started":3,"wal-append.queue_time_us":157984}
I20260709 13:03:16.507140  8542 rpcz_store.cc:276] 0709 13:03:15.481475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.481611 (+   136us) service_pool.cc:224] Handling call
0709 13:03:15.482357 (+   746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.482570 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:15.975922 (+493352us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.505659 (+529737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.505815 (+   156us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:16.505976 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.506117 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.506454 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55758,"prepare.queue_time_us":143542,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":936791,"threads_started":2,"wal-append.queue_time_us":473288}
I20260709 13:03:16.570235 12700 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:16.570900  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.571087 12700 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:16.565478 12768 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 13. Current term is 14.
W20260709 13:03:16.580418  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 52697us
I20260709 13:03:16.582276 12655 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.583143 12655 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.583667 12468 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.585991  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.587066  9060 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:16.588702  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3233) took 1122 ms. Trace:
I20260709 13:03:16.590574 12655 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.589107  8389 rpcz_store.cc:276] 0709 13:03:15.465954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.466707 (+   753us) service_pool.cc:224] Handling call
0709 13:03:15.472949 (+  6242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.939230 (+466281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.939275 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:15.941083 (+  1808us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.497250 (+556167us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:16.578179 (+ 80929us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.588120 (+  9941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.588267 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.588341 (+    74us) raft_consensus.cc:1685] finished
0709 13:03:16.588351 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.588517 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69927,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":81,"raft.queue_time_us":101976,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":6772,"thread_start_us":1006970,"threads_started":3,"wal-append.queue_time_us":438763}
W20260709 13:03:16.576701  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 63741.5us
I20260709 13:03:16.570320 12780 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.609027  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 94504.6us
I20260709 13:03:16.614876  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.625473  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.626492  8542 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:16.627599  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.628955  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.629937 12780 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.642166 12597 consensus_queue.cc:1059] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:16.643579 12700 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.645715 12742 raft_consensus.cc:3055] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:16.646256 12742 raft_consensus.cc:740] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:16.647686 12742 consensus_queue.cc:260] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.655498  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49324 (request call id 2247) took 1209 ms. Trace:
I20260709 13:03:16.657886  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.659924  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.643577 12597 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:03:16.663782 12780 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.641312  8544 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:16.681856 12780 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:16.682161 12785 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:16.684357 12727 raft_consensus.cc:3055] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:16.684985 12727 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:16.689421 12747 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:16.690200 12747 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:16.691107 12742 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.690212  8543 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:16.695968  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.697992  8543 raft_consensus.cc:2468] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:16.699519  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.706179  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.707824  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:16.708813  8393 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:16.710704  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:16.711587  8389 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:16.711622  8535 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:16.708070  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.718505  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.720322  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.723222  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:16.723459 12727 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:16.672086  8536 rpcz_store.cc:276] 0709 13:03:15.445649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.445865 (+   216us) service_pool.cc:224] Handling call
0709 13:03:16.654996 (+1209131us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b540037c654. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:16.655301 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846959360}
I20260709 13:03:16.724231  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.725526  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.725699  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.726940  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:16.727924  8536 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:16.709627  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 1985) took 1162 ms. Trace:
I20260709 13:03:16.724162  8389 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:16.731288  8538 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:16.731724  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3231) took 1281 ms. Trace:
I20260709 13:03:16.732144  8387 rpcz_store.cc:276] 0709 13:03:15.449778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.449932 (+   154us) service_pool.cc:224] Handling call
0709 13:03:16.731327 (+1281395us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002675d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:16.731501 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2940668160}
I20260709 13:03:16.733001  8538 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:16.746376  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.747108 12727 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.730008  8386 rpcz_store.cc:276] 0709 13:03:15.547447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.547576 (+   129us) service_pool.cc:224] Handling call
0709 13:03:15.587995 (+ 40419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.667049 (+ 79054us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:15.678076 (+ 11027us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.017450 (+339374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.017526 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:16.017585 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.707560 (+689975us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800301c60. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103c82a6 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419
0709 13:03:16.709190 (+  1630us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b54001199d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:16.709236 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.709429 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10686,"prepare.queue_time_us":25173,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":121,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":10048,"spinlock_wait_cycles":205150848,"thread_start_us":338887,"threads_started":1,"wal-append.queue_time_us":680876}
I20260709 13:03:16.723981  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:16.701050  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:16.794504  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 123788us
W20260709 13:03:16.796048  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 160302us
I20260709 13:03:16.801627  8544 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:16.800423 12747 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.808480 12747 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:16.811645  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:16.812016  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:16.814409  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:16.814837  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
W20260709 13:03:16.816156  8391 consensus_meta.cc:287] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.019s
I20260709 13:03:16.818194  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:16.819506  8387 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:16.824539  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:16.824652 12764 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:16.826061  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:16.826522  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.829053  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:16.814428  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:16.836055  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:16.831777  8391 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.837296  8461 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:16.848284  8393 raft_consensus.cc:1240] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:16.850455 12718 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:16.830610  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.851296 12655 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:16.853271  8468 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:16.850498  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:16.853325 12655 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:16.855444 12737 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:16.855870 12737 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.856228 12737 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.857084 12655 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:16.851428 12718 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.857638  8507 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:16.859308 12543 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:16.859782 12543 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:16.860394 12543 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:16.860450  8507 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:16.857896 12718 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.862238 12554 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:16.868961 12710 consensus_meta.cc:287] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.011s
I20260709 13:03:16.869544 12710 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:16.872802 12735 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:16.876469  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 52139.9us
I20260709 13:03:16.881943 12509 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.883549  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:16.884768 12802 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.887210 12802 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:16.887909 12802 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:16.888353 12802 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.890503  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:16.915552 12600 consensus_meta.cc:287] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.013s
I20260709 13:03:16.916354 12600 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:16.917933  8541 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:16.931016  8537 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:03:16.942927  8391 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:16.960279  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 50649.7us
W20260709 13:03:16.959537  9032 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.977660  8539 raft_consensus.cc:1240] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:16.994019  8540 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:03:16.999171  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44080 (request call id 1998) took 1308 ms. Trace:
I20260709 13:03:17.000025  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60598 (request call id 532) took 1491 ms. Trace:
I20260709 13:03:17.000582  8392 rpcz_store.cc:276] 0709 13:03:15.508708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.508860 (+   152us) service_pool.cc:224] Handling call
0709 13:03:15.509143 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.509362 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:15.842112 (+332750us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.929546 (+1087434us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b1800350a40. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe1308f4bc 00007fbe103dd48b 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a
0709 13:03:16.999378 (+ 69832us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.999473 (+    95us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:16.999523 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.999623 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.999803 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48868,"prepare.queue_time_us":163594,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"spinlock_wait_cycles":127830272,"thread_start_us":710646,"threads_started":2,"wal-append.queue_time_us":507016}
W20260709 13:03:17.004632  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 103984us
I20260709 13:03:17.006847 12735 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:17.009405  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:17.012058  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:16.999785  8390 rpcz_store.cc:276] 0709 13:03:15.690471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.807761 (+117290us) service_pool.cc:224] Handling call
0709 13:03:15.808098 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.831760 (+ 23662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.831813 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.831878 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:15.831945 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.998653 (+1166708us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b54003070d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:16.998726 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.998988 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53706624}
I20260709 13:03:17.013684  8360 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:17.014822 12737 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.014979 12543 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.019668 12745 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:17.020674 12700 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:17.021389 12767 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:16.880221  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:17.023011 12750 raft_consensus.cc:1027] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: attempt to promote peer 92314b14f5554885a80c3dc87f4beed4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:03:17.023914 12512 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.027878 12636 raft_consensus.cc:493] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:17.029439  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 109) took 5173 ms. Trace:
I20260709 13:03:17.029711  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.031749  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:17.005934  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 122514us
I20260709 13:03:16.999172 12600 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.042405 12767 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:17.043720 12636 raft_consensus.cc:515] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.049490 12767 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.047928 12700 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.051580 12636 leader_election.cc:290] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:17.043591 12512 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.054579 12512 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.043967  8289 rpcz_store.cc:276] 0709 13:03:11.894295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.916070 (+ 21775us) service_pool.cc:224] Handling call
0709 13:03:12.250141 (+334071us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001608d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13451090 00007fbe134eff3a 00007fbe192a61cc 00007fbe193a437e 00007fbe178652a4 00007fbe17865232 00007fbe17865161 00007fbe178650dc 00007fbe17864392 00007fbe1182248c 00007fbe118218c6
0709 13:03:17.029162 (+4779021us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:14.394644 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:14.431399 (+ 36755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:14.431429 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:03:14.431449 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:14.432397 (+   948us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:14.432481 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:14.432526 (+    45us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:14.610339 (+177813us) tablet.cc:701] Row locks acquired
0709 13:03:14.620621 (+ 10282us) write_op.cc:260] PREPARE: finished
0709 13:03:14.650120 (+ 29499us) write_op.cc:270] Start()
0709 13:03:14.687003 (+ 36883us) write_op.cc:276] Timestamp: P: 1783602194645779 usec, L: 0
0709 13:03:14.695194 (+  8191us) op_driver.cc:348] REPLICATION: starting
0709 13:03:15.157616 (+462422us) log.cc:844] Serialized 2054 byte log entry
0709 13:03:16.449835 (+1292219us) op_driver.cc:464] REPLICATION: finished
0709 13:03:16.579280 (+129445us) write_op.cc:301] APPLY: starting
0709 13:03:16.579492 (+   212us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:16.658256 (+ 78764us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:16.658437 (+   181us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:16.659354 (+   917us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:16.659865 (+   511us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:03:16.659954 (+    89us) write_op.cc:312] APPLY: finished
0709 13:03:16.660513 (+   559us) log.cc:844] Serialized 47 byte log entry
0709 13:03:16.660869 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:16.661249 (+   380us) write_op.cc:454] Released schema lock
0709 13:03:16.661344 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:16.708829 (+ 47485us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:16.708862 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":348814080,"child_traces":[["op",{"apply.queue_time_us":128848,"apply.run_cpu_time_us":5792,"apply.run_wall_time_us":95243,"num_ops":5,"prepare.queue_time_us":207905,"prepare.run_cpu_time_us":27897,"prepare.run_wall_time_us":996591,"raft.queue_time_us":140817,"raft.run_cpu_time_us":4130,"raft.run_wall_time_us":146251,"replication_time_us":1754470,"thread_start_us":493723,"threads_started":4,"wal-append.queue_time_us":307942}]]}
I20260709 13:03:17.056684 12700 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:17.057451 12543 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:17.062641  8509 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:17.063808 12543 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.067154  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.036471  8293 catalog_manager.cc:5697] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 5 to 6, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 6 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.069657  8358 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:17.071700 12543 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:17.073509 12543 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.078281  8358 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:17.065850 12795 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.074169 12543 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.044476 12802 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.074853 12737 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.083868 12745 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:17.085922  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.090152  9032 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.085037 12700 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:17.085963 12745 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:17.095239 12745 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.096524  8509 leader_election.cc:304] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.099023  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:17.091720 12512 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:17.093240 12700 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:17.092607  8293 catalog_manager.cc:5697] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.104775 12636 raft_consensus.cc:2749] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.105712 12700 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.104832 12512 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:17.111511 12512 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.112886 12767 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.113747 12810 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.117169  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.117430  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.119660  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.134508  8293 catalog_manager.cc:5697] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.119822  9065 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:17.120451  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.119659  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.136363  8293 catalog_manager.cc:5697] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 11, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 11 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:17.122042  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.122838  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.140053  8389 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 15.
I20260709 13:03:17.150902  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.153751  8509 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
W20260709 13:03:17.155405  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 74761.9us
I20260709 13:03:17.124326 12700 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:17.152997  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 49351.2us
I20260709 13:03:17.164680 12420 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:17.165503  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.165846 12802 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:17.166970  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:17.168118 12810 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:17.168789 12810 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.167407 12543 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.170737  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.170784 12750 raft_consensus.cc:1027] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: attempt to promote peer 92314b14f5554885a80c3dc87f4beed4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:03:17.171412  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.171742 12543 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.172050  8465 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 15.
I20260709 13:03:17.172310  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.174940  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.175719  8461 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:17.176824  9033 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.177875  8509 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.177915  8541 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:17.177932 12727 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:17.179883 12727 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:17.179919  8509 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.180490 12727 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.180941 12636 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.181910 12636 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:17.161013  8293 catalog_manager.cc:5697] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 7, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:17.174165 12810 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:17.186965 12745 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.207468  8293 catalog_manager.cc:5697] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 7, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:17.209374  8293 catalog_manager.cc:5697] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 7, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:17.210286 12745 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:17.211630  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 48592.5us
I20260709 13:03:17.215088 12727 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.191965  8358 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:17.217159  8358 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:17.218506 12599 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:17.218892 12599 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:17.192898  8537 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:17.219396 12599 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.220005  8358 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:17.221474 12789 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:17.221887 12789 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:17.222255 12789 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:17.226614  9035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.193859 12512 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.230201  8358 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:17.195354 12767 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:17.181398  8509 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:03:17.231899  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 50632.6us
I20260709 13:03:17.232496 12512 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.191686 12744 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:17.233122 12744 consensus_queue.cc:1243] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:17.192792  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.233697  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.234108  8461 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.234400  8539 raft_consensus.cc:2376] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11. Re-sending same reply.
I20260709 13:03:17.218807  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.236858  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.237144  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.236428  8465 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.238157  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.238809  8544 raft_consensus.cc:2376] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13. Re-sending same reply.
I20260709 13:03:17.240357  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.241706  8537 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:17.235854  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.233497  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.242260  8539 raft_consensus.cc:2376] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12. Re-sending same reply.
I20260709 13:03:17.235386 12727 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:17.203069 12718 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.248808  8465 raft_consensus.cc:2468] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
I20260709 13:03:17.245090 12700 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:17.205044  8508 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.246743  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:17.251035  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.251235  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.252022  8544 raft_consensus.cc:2376] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13. Re-sending same reply.
I20260709 13:03:17.251708  8390 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
W20260709 13:03:17.253523  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 48607.2us
I20260709 13:03:17.254359  9033 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.258270  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.259879  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.263684 12750 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:17.263947  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:17.265937  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:17.266438  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.267498  8540 raft_consensus.cc:2393] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 13: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:17.267424 12804 raft_consensus.cc:2804] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:17.267027  8544 raft_consensus.cc:2376] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11. Re-sending same reply.
I20260709 13:03:17.269093  8389 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:17.259869 12742 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:17.273440  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.274394  8465 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.230229 12599 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.281061  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.268052 12804 raft_consensus.cc:697] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:17.260169 12636 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:17.266019 12512 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:17.290916  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.291787  8537 raft_consensus.cc:2376] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12. Re-sending same reply.
W20260709 13:03:17.272511  8433 connection.cc:256] RPC call timeout handler was delayed by -1.136701056999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 13:03:17.257474 12789 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:17.275996 12742 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:17.300402 12599 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:17.299969 12804 consensus_queue.cc:237] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.301216 12776 consensus_queue.cc:1059] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:17.302435 12776 raft_consensus.cc:3055] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:17.302836 12776 raft_consensus.cc:740] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:17.303865 12776 consensus_queue.cc:260] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.305390 12776 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.290450 12512 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.306670 12512 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.322698  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.330747  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.334267  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.335407  8537 raft_consensus.cc:2368] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11.
I20260709 13:03:17.316260 12742 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.316915 12636 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:17.345966  8461 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:17.349192  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.349871  8537 raft_consensus.cc:2376] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11. Re-sending same reply.
I20260709 13:03:17.351565  8465 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:17.359334  8508 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.359088  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.364940  8540 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:17.365952  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.369635  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:17.375870  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.330778 12567 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:03:17.384445  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.369989 12414 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:03:17.370318 12700 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.397167  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:17.397658 12700 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.398042 12636 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.386924  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.370575 12745 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.401469 12745 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.402518 12700 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:17.404109 12745 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:17.404398  8536 raft_consensus.cc:2368] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11.
I20260709 13:03:17.405011  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:17.406538  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:03:17.391530  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 92611.9us
I20260709 13:03:17.394438  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:17.407652 12750 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:17.395335  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.408185 12750 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.370764 12600 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:17.408905  8433 connection.cc:256] RPC call timeout handler was delayed by -1.1187010569999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:03:17.409535 12600 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:17.410763 12414 raft_consensus.cc:3055] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:17.410564 12768 consensus_queue.cc:1059] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:17.411178 12414 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:17.412073 12781 raft_consensus.cc:3055] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:17.412482 12781 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:17.412185 12414 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.413370 12781 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:17.416461 12803 consensus_queue.cc:1175] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 9 } }
I20260709 13:03:17.419589  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.420790 12781 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.370566 12420 consensus_queue.cc:1059] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:03:17.422637 12420 raft_consensus.cc:3055] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:17.423038 12420 raft_consensus.cc:740] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:17.423193 12718 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.424679 12789 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.410676 12600 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.434530  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:17.437549  8389 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:17.444949  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:17.437640 12414 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.456362  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.458252  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.467708  8540 raft_consensus.cc:2393] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:17.459105  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.459842  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.468427  8537 raft_consensus.cc:2376] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12. Re-sending same reply.
I20260709 13:03:17.461939  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.462095  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.462678  8542 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:17.469942  8461 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 15: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:17.479012  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.482900  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:17.479974  8541 raft_consensus.cc:2376] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12. Re-sending same reply.
I20260709 13:03:17.449421 12768 consensus_queue.cc:1059] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:03:17.496860  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.499368  8507 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.471298 12678 consensus_queue.cc:1059] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:03:17.507076  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.508404  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.509868  8358 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:17.510573  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.518859  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.522614  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.512133 12543 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:17.534276  8536 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:17.538671 12715 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.544518  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3476b7ee17e048f38396353721fa682f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:17.546568  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.547258  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
W20260709 13:03:17.546594  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 46330.7us
I20260709 13:03:17.527325 12745 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:17.554852 12816 log.cc:927] Time spent T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:03:17.559194  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.561630  8358 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:17.552376  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:17.565665  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.515440 12420 consensus_queue.cc:260] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.557143 12745 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:17.582710  8540 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:17.550750 12512 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.593580  8358 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.596875  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.597110  8544 raft_consensus.cc:2368] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16.
I20260709 13:03:17.589040 12745 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.607733 12700 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:17.608382 12700 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:17.609480 12700 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.628342  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.603003 12789 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:17.648442 12512 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.650424 12802 raft_consensus.cc:3055] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:17.651108 12802 raft_consensus.cc:740] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:17.655890  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.656778  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.656893  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.658182  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.641185 12789 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:17.660131 12789 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.661965  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.662245 12796 raft_consensus.cc:3055] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:17.662606 12796 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:17.662534 12742 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.663733 12796 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.665295 12796 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.666386 12742 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:17.647377  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 64713.6us
I20260709 13:03:17.678525  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.682962  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.683090  8358 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:17.683672  8469 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.684283  8463 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:17.684479  8358 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.685369  8464 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:17.685305  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.681423  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.652437 12802 consensus_queue.cc:260] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.703223  8462 raft_consensus.cc:1240] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:17.711491  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.685952 12742 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:17.714645  8537 raft_consensus.cc:1240] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16. Ops: [12.8-15.9]
I20260709 13:03:17.717046  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.717304  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.718818  8466 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:17.719861  8466 raft_consensus.cc:1240] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:17.720486 12420 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.721385  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:17.723615 12599 raft_consensus.cc:1027] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: attempt to promote peer 92314b14f5554885a80c3dc87f4beed4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:03:17.726131 12512 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:17.726717 12512 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:17.727713 12512 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:17.730383  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 46022.7us
I20260709 13:03:17.731918  8358 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.732257 12600 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.732738 12744 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:17.705322  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.704864 12802 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.722818  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.702433 12789 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.740123  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.740465  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:17.763543  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.764218  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.764624 12767 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.765379 12767 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.765959 12599 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:17.766207  8358 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.767270 12599 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:17.733777 12600 consensus_queue.cc:1059] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:17.765540  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.741433  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.741480  9066 raft_consensus.cc:2468] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:17.743463  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:17.771138  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.771871 12599 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.772507 12599 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.772897  8467 raft_consensus.cc:1240] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:17.743852  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.751237  8395 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:17.773710  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.770229  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.775969 12414 consensus_queue.cc:1059] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:17.776108  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.754576  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.755285  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.740989 12744 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.776978 12803 raft_consensus.cc:3055] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:17.777227  8541 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:17.776945  8544 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:17.777585 12803 raft_consensus.cc:740] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:17.778788  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.778975  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.778697 12803 consensus_queue.cc:260] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.775198 12742 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:17.780390 12803 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.780913  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.781666  8541 raft_consensus.cc:2393] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 16: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:17.782459 12735 raft_consensus.cc:3055] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:17.782842 12735 raft_consensus.cc:740] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:17.783574  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.755587  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.757848 12750 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.783667 12735 consensus_queue.cc:260] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.786171 12735 raft_consensus.cc:3060] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.786993 12750 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:17.760411 12543 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.788105 12543 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.790356 12543 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.719861  8462 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:17.740883  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.792786  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.793181 12827 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.793537  8544 raft_consensus.cc:2376] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14. Re-sending same reply.
I20260709 13:03:17.793742 12827 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.794180  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.794881  8537 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:03:17.795976  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.797314  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.798126  8543 raft_consensus.cc:2368] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12.
I20260709 13:03:17.752637 12789 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:17.746735  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.801044 12827 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.713954 12700 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:17.803038  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.803918 12600 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.805994  8466 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:17.774964 12745 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.804448 12600 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.808336  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.814141 12700 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:17.815013 12700 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:17.816123 12700 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.817104 12600 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.818675  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.819234  9065 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:17.819598  8466 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:17.820076  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:03:17.810817  8433 leader_election.cc:336] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Timed out: RequestConsensusVote RPC to 127.7.28.195:40791 timed out after 1.521s (SENT)
I20260709 13:03:17.821768  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.825467  8544 raft_consensus.cc:1240] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:17.827252 12636 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.853524  8509 leader_election.cc:304] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.857210  8537 raft_consensus.cc:2393] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:17.858273  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.858744  9068 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:17.858995  8470 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:17.860285  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:17.860698  8508 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.861642 12543 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.861873 12802 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:17.862152 12543 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.862671 12543 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:17.861661  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 50928.6us
I20260709 13:03:17.866496  8541 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:03:17.867218  8433 leader_election.cc:336] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Timed out: RequestConsensusVote RPC to 127.7.28.195:40791 timed out after 1.732s (SENT)
I20260709 13:03:17.867419  8469 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:03:17.815090  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.829250 12789 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:17.813601  8535 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:03:17.813534  8358 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.834192 12715 consensus_queue.cc:1059] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:17.836920 12745 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:17.838064  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:17.842605  9060 raft_consensus.cc:1240] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:17.878672 12750 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:17.822045  8462 raft_consensus.cc:1275] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:17.879451 12636 raft_consensus.cc:3055] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:17.828258  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 52237.7us
I20260709 13:03:17.873296  8508 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.880944 12715 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:17.881386 12715 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.881112 12414 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:17.881731 12715 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.870086  8509 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:17.879679  9066 raft_consensus.cc:2393] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 9: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:17.880075 12636 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:17.884974  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.888492 12600 raft_consensus.cc:2804] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:17.888903  8463 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:17.889091 12600 raft_consensus.cc:697] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:17.890252 12600 consensus_queue.cc:237] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.891842  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.892936 12827 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.877838  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:17.885092  8509 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:17.895937  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.897117  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.893534 12827 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.898011  8543 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:03:17.898319 12827 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.898013 12718 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:17.898785 12825 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:17.899469 12718 raft_consensus.cc:697] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:17.900426 12718 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:17.900722  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:17.873910 12735 raft_consensus.cc:2749] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:17.905650  8544 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:17.910238  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:17.905444 12745 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:17.922519  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 55362.3us
I20260709 13:03:17.911674 12781 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.902030 12414 consensus_queue.cc:1048] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:03:17.945159  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 131723us
W20260709 13:03:17.946915  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 61998.9us
I20260709 13:03:17.948060  8359 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:17.952389 12700 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:17.958400  8281 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.201s	user 0.002s	sys 0.001s
I20260709 13:03:17.917884 12543 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.963606  8358 leader_election.cc:400] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11.
I20260709 13:03:17.949290 12825 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:17.970193 12825 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.986402 12420 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:17.987144 12420 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.964414 12636 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:17.996138  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:17.994781  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 48870us
I20260709 13:03:17.969504 12543 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:17.998199 12768 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.000104 12768 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:18.000499 12768 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.002204 12636 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:18.008401  8468 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:18.008769  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:18.009012 12768 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.009423  8465 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:18.011444 12768 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:18.015185  8469 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:18.019722  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:17.989609 12420 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.018891  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:18.028784  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 63509.8us
I20260709 13:03:18.031457  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:18.040145  8465 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:18.044258  8508 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:17.989647 12825 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.045266 12768 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:17.989476 12715 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:18.054673  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 56644.3us
I20260709 13:03:18.050647 12655 consensus_queue.cc:1059] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:03:18.042743 12567 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:03:18.055080 12735 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:18.061854 12735 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:18.062939 12735 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.054482 12768 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:18.047670 12420 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:03:18.091405  8433 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:18.103350  8359 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.092270 12768 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.107393 12789 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:18.116062 12802 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:18.128504  8358 leader_election.cc:400] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11.
W20260709 13:03:18.130997  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.131332  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.137548  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.120213 12700 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:18.135823 12742 consensus_queue.cc:1059] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:03:18.113617 12744 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:18.139464 12715 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.141299  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:18.149456  8462 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.138413 12599 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:18.166464  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.162142 12827 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.160983 12767 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.170910 12767 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.173480 12767 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:18.174868 12744 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:18.179025  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:18.179838 12789 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.149555 12745 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.184381 12825 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:18.190929  8462 raft_consensus.cc:2468] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:18.194837  8470 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:18.196916  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 68641.9us
I20260709 13:03:18.188709 12827 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.200093  8508 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:18.158622  8281 maintenance_manager.cc:643] P 9c29a936330e465e8f9c7de5c6f8056b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.097s	user 0.195s	sys 0.069s Metrics: {"bytes_written":29715,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":231058,"dirs.run_cpu_time_us":536,"dirs.run_wall_time_us":4827,"drs_written":1,"lbm_read_time_us":375,"lbm_reads_lt_1ms":4,"lbm_write_time_us":382639,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":8,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":138348,"threads_started":1,"update_count":5}
I20260709 13:03:18.250077 12744 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:18.260409  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 169097us
W20260709 13:03:18.251828 12841 log.cc:927] Time spent T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:18.220796 12512 raft_consensus.cc:2804] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:18.267174 12512 raft_consensus.cc:697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:18.268321 12512 consensus_queue.cc:237] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.270345  8470 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:18.270819 12750 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:18.271286 12750 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:18.271520 12848 consensus_queue.cc:1059] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:18.272543 12846 raft_consensus.cc:3055] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:18.272303 12750 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.272984 12846 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:18.273432 12750 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.220711  8358 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.255059 12768 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:18.264098 12744 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:18.265106  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50742 (request call id 222) took 3701 ms. Trace:
I20260709 13:03:18.198853 12825 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:18.289557  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:18.291595  8433 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.293730  8469 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:18.294775 12720 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:18.284739  8293 rpcz_store.cc:276] 0709 13:03:14.563423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.563588 (+   165us) service_pool.cc:224] Handling call
0709 13:03:18.265021 (+3701433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:17.425732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:17.504487 (+ 78755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:17.511930 (+  7443us) write_op.cc:435] Acquired schema lock
0709 13:03:17.514968 (+  3038us) tablet.cc:662] Decoding operations
0709 13:03:17.641389 (+126421us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:17.667863 (+ 26474us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:17.667901 (+    38us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:03:17.668662 (+   761us) tablet.cc:701] Row locks acquired
0709 13:03:17.668720 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:03:17.669099 (+   379us) write_op.cc:270] Start()
0709 13:03:17.669249 (+   150us) write_op.cc:276] Timestamp: P: 1783602197668990 usec, L: 0
0709 13:03:17.669276 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:03:17.670112 (+   836us) log.cc:844] Serialized 2849 byte log entry
0709 13:03:17.930632 (+260520us) op_driver.cc:464] REPLICATION: finished
0709 13:03:18.066133 (+135501us) write_op.cc:301] APPLY: starting
0709 13:03:18.066228 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:18.066931 (+   703us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:18.067055 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:18.115117 (+ 48062us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:18.115413 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=7,key_file_lookups=7,delta_file_lookups=7,mrs_lookups=14
0709 13:03:18.115824 (+   411us) write_op.cc:312] APPLY: finished
0709 13:03:18.151031 (+ 35207us) log.cc:844] Serialized 101 byte log entry
0709 13:03:18.162441 (+ 11410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:18.173657 (+ 11216us) write_op.cc:454] Released schema lock
0709 13:03:18.173727 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:18.174651 (+   924us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:18.174682 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":135210,"apply.run_cpu_time_us":14758,"apply.run_wall_time_us":108527,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12570,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6222,"cfile_init":2,"lbm_read_time_us":5724,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":7,"prepare.queue_time_us":161800,"prepare.run_cpu_time_us":12145,"prepare.run_wall_time_us":304384,"raft.queue_time_us":74673,"raft.run_cpu_time_us":54293,"raft.run_wall_time_us":124984,"replication_time_us":261204,"thread_start_us":347401,"threads_started":4,"wal-append.queue_time_us":169503}]]}
I20260709 13:03:18.296466  8282 maintenance_manager.cc:419] P 9c29a936330e465e8f9c7de5c6f8056b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10161 bytes on disk
I20260709 13:03:18.298007 12768 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:18.282289 12846 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.299242  8281 maintenance_manager.cc:643] P 9c29a936330e465e8f9c7de5c6f8056b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":322,"lbm_reads_lt_1ms":4}
I20260709 13:03:18.299754 12846 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:18.302613  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 102700us
I20260709 13:03:18.303519  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.304927  8358 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.290512 12636 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.305709 12825 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.306296 12636 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.306702 12781 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:18.307112 12825 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.307200 12414 consensus_queue.cc:1059] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:18.307142 12781 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:18.308466 12636 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.308584 12781 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.309974 12781 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:18.319474 12599 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:18.320252 12599 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.303627 12720 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:18.290232 12789 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:18.321210 12744 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:18.321434 12720 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.322211 12744 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.324455 12744 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:18.314630  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:18.334043  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.335409  8470 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:18.308460 12414 raft_consensus.cc:3055] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:18.344161  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:18.345448  8470 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:18.325182 12718 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:18.342679 12414 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:18.357856 12718 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.365291 12599 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:18.366251 12599 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:18.365449 12718 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.367439 12599 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.375604 12414 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:18.377339 12414 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:18.378481  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.382787 12744 raft_consensus.cc:1027] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: attempt to promote peer 92314b14f5554885a80c3dc87f4beed4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:03:18.380306  8290 catalog_manager.cc:5697] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.387164  8290 catalog_manager.cc:5697] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.391657  8290 catalog_manager.cc:5697] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 5 to 6, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 6 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.337707 12848 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.412243  8290 catalog_manager.cc:5697] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 10 to 11, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 11 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.420200  9068 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:03:18.401208  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 67262.1us
I20260709 13:03:18.401316  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:18.403126  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.397842  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 114411us
I20260709 13:03:18.420774  8290 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 10 to 12, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:18.428923  8358 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.430999  8508 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:18.431780  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:18.428792 12825 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:03:18.433668  8290 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:18.434139 12745 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:18.442611  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.437660 12718 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:18.447400 12718 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.447777 12718 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:18.448696 12845 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:18.449069  9068 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:03:18.449177 12845 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:18.449681 12845 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.434378 12567 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:03:18.450996 12567 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.451510 12567 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.459692  8358 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.466172  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:18.440284  8290 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 12 to 15, now has a pending config: VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193), VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194), VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195), NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 15 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:18.486191 12745 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.486770  8358 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.487757 12744 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.489194  8358 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.467314 12512 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:03:18.497123  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:18.500255  8358 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.498890 12744 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:18.453751 12567 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.499171 12745 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.504019 12781 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:18.502249 12789 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:03:18.518168  8469 raft_consensus.cc:2410] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:18.521337 12636 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:18.526825 12636 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:18.529170 12636 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.512966 12781 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:18.530031 12781 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.531571  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:18.536784 12718 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.525957  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.550987  8433 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.552740 12599 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:18.553694 12599 consensus_queue.cc:1243] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:18.556092 12789 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:18.556488 12789 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:18.521581 12745 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:18.560155 12848 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:18.563069 12846 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.567829  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.560285 12845 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.572363 12845 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:18.576470 12781 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.577515 12844 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:18.557324 12789 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:18.578678  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.523377 12567 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:18.581049 12567 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.581579  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:18.582165  8469 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:18.583889 12567 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.579496 12718 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.585575  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:18.586308  8470 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:18.590248  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:18.592121 12718 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:18.593155 12718 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:18.593636 12718 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:18.596211  8469 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:18.578718  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.615248 12844 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:18.616757  8508 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:18.617671 12720 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:18.618212 12720 raft_consensus.cc:697] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:18.619160 12720 consensus_queue.cc:237] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:18.610450  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.612694 12781 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:18.608196  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 85296.8us
I20260709 13:03:18.625366  8469 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:18.630203  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:18.633960 12567 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:18.640219  8358 leader_election.cc:400] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16.
I20260709 13:03:18.646143 12846 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:03:18.642135 12845 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:03:18.655774  8358 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:18.656867 12857 consensus_queue.cc:1059] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:18.657291  8358 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:03:18.665148  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.642805 12789 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.659152  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.657626 12857 consensus_queue.cc:1243] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:18.688757  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:18.691283  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.691947  8535 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.695580  8536 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:18.697494  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.698257  8543 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:03:18.698241  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.699483  8537 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 12: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:18.703819  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.703969  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.705221  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.705860  8542 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:03:18.719339  8541 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:18.724013  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.657778 12745 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:18.724704  8544 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.683909 12750 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:18.728327 12750 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.728874 12750 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:18.693571 12781 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:18.659453 12845 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 13:03:18.736795  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 48168.3us
I20260709 13:03:18.733335  8388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:18.738988  8388 raft_consensus.cc:606] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.739045  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:18.706135 12844 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:18.659673 12846 consensus_queue.cc:1059] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:03:18.693869 12767 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:03:18.746270 12768 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:18.734901 12735 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.744818 12844 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.752700 12846 raft_consensus.cc:3055] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:18.754046  8470 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:18.701386 12567 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.759066  8535 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:18.758971 12567 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.761665 12567 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.764154  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.757836 12846 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:18.798745 12846 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.800022 12846 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.802666  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.804080  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.805938 12845 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.806846 12845 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.807559 12845 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.756577 12768 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.815241 12768 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.757611 12844 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:18.821933  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.763952 12735 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.822942  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.824096 12735 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.824119 12802 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.826357  8433 leader_election.cc:400] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12.
I20260709 13:03:18.757361 12599 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:18.827028 12599 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:18.827957 12599 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:18.842944  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.846037 12802 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:18.847790  8433 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:18.829633 12599 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.852808 12845 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.813235 12718 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.865407 12767 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:18.890549 12767 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:18.892422 12718 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:18.874980 12802 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.877190  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.893584 12767 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:18.896101  8359 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.896311 12789 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.895087  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:18.899915 12789 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:18.879297  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 105875us
I20260709 13:03:18.912041  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:18.913354 12767 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:18.917068  8468 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:18.921198  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.921437  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:18.922036  8465 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:18.924211  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:18.925832  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.929247  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.924211  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.931368  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:18.932062  8468 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:18.934613  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.942394 12735 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:18.943804  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.945415  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.951828  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:18.952781  8541 raft_consensus.cc:2410] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:18.953406  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 248) took 3534 ms. Trace:
I20260709 13:03:18.954373 12718 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:18.906353  8544 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 15.
I20260709 13:03:18.958700  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.959362  8541 raft_consensus.cc:2376] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7. Re-sending same reply.
I20260709 13:03:18.956806 12789 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:18.962316  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.944602  8289 catalog_manager.cc:5697] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 5 to 7, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 7 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.968140  8465 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
I20260709 13:03:18.976035 12789 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:18.958570  8290 rpcz_store.cc:276] 0709 13:03:15.419462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.457501 (+ 38039us) service_pool.cc:224] Handling call
0709 13:03:18.953297 (+3495796us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:18.511724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:18.512379 (+   655us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:18.512419 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:03:18.512448 (+    29us) tablet.cc:662] Decoding operations
0709 13:03:18.606459 (+ 94011us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:18.606533 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:18.606564 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:03:18.607276 (+   712us) tablet.cc:701] Row locks acquired
0709 13:03:18.607294 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:18.607444 (+   150us) write_op.cc:270] Start()
0709 13:03:18.607558 (+   114us) write_op.cc:276] Timestamp: P: 1783602198607398 usec, L: 0
0709 13:03:18.607577 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:03:18.628168 (+ 20591us) log.cc:844] Serialized 3091 byte log entry
0709 13:03:18.771611 (+143443us) op_driver.cc:464] REPLICATION: finished
0709 13:03:18.772382 (+   771us) write_op.cc:301] APPLY: starting
0709 13:03:18.772472 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:18.796841 (+ 24369us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:18.796968 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:18.841611 (+ 44643us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:18.866110 (+ 24499us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:03:18.866182 (+    72us) write_op.cc:312] APPLY: finished
0709 13:03:18.866670 (+   488us) log.cc:844] Serialized 73 byte log entry
0709 13:03:18.867610 (+   940us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:18.867759 (+   149us) write_op.cc:454] Released schema lock
0709 13:03:18.867827 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:18.868321 (+   494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:18.868369 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":532,"apply.run_cpu_time_us":10766,"apply.run_wall_time_us":95865,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29330,"num_ops":7,"prepare.queue_time_us":39484,"prepare.run_cpu_time_us":4110,"prepare.run_wall_time_us":116727,"replication_time_us":163876,"thread_start_us":39118,"threads_started":1}]]}
I20260709 13:03:18.970077  8289 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 8 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 10 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.978590 12789 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:18.978988  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:18.979712  8542 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.979962  8289 catalog_manager.cc:5697] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.982667  8540 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:18.984263  8536 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:18.984560  8541 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 16.
I20260709 13:03:18.987572  8541 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:03:18.998219  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.000279  8539 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 6.
I20260709 13:03:19.068039  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:03:19.069365  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 94251.1us
I20260709 13:03:19.071242  8535 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:19.070236  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:19.078634  8388 raft_consensus.cc:1240] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:19.083729  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.084414  8391 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.088791  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:19.089057  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.089766  8461 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:03:19.092463  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.093225  8461 raft_consensus.cc:2368] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:03:19.094637  8461 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:19.094899  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:19.095387  8394 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:19.095510  8395 raft_consensus.cc:1240] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:19.069046 12745 raft_consensus.cc:697] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.099892  8394 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:19.097890  8462 raft_consensus.cc:1240] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:19.092972  8508 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:19.071930 12735 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:19.095954  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.104017  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.104490  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:19.105348  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:19.105804  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.106006  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.106276  8464 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:19.106653  8387 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:19.107452  8466 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:19.107604  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.108827 12543 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:19.109266 12543 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.109622 12543 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:19.112032 12745 consensus_queue.cc:237] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.114851 12768 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.117199 12768 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:19.107275  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.091897 12512 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:19.123327 12512 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.122298  8394 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:19.123769 12512 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.124157  8463 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:03:19.124612 12870 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:19.125051 12870 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.125386 12870 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:19.129954  8433 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:19.104496  8465 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:19.132236  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.133388  8359 leader_election.cc:400] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:03:19.133940  8359 leader_election.cc:403] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:19.136307  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:19.137925  8542 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:19.138597  8394 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:19.135097 12735 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.141304  8390 raft_consensus.cc:1275] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:19.141773 12869 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:19.142601  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:19.135337 12871 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:19.153280  8394 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:19.154831  8391 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 16.
I20260709 13:03:19.157181  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.167297  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:19.174512 12870 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.138886 12802 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:19.178207 12870 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:19.182601 12543 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.188683  8393 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:19.188313 12750 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.158632 12768 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.148466 12867 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:19.194123  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.191654  8395 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:19.224510  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.227406  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.236649  8389 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:19.240406  8392 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:19.243088  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.158746 12789 consensus_queue.cc:1059] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:03:19.249500  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.228194 12802 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:19.252363  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 95656.7us
I20260709 13:03:19.254848  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:03:19.260128  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.262138  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 161010us
I20260709 13:03:19.265295  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:19.273604 12737 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:19.274355 12737 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:19.275635 12737 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.300081 12767 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:19.300607 12767 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.302259  8390 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:19.305344 12750 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:19.306871 12870 raft_consensus.cc:3055] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:03:19.318678  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 61702.2us
I20260709 13:03:19.319893  8433 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:19.319962  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.321033 12846 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:19.321612  8390 raft_consensus.cc:2393] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:19.314441 12870 raft_consensus.cc:740] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.325444 12870 consensus_queue.cc:260] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.321549  8433 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:19.340894  8395 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:19.341622  8393 raft_consensus.cc:3060] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:19.340919 12844 consensus_meta.cc:287] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 13:03:19.350775  8463 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:19.336011 12870 raft_consensus.cc:3060] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.337076 12420 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:19.339133 12846 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:19.366000 12543 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:19.367426 12735 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:19.301564 12767 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.363252  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.360932  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:19.382969  8395 raft_consensus.cc:2393] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 15: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
W20260709 13:03:19.381956  8507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.193:35967 timed out after 1.500s (SENT) [suppressed 44 similar messages]
I20260709 13:03:19.380936 12718 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.392663 12718 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.395745 12718 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:19.402626  8395 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:19.414357  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.415648  8395 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:19.398208 12846 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:19.386866 12735 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:19.363484 12844 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.370724 12420 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.385358 12512 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.439929 12846 raft_consensus.cc:697] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:19.441468 12846 consensus_queue.cc:237] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.443248  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.443984  8469 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:19.447670  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:19.451026  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.451879  8390 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:19.437623 12735 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:19.453337  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 92526.3us
I20260709 13:03:19.453691  8392 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:19.454123  8392 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.455986  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.456422  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.452946  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.457567  8463 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:19.460922  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.461077 12802 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:19.461884  8386 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 9: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:19.464586  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:19.464922 12844 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:19.465502  8391 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:19.466813  8535 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:19.467916 12735 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:19.468065  8389 raft_consensus.cc:3055] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:19.471259  8389 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.471647  8470 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:03:19.429978 12767 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:19.474745  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.486584  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.486954  8390 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:19.479163  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:19.480719  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:19.456961  8388 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:19.496246  8288 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 110) took 2053 ms. Trace:
I20260709 13:03:19.496917  8288 rpcz_store.cc:276] 0709 13:03:17.409997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.410254 (+   257us) service_pool.cc:224] Handling call
0709 13:03:19.439352 (+2029098us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80426,"reported_tablets":9}
I20260709 13:03:19.454834  8392 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.500520  8392 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.481089  8389 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.504781  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:19.507988  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:19.508929  9068 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:19.512185  8543 raft_consensus.cc:2393] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:19.451889 12420 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:19.515007  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50744 (request call id 242) took 2412 ms. Trace:
I20260709 13:03:19.512429  8509 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:19.520479  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:19.521546  8542 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.515462  8289 rpcz_store.cc:276] 0709 13:03:17.102599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.109902 (+  7303us) service_pool.cc:224] Handling call
0709 13:03:19.514939 (+2405037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:19.083301 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:19.114373 (+ 31072us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:19.114416 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:03:19.114435 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:19.115006 (+   571us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:19.115074 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:19.115106 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:03:19.115438 (+   332us) tablet.cc:701] Row locks acquired
0709 13:03:19.115457 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:03:19.115617 (+   160us) write_op.cc:270] Start()
0709 13:03:19.115737 (+   120us) write_op.cc:276] Timestamp: P: 1783602199115570 usec, L: 0
0709 13:03:19.115760 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:19.116435 (+   675us) log.cc:844] Serialized 1308 byte log entry
0709 13:03:19.118670 (+  2235us) op_driver.cc:464] REPLICATION: finished
0709 13:03:19.119134 (+   464us) write_op.cc:301] APPLY: starting
0709 13:03:19.119220 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:19.121086 (+  1866us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:19.121195 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:19.147109 (+ 25914us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:19.147276 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:03:19.147321 (+    45us) write_op.cc:312] APPLY: finished
0709 13:03:19.147544 (+   223us) log.cc:844] Serialized 41 byte log entry
0709 13:03:19.147735 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:19.147825 (+    90us) write_op.cc:454] Released schema lock
0709 13:03:19.147867 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:19.173586 (+ 25719us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:19.173634 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65447,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":5569,"apply.run_wall_time_us":35088,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12570,"num_ops":3,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":3140,"prepare.run_wall_time_us":39767,"replication_time_us":2755}]]}
I20260709 13:03:19.481946 12844 consensus_queue.cc:1059] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:03:19.535554  8389 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:19.536953  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.539453  8358 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:19.540784  8358 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:19.548053  8542 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
W20260709 13:03:19.552770  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 98245.8us
I20260709 13:03:19.553694  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:19.532279 12737 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:19.557695  8358 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:19.529495 12636 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:03:19.576869  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 194948us
I20260709 13:03:19.552899 12750 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:19.588359  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.573308  8358 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:19.578336 12789 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:19.585044 12846 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:03:19.578576 12745 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.565225 12844 raft_consensus.cc:3055] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:03:19.589480  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 74417.9us
I20260709 13:03:19.567773 12870 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:19.589622  8358 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:19.596271 12869 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:19.567158 12737 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:19.575860 12802 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:19.593192 12844 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:19.581368 12885 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.601625 12844 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.605347 12844 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.592523 12720 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.607002 12720 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:19.618018  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 61682.3us
I20260709 13:03:19.619583  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:19.592072 12744 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:19.626727  8389 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:03:19.590562 12789 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:19.631356  8389 pending_rounds.cc:85] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 6
W20260709 13:03:19.666013  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 67303.1us
I20260709 13:03:19.600603 12737 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:19.667403  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 46729.6us
I20260709 13:03:19.631784  8389 pending_rounds.cc:107] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:19.670181  8389 raft_consensus.cc:2889] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:19.671859  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.669572  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:19.637908 12789 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:19.686636  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:19.598838 12745 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.667377 12744 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.692973  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:19.630002 12846 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:03:19.693732  8434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.693117  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 95625.9us
I20260709 13:03:19.708593 12900 consensus_queue.cc:1059] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:19.629578 12885 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:19.690003 12512 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:19.716750  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:19.715123  8358 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:19.690590 12889 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:19.684496 12599 consensus_queue.cc:1059] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:03:19.700755 12867 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8.
I20260709 13:03:19.729755  8393 raft_consensus.cc:1275] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:03:19.703791 12869 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.713886 12735 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:19.766919  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.763170 12872 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.718017 12900 consensus_queue.cc:1059] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:03:19.781724  8392 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:03:19.787817  8392 pending_rounds.cc:85] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 7
I20260709 13:03:19.788305  8392 pending_rounds.cc:107] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:19.788668  8392 raft_consensus.cc:2889] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:19.761997 12802 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:19.782189  8394 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:19.770165 12735 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:19.769251 12889 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:03:19.798000  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 73492.4us
I20260709 13:03:19.825744  8358 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:19.818332 12735 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:19.784947 12904 consensus_queue.cc:1059] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:03:19.829844 12872 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.794341 12903 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:03:19.854004 12869 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.860981 12897 consensus_queue.cc:1059] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 13:03:19.866547  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 79658.9us
W20260709 13:03:19.869284  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 43700.9us
I20260709 13:03:19.795102 12744 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.870661  8358 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:19.881891 12899 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:19.882603 12899 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:19.885341 12899 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:19.850818 12900 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:19.886343 12900 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:19.889165 12901 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:03:19.895382  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:19.896207  9068 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
W20260709 13:03:19.898283  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 215173us
I20260709 13:03:19.878257 12846 raft_consensus.cc:3055] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:19.903709  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:19.905776  9068 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:03:19.892904 12900 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:19.914077 12745 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:19.914820 12909 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:19.916041 12905 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:03:19.917160 12636 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.917387 12908 raft_consensus.cc:3055] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:19.917804 12636 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:19.918530 12894 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:03:19.906123 12889 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.926537  8542 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:19.908301  8433 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:19.903491  8508 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:19.898816 12767 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:19.932893  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 328930us
I20260709 13:03:19.859089 12872 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.905066 12846 raft_consensus.cc:740] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:19.893236 12802 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.938311 12636 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:19.950956  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.958057  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:19.959908 12767 raft_consensus.cc:697] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.962543 12718 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:03:19.963392 12872 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:19.941864 12908 raft_consensus.cc:740] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.965590 12745 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.966229 12745 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:19.970090  8470 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:19.971222 12910 consensus_queue.cc:1059] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:03:19.971611 12891 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:19.972095 12891 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:19.972036 12913 consensus_queue.cc:1059] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:19.973122 12913 raft_consensus.cc:3055] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:19.972405 12910 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:19.973284 12891 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.974001 12910 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:19.974699 12912 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:19.973518 12913 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:19.975672 12750 raft_consensus.cc:3055] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:19.976264 12750 raft_consensus.cc:740] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:19.976157 12910 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.976329 12846 consensus_queue.cc:260] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:19.974859 12891 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.977751 12910 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:19.978004 12846 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:19.976666 12887 log.cc:927] Time spent T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.408s	user 0.000s	sys 0.002s
I20260709 13:03:19.975196 12912 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.947732 12904 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:19.983165  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:19.986527  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.986753  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.987529  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:19.988662 12636 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.991758  8469 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:19.991655 12636 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.994339 12913 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:19.991084 12912 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:19.996726 12913 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.996275 12737 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:19.998023  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:19.998813 12737 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:19.998674  8289 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 8 to 9, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:20.000496  8289 catalog_manager.cc:5697] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 9 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.001842  8470 raft_consensus.cc:2393] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:19.977675 12750 consensus_queue.cc:260] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.002141  8468 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:20.007803 12735 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.010336 12916 consensus_queue.cc:1048] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:20.011925  8289 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 8 to 9, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:20.013166  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:20.001860 12636 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:19.965337 12908 consensus_queue.cc:260] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.013955 12914 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.014595 12908 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.013922  8289 catalog_manager.cc:5697] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 10 to 11, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:20.017352  8507 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.018216  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:20.020879  8468 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:20.025190  8465 raft_consensus.cc:1240] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:03:20.026824  8535 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:03:20.026824  8538 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:20.027211 12599 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:20.027738 12599 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:20.028554 12599 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.029318 12912 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.030643 12745 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:20.031924 12912 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:20.032487  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.032603  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:20.032613 12892 log.cc:927] Time spent T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.455s	user 0.003s	sys 0.000s
I20260709 13:03:20.033857  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.034348 12885 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:20.019766  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:20.035221  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.037333  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.038249  8393 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:20.038048  8360 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:20.046033  8389 raft_consensus.cc:1275] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:03:20.046456  8389 pending_rounds.cc:85] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 7
I20260709 13:03:20.046689  8389 pending_rounds.cc:107] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:03:20.046932  8389 raft_consensus.cc:2889] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.048290  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:20.049069  8543 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:20.050489  8544 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:20.055058  8544 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:20.055162  8541 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:20.039261  8360 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:20.045867  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.062126  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:20.062583  8390 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:20.063235  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:20.063897  8468 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.029578 12599 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.010756 12735 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:20.066489  8389 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:20.068933  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:20.074874  9066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf"
dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:51846
I20260709 13:03:20.079480  9066 raft_consensus.cc:606] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.065380 12912 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:20.090247  8392 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:20.092043  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:20.093977  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:20.094506  9068 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:20.095467  8507 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.097657 12737 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.097695 12768 raft_consensus.cc:3055] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:20.070398 12904 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.098392 12789 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.098832 12904 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:20.099202  8509 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:20.100282 12737 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:20.098380 12768 raft_consensus.cc:740] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:20.100934 12904 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:20.101254 12903 raft_consensus.cc:3055] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:20.101478 12789 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:20.101668 12903 raft_consensus.cc:740] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:20.102702 12903 consensus_queue.cc:260] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:20.103543  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.104705 12903 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.962343 12767 consensus_queue.cc:237] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.109946 12906 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:20.110471 12906 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:20.110873 12906 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:20.114822  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:20.115603  8465 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
W20260709 13:03:20.118845  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 54822.9us
I20260709 13:03:20.119922  8358 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:20.121308  8465 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:20.122085  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:20.119400  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:20.123196  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 54404.3us
I20260709 13:03:20.124892  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:20.126224  8466 raft_consensus.cc:2410] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:20.126796  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:20.073907 12745 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.074118 12744 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:20.127079  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.129127  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
W20260709 13:03:20.135360 12919 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:20.136015  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:20.141157  8469 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.112234 12737 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:20.129647 12872 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:20.138411 12912 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:03:20.141322  8358 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.149502  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.150403  8390 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:20.151232  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:20.140549 12910 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:20.139562 12900 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:20.170022 12900 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.170704 12900 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:20.155931 12878 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:20.156378 12889 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.137930 12744 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:20.162968  8470 raft_consensus.cc:2393] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:20.155400  8507 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.156275 12895 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:03:20.178843  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 51855.1us
I20260709 13:03:20.124606 12789 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:03:20.182430  8466 raft_consensus.cc:1240] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:03:20.157451 12911 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:20.188282  8507 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.181592 12869 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.163503 12912 consensus_queue.cc:1243] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer 2122d8c723e84e3da22f81f7eeb4b1a9 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:20.179344 12872 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.194202  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:20.157817 12914 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:03:20.200348  8507 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.206363 12737 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:20.171991 12636 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:03:20.182157 12744 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:20.163967 12891 consensus_queue.cc:1059] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:03:20.140019 12745 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:20.225399  8535 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:03:20.242281  8358 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.242624  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.230829  8469 raft_consensus.cc:2468] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:20.210049 12543 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.209291 12567 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:20.248870  8508 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:20.194993 12867 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:03:20.262024 12907 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:20.264411 12636 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:20.268707  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:20.269524  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.283710  8389 raft_consensus.cc:3060] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.284026  8393 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:20.270121  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.270219  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:20.251580 12420 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:03:20.274143 12877 raft_consensus.cc:2804] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:20.243566 12878 consensus_queue.cc:1048] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:03:20.278911 12898 consensus_queue.cc:1048] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:20.280354 12745 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:20.286424  8386 raft_consensus.cc:2410] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:20.251677 12869 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.235183 12895 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:03:20.220243 12872 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:20.290666  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:20.253561 12891 consensus_queue.cc:1243] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer 2122d8c723e84e3da22f81f7eeb4b1a9 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:20.252605 12599 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:20.307669 12720 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:20.228284 12904 consensus_queue.cc:1059] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:03:20.298220  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.307711 12599 raft_consensus.cc:697] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:20.309122  8387 raft_consensus.cc:2410] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:20.295486  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:20.309653 12599 consensus_queue.cc:237] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.311333 12905 consensus_queue.cc:1059] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:03:20.287626 12911 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.313735 12911 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.316145 12911 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:20.317723  8464 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:20.283708  8468 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:20.287916  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:20.204547 12735 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:03:20.303324  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:20.303771 12869 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.320533  8391 raft_consensus.cc:2410] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:20.321126  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:20.322880  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:20.321171  8468 raft_consensus.cc:1240] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:20.323539  8539 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:20.327605  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:20.328935  8508 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:20.334349  8468 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:20.338624 12872 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:20.340799  8393 raft_consensus.cc:2393] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 10: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:20.345513  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:20.303406 12877 raft_consensus.cc:697] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:20.348819  8508 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:20.349905  8469 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:20.354090 12916 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:20.359102  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 164595us
I20260709 13:03:20.349865 12512 raft_consensus.cc:2804] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:20.363672  8389 raft_consensus.cc:2468] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:20.346055 12745 consensus_queue.cc:1059] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:03:20.384331  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.394025  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 268721us
I20260709 13:03:20.361035 12916 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.356310 12870 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:03:20.364851 12846 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:20.431291 12916 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:20.515470  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 152113us
I20260709 13:03:20.454928 12768 consensus_queue.cc:260] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:20.579808  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 185659us
I20260709 13:03:20.587544  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:20.589556  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 194443us
I20260709 13:03:20.590328  9033 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:20.437281 12745 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.599936  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:20.589860 12846 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:20.660410 12636 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:20.514909 12909 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.662408 12909 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:20.665941 12909 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:20.742491  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 151923us
I20260709 13:03:20.576470 12911 raft_consensus.cc:3055] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:20.744532  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 144730us
I20260709 13:03:20.744817 12911 raft_consensus.cc:740] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:20.589202 12844 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.598865 12768 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.741195 12737 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.746517 12891 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.669639 12745 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.750010 12907 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:20.779259 12927 log.cc:927] Time spent T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:03:20.765625 12803 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:20.788988 12744 consensus_meta.cc:287] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.000s
I20260709 13:03:20.789848 12914 raft_consensus.cc:3055] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:20.842835 12914 raft_consensus.cc:740] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:03:20.792965 12937 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:03:20.438485 12877 consensus_queue.cc:237] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.799950 12916 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:20.802565 12903 consensus_meta.cc:287] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.004s
I20260709 13:03:20.751698 12512 raft_consensus.cc:697] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:20.769387 12889 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:03:20.791785 12906 consensus_meta.cc:287] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.004s
W20260709 13:03:20.932029  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 79888.5us
I20260709 13:03:20.844098  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:20.846521  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.848881  8468 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:20.844897  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:20.777438 12869 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:20.835472 12543 consensus_meta.cc:287] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 13:03:20.754022 12844 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:20.937336  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:20.927677 12878 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:03:20.936305  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.805999 12911 consensus_queue.cc:260] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.843643 12803 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.924300  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:20.925173  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:20.848913 12867 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:20.805445 12891 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.986553  8467 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 16.
I20260709 13:03:20.940050 12825 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.947292 12543 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.851872 12744 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:20.969614 12903 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.005162 12803 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.980286 12897 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:21.080533  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 126401us
W20260709 13:03:21.095330  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 100799us
I20260709 13:03:21.088101 12867 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:20.946211 12889 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.070081 12905 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:21.098389  8394 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 7.
I20260709 13:03:20.940443 12906 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.071072  9066 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:21.097316 12543 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.079080 12825 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:21.148847 12924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.021s	sys 0.028s
W20260709 13:03:21.149471 12928 log.cc:927] Time spent T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:03:21.006803 12914 consensus_queue.cc:260] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.151870 12750 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.157980 12543 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.097064 12897 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.131471 12910 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.093061 12903 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:21.197681 12954 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:03:21.198446 12933 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.426s	user 0.001s	sys 0.000s
I20260709 13:03:21.199363 12916 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:21.202203 12745 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:21.202486 12946 log.cc:927] Time spent T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:03:21.203886 12906 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.204980 12891 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.206135 12744 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.092418 12512 consensus_queue.cc:237] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:21.192015 12924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.022s	sys 0.029s
I20260709 13:03:21.214066 12825 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:21.215384 12936 log.cc:927] Time spent T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:03:21.215787 12948 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.147610 12905 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:21.216195 12913 consensus_meta.cc:287] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 1.217s	user 0.012s	sys 0.000s
I20260709 13:03:21.216532  8462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47226 (request call id 3402) took 1103 ms. Trace:
W20260709 13:03:21.216946 12939 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:03:21.222502  8461 raft_consensus.cc:2410] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:21.224954 12414 raft_consensus.cc:993] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:21.226480 12883 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.227828  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 2334) took 1208 ms. Trace:
I20260709 13:03:21.231261 12899 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.254045 12789 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.206029 12914 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:21.218468 12910 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.215317 12803 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:21.224097 12900 consensus_meta.cc:287] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 1.053s	user 0.008s	sys 0.007s
W20260709 13:03:21.255143  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 496413us
I20260709 13:03:21.256304  8462 rpcz_store.cc:276] 0709 13:03:20.112887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.114010 (+  1123us) service_pool.cc:224] Handling call
0709 13:03:20.118315 (+  4305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.140629 (+ 22314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.140665 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.151049 (+ 10384us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.400514 (+249465us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:20.400575 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.400677 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.216209 (+815532us) raft_consensus.cc:1685] finished
0709 13:03:21.216231 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.216421 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31176,"raft.queue_time_us":23974,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":11179,"thread_start_us":190104,"threads_started":1,"wal-append.queue_time_us":599756}
I20260709 13:03:21.263329  8463 raft_consensus.cc:2410] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:21.235236 12867 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.274628  8464 rpcz_store.cc:276] 0709 13:03:20.019251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.019473 (+   222us) service_pool.cc:224] Handling call
0709 13:03:21.227618 (+1208145us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54003cc8d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:21.227729 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648698240}
I20260709 13:03:21.238667 12903 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.286537  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:21.262511 12891 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:21.294956  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 162060us
I20260709 13:03:21.297266  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3326) took 1010 ms. Trace:
I20260709 13:03:21.280710 12844 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.292533 12414 raft_consensus.cc:1081] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:21.276055 12948 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.294552 12825 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:21.281490 12899 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.369019  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:21.370162  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:21.345768 12543 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:21.373034 12974 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:21.300019  8387 rpcz_store.cc:276] 0709 13:03:20.287158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.311985 (+ 24827us) service_pool.cc:224] Handling call
0709 13:03:20.312553 (+   568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.312896 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.312921 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.313352 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.369109 (+ 55757us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:20.909694 (+540585us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.297015 (+387321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.297077 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.297109 (+    32us) raft_consensus.cc:1685] finished
0709 13:03:21.297118 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.297217 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37531,"prepare.queue_time_us":559276,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":324533,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":246,"thread_start_us":883448,"threads_started":3,"wal-append.queue_time_us":515762}
I20260709 13:03:21.346851 12905 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.382120  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:21.383095  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.290328 12900 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:21.350064 12956 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:03:21.469254  8464 raft_consensus.cc:2393] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 7: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:21.350169  9060 raft_consensus.cc:2393] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 8: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:03:21.350670 12897 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.351187 12930 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:21.479481 12930 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.345820 12962 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.481982  8390 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:21.482556  8470 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:21.482249 12962 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:21.357268  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.484092 12876 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.484663 12876 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:21.485280  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.486940 12876 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.358740 12803 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:21.290437 12883 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.292817 12891 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.362424 12948 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.363646 12910 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.509495 12911 raft_consensus.cc:3060] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:21.364346 12939 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:21.511986 12910 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.365199 12889 leader_election.cc:290] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.512593 12910 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.369277 12899 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.373651 12974 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.514941 12910 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.515269 12974 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.375175 12869 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.516070 12869 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.516853  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3319) took 1232 ms. Trace:
I20260709 13:03:21.517030  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.518406 12869 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.517282  8395 rpcz_store.cc:276] 0709 13:03:20.284236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.290283 (+  6047us) service_pool.cc:224] Handling call
0709 13:03:20.290627 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.351214 (+ 60587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.351246 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.351698 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.448405 (+ 96707us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:20.747311 (+298906us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.829153 (+ 81842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.231035 (+401882us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b18000ca720. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe10374c0a 00007fbe19ab4219 00007fbe173bb58f 00007fbe103fa571 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd
0709 13:03:21.516488 (+285453us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b5400118fd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:21.516567 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.516615 (+    48us) raft_consensus.cc:1685] finished
0709 13:03:21.516629 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.516781 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139087,"prepare.queue_time_us":499342,"raft.queue_time_us":188947,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":11657,"spinlock_wait_cycles":286144000,"thread_start_us":247505,"threads_started":2,"wal-append.queue_time_us":639814}
I20260709 13:03:21.377589 12745 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.520650 12745 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.376951  8360 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
W20260709 13:03:21.522142  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 145275us
I20260709 13:03:21.377857 12750 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.283254 12789 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:21.378352 12909 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:21.527558 12909 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.528108 12962 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.528692 12789 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:21.379804  8391 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:21.380036  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.381489  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:21.387077  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.530447  8462 raft_consensus.cc:2393] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:21.387367  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.530982  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.522779 12745 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.389313  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:21.389931  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.444152  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:21.477701  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:21.478048 12976 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.491171  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:21.535557  8464 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.494289  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.504369 12883 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.507128 12891 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.493417 12897 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.508562 12930 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:21.518766 12900 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.519544  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.378100 12906 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.530930  8465 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:21.537429 12905 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.550071 12906 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.550416 12905 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.552376 12906 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.552668 12905 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.552919 12906 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.524437 12869 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:21.553547 12869 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.553773  8393 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:21.553984 12869 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.539024  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:21.540937  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.544572  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.558409  8391 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 13.
I20260709 13:03:21.534641 12750 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.559322  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.560384 12750 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.545312 12897 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.563273 12897 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.555783 12906 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.566608 12906 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:21.573199  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 99784.4us
I20260709 13:03:21.575847  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.591338  8464 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:21.591259  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.529716 12909 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.592388  8465 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:03:21.593338  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.528709 12876 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.596240  9032 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:21.599937  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.600242  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.600636  8466 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:21.600875  8464 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:21.599954  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.601917  8469 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:21.602555  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.603842  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:21.604820  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.605501  8387 raft_consensus.cc:2393] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 14: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:21.607527  8467 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:21.609385  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.611986  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:21.621709  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 53578.6us
I20260709 13:03:21.608793 12961 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:21.623193 12961 raft_consensus.cc:493] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.623773 12961 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.558015 12976 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.632170 12976 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.632861 12905 raft_consensus.cc:493] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:21.633374  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3331) took 1240 ms. Trace:
I20260709 13:03:21.633517 12905 raft_consensus.cc:515] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.634156  8388 rpcz_store.cc:276] 0709 13:03:20.392546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.392950 (+   404us) service_pool.cc:224] Handling call
0709 13:03:20.393403 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.425126 (+ 31723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.425168 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.425631 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:03:21.360844 (+935213us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b18003d4200. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:03:21.544059 (+183215us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:21.598715 (+ 54656us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.604238 (+  5523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.604319 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.632903 (+ 28584us) raft_consensus.cc:1685] finished
0709 13:03:21.633085 (+   182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.633289 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38435,"prepare.queue_time_us":49599,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":2406,"raft.queue_time_us":39776,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":13728,"spinlock_wait_cycles":7325056,"thread_start_us":182976,"threads_started":1,"wal-append.queue_time_us":1204473}
I20260709 13:03:21.636786 12897 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:21.637420 12897 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.606483 12750 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.638805 12750 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.639675 12897 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.644371  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:21.659745  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:21.660054  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:21.637491  8392 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 16.
I20260709 13:03:21.665584  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:21.620517 12543 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:21.670518  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:21.615144 12512 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:21.646689 12905 leader_election.cc:290] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.606695 12876 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.646493 12976 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:21.694924  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.696089  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.696771  8465 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:21.679576 12543 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.707367 12986 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.669291 12869 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.690840 12750 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.695207  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:21.718501 12869 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.720598  8388 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:21.697417 12767 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:21.722703  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:21.725124  9065 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.710587 12917 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:21.698926 12893 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:03:21.688814 12512 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.708010 12986 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.713757  9066 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:21.737011  9065 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:21.695315 12976 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.738219  8360 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:21.724941 12767 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:21.743996  8387 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:03:21.744343  8387 pending_rounds.cc:85] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 4
I20260709 13:03:21.744529  8387 pending_rounds.cc:107] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:03:21.744719  8387 raft_consensus.cc:2889] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:21.746608  8360 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:21.742627 12908 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:21.748466 12908 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:21.749327  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3313) took 1482 ms. Trace:
I20260709 13:03:21.749838  8390 rpcz_store.cc:276] 0709 13:03:20.266971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.269886 (+  2915us) service_pool.cc:224] Handling call
0709 13:03:21.749107 (+1479221us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003c8a54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:21.749267 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2751532416}
I20260709 13:03:21.739117 12543 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:21.739820 12869 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.753643  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.754408  8390 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:21.757002  8390 pending_rounds.cc:85] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 5
I20260709 13:03:21.757320  8390 pending_rounds.cc:107] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:03:21.757524  8390 raft_consensus.cc:2889] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:21.755678  8507 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:21.759950 12986 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:21.755285 12869 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.749449 12908 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.753481 12750 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:21.763871 12986 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:21.765008 12986 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:21.765385 12986 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.767665 12876 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.768441  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.769984 12750 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:21.771112 12750 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.773308  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.774632  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47226 (request call id 3405) took 1652 ms. Trace:
I20260709 13:03:21.775166  8461 rpcz_store.cc:276] 0709 13:03:20.121731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.121859 (+   128us) service_pool.cc:224] Handling call
0709 13:03:21.774383 (+1652524us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400237b54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:21.774566 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2521234816}
I20260709 13:03:21.776664  8468 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:21.773181  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:21.777364  8468 pending_rounds.cc:85] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 3
I20260709 13:03:21.777751  8468 pending_rounds.cc:107] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:21.778283  8468 raft_consensus.cc:2889] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:21.779249  8463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47242 (request call id 2326) took 1796 ms (client timeout 1819 ms). Trace:
W20260709 13:03:21.779886  8463 rpcz_store.cc:269] 0709 13:03:19.982787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.982905 (+   118us) service_pool.cc:224] Handling call
0709 13:03:21.776118 (+1793213us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003ccdd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:21.779168 (+  3050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2930039168}
I20260709 13:03:21.777104 12893 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:21.780965 12907 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.789105 12911 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:21.794106 12876 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.802933 12897 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.809197 12907 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.811691 12909 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.824885 12909 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.825634 12745 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.826453 12745 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.819717 12897 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.830294 12897 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.829483 12891 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:21.831300  8394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60598 (request call id 572) took 1740 ms (client timeout 1833 ms). Trace:
I20260709 13:03:21.831606 12891 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:21.831813  8394 rpcz_store.cc:269] 0709 13:03:20.090554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.103231 (+ 12677us) service_pool.cc:224] Handling call
0709 13:03:21.831103 (+1727872us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54001194d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:21.831233 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286161792}
I20260709 13:03:21.832439 12512 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:21.838442  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.839669  8542 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 16.
I20260709 13:03:21.837507  8535 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:21.842375  8541 raft_consensus.cc:1240] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:21.845491  8465 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:21.851820  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.855614  8544 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:21.857887  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.813645 12906 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.858886  8465 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:21.863549  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.859756  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.858929  8544 raft_consensus.cc:1240] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:21.860291  8536 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:21.865332  8464 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 12: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:21.860519  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.860591  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.861874  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:21.869014  8537 raft_consensus.cc:2393] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:21.862929  8538 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:21.858711  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:21.810413 12893 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.868225  8435 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
W20260709 13:03:21.878494  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.822532 12907 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.793435 12767 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.877892  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.883419  8469 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:21.872010  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:21.878019  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.888019  8464 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:21.815575 12911 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.903000 12976 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.903489 12911 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:21.861374 12897 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.906147 12897 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:21.908329 12897 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.874712  8463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:48784
I20260709 13:03:21.909345  8463 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.909747  8463 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.886804  8540 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:21.867159 12420 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:21.817320 12876 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.899103 12909 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:21.901088 12767 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.914433  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.946272  8540 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:21.946873  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:21.869745 12985 log.cc:927] Time spent T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:03:21.918259  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:21.918845  8464 raft_consensus.cc:2468] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 8.
I20260709 13:03:21.949690  8395 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:21.919117  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:21.919557  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.920779  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.921061  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.951370  8537 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:21.951455  8543 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:21.951911  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:21.952349  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.922343  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.922685  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.819180 12961 raft_consensus.cc:515] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.916579  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.936245  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:21.937757  8463 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:21.975167  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 57416.4us
I20260709 13:03:21.976538  8358 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:22.008906  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:21.953325  8542 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:22.009608  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:21.953153  8544 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:22.008908  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.011562  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.014881  8464 raft_consensus.cc:2410] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:03:22.025467  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.942004 12989 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:03:22.030295  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:22.055740  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.916335 12891 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.137073  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.138090  8464 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 14.
I20260709 13:03:21.928504 12911 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:21.940497 12976 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:22.147887  9068 raft_consensus.cc:2393] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 14: Already voted for candidate 92314b14f5554885a80c3dc87f4beed4 in this term.
I20260709 13:03:22.144577  8463 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:22.144281  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.146221  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:22.154175  9065 raft_consensus.cc:3055] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:22.154554  9065 raft_consensus.cc:740] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:21.952438 12889 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:21.888697 12906 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.024740 12789 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:22.025250 12870 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:22.148756 12937 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:03:22.010303 12909 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:22.011179 12869 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.153386  8540 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:22.025566 12962 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:22.160781  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.227313  8470 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:22.155534  9065 consensus_queue.cc:260] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:21.941916 12420 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.158481 12958 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:22.174297 12789 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.255407 12789 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.255905 12906 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.256469 12420 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:22.221545 12985 log.cc:927] Time spent T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:22.249977  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.168840 12976 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.253264  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.249541 12802 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.253827  9065 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:22.254624 12958 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.258086  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.272044  8508 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
W20260709 13:03:22.221827 12984 log.cc:927] Time spent T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:22.158989 12911 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.284876  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:22.322659 12993 log.cc:927] Time spent T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:03:22.323155  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:22.323490 12911 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:22.326740  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.326565  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54621.2us
I20260709 13:03:22.332208  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:22.249943 12962 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:22.365113  8386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.003s	sys 0.043s
W20260709 13:03:22.382393  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 67387.8us
W20260709 13:03:22.393996  9034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.395946  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.396997  8463 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:22.404850 12996 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:22.410765 12934 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:22.370961 12987 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:22.365623 12735 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:22.288955 12802 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.367200 12876 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.289877 12897 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:22.224933 12870 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.384181  8507 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:03:22.417752 12986 consensus_meta.cc:287] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
W20260709 13:03:22.453925  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 69865.5us
I20260709 13:03:22.444484 12735 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:22.423378 12976 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.463130 12846 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:22.442572 12958 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.460456 12420 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:22.366925 12891 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:22.435691 12962 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.440912 12893 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.479898  9065 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
W20260709 13:03:22.485276  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 260929us
I20260709 13:03:22.488370  9033 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:22.490718  9033 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:22.482636 12846 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.483498 12420 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:22.491555 12891 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.498517 12881 raft_consensus.cc:2804] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:22.499722 12884 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:22.478017 12986 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.469939 12897 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.521232 12789 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:22.528388 12907 consensus_meta.cc:287] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:03:22.528898 12907 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.531294 12789 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.534158 12897 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:22.535782 12802 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:22.518468 12884 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:22.513541 12420 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.539379 12884 raft_consensus.cc:3060] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.509472 12846 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.526772 12881 raft_consensus.cc:697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:22.546037  8537 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 17: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:22.538877 12735 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.560976 12907 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.561333 12870 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:22.562554 12986 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.560978 12846 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:22.574333  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 83693us
I20260709 13:03:22.576884  8435 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:22.582074 12420 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.586630 12420 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.593138  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3338) took 1203 ms. Trace:
I20260709 13:03:22.593614  8393 rpcz_store.cc:276] 0709 13:03:21.389562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.389672 (+   110us) service_pool.cc:224] Handling call
0709 13:03:22.592960 (+1203288us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5400306bd4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:22.593076 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47387392}
I20260709 13:03:22.587558 13003 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:22.601670  9065 raft_consensus.cc:1240] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:22.604347  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.604614  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.604952  8540 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:22.605693  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.610316  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:22.610507  8538 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:22.612134 12941 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.612690 12941 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.613481  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:22.614032  9060 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:22.614832 12941 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.599064 12986 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:22.616888  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 206864us
I20260709 13:03:22.574615 12881 consensus_queue.cc:237] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.619432  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.619640  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.620343  8542 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 15.
I20260709 13:03:22.615487  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.620869  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.621255  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.621712  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.623026  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.615628  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:22.616648 12986 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.623775  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:22.623993  8508 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:22.624557  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.624013  8538 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:03:22.626569  8543 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:22.629217  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becd976429a45a3874a10895b19b63e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.632736  9066 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:22.634280  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.634543  8535 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:03:22.634752 12986 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:22.635174  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.629349 12543 consensus_queue.cc:1059] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:03:22.599874 12891 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.635691  8435 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:22.638746 12891 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:22.639348 12891 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.639740 12891 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.629220  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.642577  8540 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 16.
I20260709 13:03:22.651626  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.642753 12735 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:22.652702  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.644658 12543 raft_consensus.cc:3055] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:22.661077 12543 raft_consensus.cc:740] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:22.662416 12971 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:22.663091 12971 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.665398 12971 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:22.611311 13003 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:22.645141 12884 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.629503  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.649993  8464 raft_consensus.cc:1275] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:22.629868  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:22.642577  8542 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:22.658918 12961 leader_election.cc:290] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.659271  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.668354  8468 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:22.668637  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.660439  8470 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:03:22.670694  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:22.672134  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 44236.5us
I20260709 13:03:22.672798  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.674024  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.673986  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:22.674845  8540 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:22.676373  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:22.676419  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.681159  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:22.682086  8468 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:22.682559  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:22.682976  8433 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:22.683285  8464 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 12: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:22.662367 12543 consensus_queue.cc:260] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.687639 12846 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:22.688081 12543 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:22.688575 12953 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:22.689018 12953 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.689369 12953 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.653079 12735 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.684089  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:22.693485  8433 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:22.694097  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.695829  8433 leader_election.cc:304] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:22.698536  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.699868  8463 raft_consensus.cc:2410] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:03:22.679641 12889 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:22.707428  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:22.679989 13002 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:03:22.716217 13002 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:22.716763 13002 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.717126 13002 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.708416 12897 raft_consensus.cc:2749] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:22.694521  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:22.698139 12735 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:22.724165 12953 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.709824 13003 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.680450 12971 consensus_queue.cc:1059] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:03:22.738585 12971 raft_consensus.cc:3055] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:22.739037 12971 raft_consensus.cc:740] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:22.739998 12971 consensus_queue.cc:260] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.740978  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:22.741305 12971 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.701578 12802 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:22.701828 12846 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:22.743058 12846 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.743431 12846 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:22.746953  9032 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:22.748649  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.751840  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:22.754637  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:22.756995  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:22.705945 12889 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:22.758347 13002 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:22.771289 13002 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 17 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.780851  8536 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:22.753189 12891 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.758347 12727 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:22.763280 12420 consensus_queue.cc:1048] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:22.783254 12891 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:22.783857 12898 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:22.784305 12898 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:22.784657 12898 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.792307  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:22.793087  9060 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.810814 12884 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.811439 12889 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.812017  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:22.807050 12735 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.827394  8543 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:22.828435  8542 raft_consensus.cc:1240] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:22.831092  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.821166  8462 raft_consensus.cc:2468] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 14.
I20260709 13:03:22.834568  8508 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:22.839735  9033 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:22.840705 12917 raft_consensus.cc:2804] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:22.841367 12917 raft_consensus.cc:697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 14 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:22.842013 12420 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:22.842530 12420 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:22.843140 12420 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:22.842478 12917 consensus_queue.cc:237] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:22.585352  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.829903 12953 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.851298 12745 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.853566  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 111) took 3303 ms. Trace:
I20260709 13:03:22.859269  9060 raft_consensus.cc:2468] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
W20260709 13:03:22.859656  9034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.854305 12889 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.895346 12898 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.869807  8289 rpcz_store.cc:276] 0709 13:03:19.570021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.581248 (+ 11227us) service_pool.cc:224] Handling call
0709 13:03:22.853495 (+3272247us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:20.144016 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:20.144693 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:20.144726 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:03:20.144745 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:20.145374 (+   629us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:20.145450 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:20.145479 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:20.145932 (+   453us) tablet.cc:701] Row locks acquired
0709 13:03:20.145954 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:03:20.146105 (+   151us) write_op.cc:270] Start()
0709 13:03:20.146279 (+   174us) write_op.cc:276] Timestamp: P: 1783602200146051 usec, L: 0
0709 13:03:20.146313 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:03:20.228916 (+ 82603us) log.cc:844] Serialized 1674 byte log entry
0709 13:03:21.695911 (+1466995us) op_driver.cc:464] REPLICATION: finished
0709 13:03:21.782617 (+ 86706us) write_op.cc:301] APPLY: starting
0709 13:03:21.794191 (+ 11574us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:22.482345 (+688154us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:22.487747 (+  5402us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:22.536381 (+ 48634us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:22.536601 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:03:22.536660 (+    59us) write_op.cc:312] APPLY: finished
0709 13:03:22.548995 (+ 12335us) log.cc:844] Serialized 49 byte log entry
0709 13:03:22.561952 (+ 12957us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:22.562054 (+   102us) write_op.cc:454] Released schema lock
0709 13:03:22.562104 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:22.562529 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:22.562559 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55369,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":63780,"apply.run_cpu_time_us":12239,"apply.run_wall_time_us":782783,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20887,"num_ops":4,"prepare.queue_time_us":31671,"prepare.run_cpu_time_us":55360,"prepare.run_wall_time_us":1105402,"raft.queue_time_us":189463,"raft.run_cpu_time_us":6567,"raft.run_wall_time_us":61470,"replication_time_us":1529294,"thread_start_us":1195571,"threads_started":4,"wal-append.queue_time_us":1021105}]]}
I20260709 13:03:22.847535 12735 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.899641 12889 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.899137 12846 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.899657 12898 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.902694 12420 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:22.910903 12846 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:22.920286 12420 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:22.927364  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3350) took 1010 ms. Trace:
I20260709 13:03:22.927906  8387 rpcz_store.cc:276] 0709 13:03:21.917435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.918899 (+  1464us) service_pool.cc:224] Handling call
0709 13:03:21.954771 (+ 35872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.954955 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:22.142101 (+187146us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.873836 (+731735us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b18002ccc80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe10374c0a 00007fbe19ab4219 00007fbe103fca40 00007fbe103f74e4 00007fbe103f7455 00007fbe134df060 00007fbe134f1716 00007fbe13502287 00007fbe13502208
0709 13:03:22.927015 (+ 53179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.927069 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:22.927110 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.927177 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.927302 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6495,"prepare.queue_time_us":187640,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":731771,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":165,"spinlock_wait_cycles":21030272,"thread_start_us":52908,"threads_started":1}
I20260709 13:03:23.032814  8435 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:23.033666 12889 raft_consensus.cc:2804] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:23.034235 12889 raft_consensus.cc:697] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:23.035231 12889 consensus_queue.cc:237] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:23.061554  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 201404us
I20260709 13:03:23.062659  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.063849 12878 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:23.066011 12900 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.066548 12900 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:23.067324  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.078094 12900 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.107677  8470 raft_consensus.cc:2393] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 12: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:23.139868  8540 raft_consensus.cc:2468] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 14.
W20260709 13:03:23.142882  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 435552us
I20260709 13:03:23.143697  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:23.146961 12889 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:23.148069 12889 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.148445 12889 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:23.149821  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.152127  8387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:23.152796  8387 raft_consensus.cc:606] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.153151  8387 raft_consensus.cc:614] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:23.145316  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:23.157382 12846 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:23.158084 12846 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.158386  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.159164  8389 raft_consensus.cc:2393] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 in current term 14: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:23.159919 13009 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.160081 12846 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.160434 13009 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:23.162678 13009 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.163975  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79a5acddc004781bbeac307ae4e58d1" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.169729 12953 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:23.170197 12953 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.170564 12953 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.174847  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:23.175587  8464 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:23.176260  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.191746  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.193553  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:23.196455  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.196787  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.197265  8541 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.198619  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.199867  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.201404  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.202313  8395 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 9.
W20260709 13:03:23.207744  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.211047  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.211602  8388 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:23.213008  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.213670  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3334) took 1834 ms. Trace:
I20260709 13:03:23.214383 12789 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:23.214694 12744 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:23.214771  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.215066 12789 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:23.215200 12744 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.206288 12953 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.216912  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.217455 12789 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:23.214088  8358 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.219075  8393 raft_consensus.cc:1240] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:03:23.222868  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3348) took 1309 ms. Trace:
I20260709 13:03:23.228475  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.447997  8387 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:23.230764  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.231158  8470 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:23.232457  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.232676  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.450902  8392 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:23.218187 12953 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.233525  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.214075  8386 rpcz_store.cc:276] 0709 13:03:21.379277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.385670 (+  6393us) service_pool.cc:224] Handling call
0709 13:03:21.386006 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:21.836414 (+450408us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b2c001ab198. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe11797291 00007fbe117b20ca 00007fbe134e04ad 00007fbe134e6e1b 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2
0709 13:03:21.836525 (+   111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:21.836552 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:21.862783 (+ 26231us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.366508 (+503725us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:22.486747 (+120239us) log.cc:844] Serialized 14 byte log entry
0709 13:03:23.213297 (+726550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.213388 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.213429 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:23.213509 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.213615 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739154,"prepare.queue_time_us":121332,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":813766,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":3798,"spinlock_wait_cycles":2618752,"thread_start_us":503320,"threads_started":1,"wal-append.queue_time_us":601609}
I20260709 13:03:23.239274  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:23.516400  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 302376us
I20260709 13:03:23.239962  8540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:23.518026  8540 raft_consensus.cc:606] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.240643  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.526221  8395 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 16.
I20260709 13:03:23.243187  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:23.251482  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:23.255625 13011 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:23.258451  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.261871  9032 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.527854  8462 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.528026  8461 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.528160  8535 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:23.528390  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 270475us
I20260709 13:03:23.262311  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.263944  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.264387 12987 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.529884  8538 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.529979  8539 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.265542  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.271265  8541 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:23.274389  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.530512  8542 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:23.279244  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.293911  8467 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:03:23.303929  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.471002  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 122612us
I20260709 13:03:23.531273  8544 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
W20260709 13:03:23.531440  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.445973  8394 rpcz_store.cc:276] 0709 13:03:21.913639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.913772 (+   133us) service_pool.cc:224] Handling call
0709 13:03:21.914158 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:21.937234 (+ 23076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:21.937278 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:21.954498 (+ 17220us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.641922 (+687424us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b180044cc20. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:03:22.732614 (+ 90692us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:22.761217 (+ 28603us) log.cc:844] Serialized 14 byte log entry
0709 13:03:23.222428 (+461211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.222512 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.222554 (+    42us) raft_consensus.cc:1685] finished
0709 13:03:23.222648 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.222799 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":462525,"prepare.queue_time_us":28377,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":463165,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":16410,"spinlock_wait_cycles":9767296,"thread_start_us":90460,"threads_started":1,"wal-append.queue_time_us":629498}
I20260709 13:03:23.473017  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.473956 12930 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:03:23.476969  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.477010  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.471655 12872 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.276381  8464 raft_consensus.cc:2468] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:23.534700  8393 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:23.534663  8358 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.542724  8542 raft_consensus.cc:2468] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:23.538116  8390 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:03:23.544700  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.543344  9032 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.546663  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:23.549474  8461 raft_consensus.cc:2468] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:23.550529  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.551182  8393 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:23.543576 12885 raft_consensus.cc:2804] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:23.551908 12885 raft_consensus.cc:697] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 14 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:23.552292  9060 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:23.552757 12885 consensus_queue.cc:237] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:23.553511  9066 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:23.538686 12909 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:23.553946 12869 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:23.554363 12909 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.555109 12872 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.556463 12909 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.557126 12872 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.562897  8539 raft_consensus.cc:2468] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:23.564510  8462 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:23.567435  8358 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.569607  8358 leader_election.cc:304] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.570322  8461 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:23.571861  8535 raft_consensus.cc:2468] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 16.
I20260709 13:03:23.574007 13011 consensus_queue.cc:1059] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:23.574453 12567 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:23.574836 12909 raft_consensus.cc:3055] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:23.575239 12909 raft_consensus.cc:740] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:23.576296  8508 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:23.570379 12789 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:03:23.577641 12996 raft_consensus.cc:2804] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:23.576013 12909 consensus_queue.cc:260] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:23.576392 13000 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:23.578235 12996 raft_consensus.cc:697] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:23.566206 12745 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:03:23.578704 12909 raft_consensus.cc:3060] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.580329  8508 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:23.580785  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.582674  8538 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 17.
I20260709 13:03:23.579155 12996 consensus_queue.cc:237] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.557735 12965 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:23.551098 12750 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:23.585062  8508 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:23.566321 12908 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:23.538033 12987 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.580179 12900 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:23.586822  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.586414 12745 raft_consensus.cc:3060] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.586908  8358 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.591114 12877 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:23.590867 12898 raft_consensus.cc:2804] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:23.595489  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.596092  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.595471  8358 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.594478 12900 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.597133 12908 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:23.594647 12930 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.598618 12869 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:23.590487 12789 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:03:23.599316 12869 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.598719 12908 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.599723 12869 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:23.599895 12908 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.598575 12900 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.600016  8543 raft_consensus.cc:2393] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 11: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:23.599740 12987 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:23.588644 12750 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.573197 12872 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:03:23.601851 12750 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.602306  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.603420  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.604795 12877 raft_consensus.cc:697] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:23.606228 12877 consensus_queue.cc:237] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.607969 12930 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:23.611182  8358 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.613504 12898 raft_consensus.cc:697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:23.614879 12898 consensus_queue.cc:237] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.617262  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.618443  8389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:23.619048  8389 raft_consensus.cc:606] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.619375  8389 raft_consensus.cc:614] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:23.588527 12965 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:23.620252 12965 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:23.623611 12930 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.624471 12744 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.625063 12744 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:23.632812  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:23.633430  8538 raft_consensus.cc:606] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:23.621091 12900 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.635324  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.635977  8535 raft_consensus.cc:2410] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:03:23.638523  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.632077  8358 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.644021  8358 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.644843 12872 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:23.644981 12744 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:23.645529 12872 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.645584 12744 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.646095 12872 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:23.646144 12744 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.648286  8358 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.649101 12789 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:23.649482 12789 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.649842 12789 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:23.652287 12889 consensus_meta.cc:287] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.503s	user 0.014s	sys 0.007s
I20260709 13:03:23.652729 12889 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.654682  8389 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:23.654323 12744 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.657256 12744 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.658457  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.665855  8389 raft_consensus.cc:3060] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:23.668614  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 489041us
I20260709 13:03:23.670182  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.671752 12802 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.672289 12802 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.673171  8433 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:23.673475  8395 raft_consensus.cc:1275] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:23.674075 12897 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.674548 12897 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.675997 12846 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:23.676635 12897 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.679888  9068 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:23.678957  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.681499  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.683652  8358 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.685829  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.684896  8395 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:23.688207 13011 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:23.688536  9060 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:23.689422 13003 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.689992 13003 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.692668 13003 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.687815  8538 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.696916  8358 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.698103  8389 raft_consensus.cc:1275] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:23.706679  8433 leader_election.cc:304] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:23.656283 12908 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:23.707799  8538 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:23.708514  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.724190  8389 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.709717  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:23.726197  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.677222 12897 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:23.727770  8433 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.732956  8387 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 13: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:23.724149 13003 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:23.708727 12953 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:23.734726  8389 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 17.
I20260709 13:03:23.706727 13011 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:23.736004  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.738165  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.734105  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:23.729054 13009 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:23.741237  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:23.743934  8465 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:23.724627 12846 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:03:23.744831 12897 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:23.727645 13002 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:03:23.736519 12953 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:23.738601 12802 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.738452 12744 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.743758 13011 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:23.758033  8433 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:23.764146  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:23.775821  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 518776us
I20260709 13:03:23.775926 12971 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:23.777148  8359 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.778158 12889 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.779183  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.779980  8386 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 13: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:23.781082  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.776805 12971 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.782860  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.783756  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.760432 13003 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:23.758513 12953 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:23.786127  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.788033  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.789347  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.744553 12965 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:23.792052  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.794487  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.767504 12802 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:23.797554 13011 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.801049  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.803442 12869 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.806397 12911 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:23.807224 12911 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:23.807480 12745 raft_consensus.cc:2749] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:23.807919 12911 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:23.808420 12745 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:23.810237 12971 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:23.795018 12897 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:23.811086  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.812242  8388 raft_consensus.cc:2410] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:03:23.785125 12889 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:23.818647  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:23.786490 13002 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:23.764395 12744 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.827191  9065 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:23.828899 12965 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.829466  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:23.786731 13003 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:23.833845  8388 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:23.824908 12889 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.821019 12869 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.829380 12900 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.829562 13002 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:23.843408 12908 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:23.850322  8535 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:03:23.850912  8535 pending_rounds.cc:85] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 9
I20260709 13:03:23.850936  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.851257  8535 pending_rounds.cc:107] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:03:23.853003  8391 raft_consensus.cc:2410] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:03:23.853276  8535 raft_consensus.cc:2889] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:23.831192 13025 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:23.835726 13003 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:23.860816  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.858661  8542 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16. Ops: [14.10-15.11]
I20260709 13:03:23.860925  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.841817 12872 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:23.867775  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 86592.8us
I20260709 13:03:23.873675  8542 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:03:23.875901  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.877990  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.878672  8541 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.870999 12744 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.891426  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:03:23.891709  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 69302.6us
I20260709 13:03:23.845891 12889 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:23.891076  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.875375  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:23.893091  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:23.895572  8536 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 12: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:23.893323  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.897143  8507 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.893348  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.899708  8538 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.851259 13002 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:23.834671 12789 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.905925  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:23.904726  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:23.904981  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:23.906988  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:23.907282  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:23.907965  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:23.926975  8536 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:23.902549 13025 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:03:23.869767 12872 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.840410 12750 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:23.913216  8544 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:23.920346 12953 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:23.926215  8464 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.930034  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:23.905820  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:23.927672  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:23.931782  8541 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:23.933312  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:23.932667  8433 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:23.921288  8538 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:23.942538  8464 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:23.902249 12971 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.893916 12908 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:23.945000  8389 raft_consensus.cc:2368] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 12. Current term is 13.
I20260709 13:03:23.948760 13026 raft_consensus.cc:2804] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:03:23.973989  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 184685us
I20260709 13:03:23.947768 12420 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:23.974960 12420 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.975366 12420 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.921932 12987 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:23.921700 12802 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:23.929768 12567 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.926136 12912 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:23.949409  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:24.002967  8542 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:24.002842 12420 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.003386  8386 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:23.949550  8394 raft_consensus.cc:2393] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 17: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:23.955288  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:24.004838  8392 raft_consensus.cc:2368] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 14. Current term is 15.
I20260709 13:03:23.943593 12897 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:23.944991  8433 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:23.981897 12971 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 17 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:23.983047 12789 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:23.975165 12908 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:23.984539 12720 raft_consensus.cc:993] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:23.989244  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:24.019841  8538 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.990394  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:24.021360  8541 raft_consensus.cc:2393] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 17: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:23.991801  8536 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 15.
I20260709 13:03:23.994921  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:23.946025 12846 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:03:24.007939 12420 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:23.965109 12543 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:23.986981 12750 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.030313  8507 leader_election.cc:400] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 14. Current term is 15.
I20260709 13:03:24.043124  8507 leader_election.cc:403] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:24.031119  9032 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:24.033639  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:24.044432  8392 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:24.038749 12953 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:24.046578  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51792.3us
I20260709 13:03:24.046846  8388 raft_consensus.cc:1240] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:23.948220 12877 consensus_queue.cc:1059] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:03:24.048307  8358 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:24.039460 12912 raft_consensus.cc:1081] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:24.040045 12802 raft_consensus.cc:2804] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:24.007287 13009 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:24.048334  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.007201 12897 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.007323 12567 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:24.051038 13011 consensus_queue.cc:1059] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:24.039333  8538 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:24.056559  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:24.059731  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 109282us
I20260709 13:03:24.065469  8358 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:24.051929 13027 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:24.046025 13026 raft_consensus.cc:697] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:24.052443 12720 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 14. Current term is 15.
I20260709 13:03:24.061198 12897 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:24.072849  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:24.063499 12909 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:24.065511 12802 raft_consensus.cc:697] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:24.094110  8358 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:24.095072  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:03:24.085145  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 140247us
I20260709 13:03:24.096455  8433 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:24.087173  8392 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:24.088775  8388 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:24.066623 12885 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:24.059360 12877 raft_consensus.cc:3055] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:24.066927 12744 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:24.091555  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.073534 12872 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:24.074314 13027 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:24.052152 12870 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:24.113219  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.098075  8392 raft_consensus.cc:1275] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:24.095043  8358 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:24.100214  8433 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:24.117141  8433 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:24.118074 12953 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:24.118578 12953 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:24.119453 12953 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:24.120033  8541 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:24.104180 13023 raft_consensus.cc:2804] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:24.066408 12976 consensus_queue.cc:1059] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:03:24.136633 13002 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.080039 12900 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:24.138324 12900 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:24.134442 13011 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:24.139266 12900 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:24.070340 12965 consensus_queue.cc:1048] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:03:24.124667  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.125412 12744 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:24.126739 12908 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:24.129297 12567 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:24.114471 12909 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.122991  8358 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:24.130112 13041 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:24.070806 13031 consensus_queue.cc:1048] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:03:24.131186  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.063117 12789 consensus_queue.cc:1059] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:03:24.103562 12877 raft_consensus.cc:740] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:24.092783 12906 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:24.135241 13026 consensus_queue.cc:237] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.168226 12906 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:24.059612 13009 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.146422  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:24.102164 12911 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:24.106169 12750 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:24.148273  8388 raft_consensus.cc:2468] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 10.
I20260709 13:03:24.090757 12971 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.158103  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:24.190662  8541 raft_consensus.cc:2410] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:03:24.158725  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:24.191812  8543 raft_consensus.cc:2393] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 14: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:24.159003  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:24.193127  8536 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 13: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:24.159824  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:24.194041  8538 raft_consensus.cc:2393] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 13: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:24.159996  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.160851  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:24.166052 12802 consensus_queue.cc:237] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.166946 12908 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:24.167258 12877 consensus_queue.cc:260] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:24.168740 12906 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.211410  8388 raft_consensus.cc:1240] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:24.229979  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 51430.7us
I20260709 13:03:24.153932 12745 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:24.216311  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 56392.9us
I20260709 13:03:24.234740  8359 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.217020 12911 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:24.217327 13023 raft_consensus.cc:697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:24.236048 12911 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.236191 13023 consensus_queue.cc:237] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.217694 13049 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:24.217698 12870 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:24.206969  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:24.219935  8390 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:24.114202 12872 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.244218 12872 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.184597 12750 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.178140 12744 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:24.259166  9032 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:24.265336 13022 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.433s	user 0.000s	sys 0.004s
I20260709 13:03:24.221045 12909 raft_consensus.cc:3055] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:24.180274 13011 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:03:24.277067  8465 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:24.260579  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.278712  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.262085 12750 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:24.285382  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:24.288383  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:24.286432  8468 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:24.286345  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.259542 12908 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:24.267859 12745 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:24.291458  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.292270  8468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:03:24.294669  8463 raft_consensus.cc:2393] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 14: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:24.294817  8468 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.295217  8468 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:24.296239 13041 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
W20260709 13:03:24.297083  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800309700 after lost signal to thread 7286
W20260709 13:03:24.298223  9090 debug-util.cc:398] Leaking SignalData structure 0x7b08002f52c0 after lost signal to thread 8327
W20260709 13:03:24.298645  9090 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9c00 after lost signal to thread 8341
I20260709 13:03:24.298022 13041 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.269907 12909 raft_consensus.cc:740] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:24.305302  8462 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:03:24.299841  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800292c40 after lost signal to thread 8419
W20260709 13:03:24.411043  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800297780 after lost signal to thread 8494
W20260709 13:03:24.412346  9090 debug-util.cc:398] Leaking SignalData structure 0x7b080036cde0 after lost signal to thread 8568
W20260709 13:03:24.413619  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800312100 after lost signal to thread 9093
I20260709 13:03:24.313302 12744 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.294345 12789 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:24.344969  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54164.6us
I20260709 13:03:24.260361 12897 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
W20260709 13:03:24.371186  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 112098us
I20260709 13:03:24.213174 13027 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.423408  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:24.428282  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:24.440611  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:24.442828 13011 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:24.443333 13011 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:24.443749 13011 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:24.388988  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 255802us
I20260709 13:03:24.284649 12911 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:24.279832 12872 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:24.300675 12961 raft_consensus.cc:2804] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:24.299799 12976 raft_consensus.cc:3055] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:24.390764 12745 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:24.469547  8461 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:03:24.475804  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 48356.3us
W20260709 13:03:24.456094 12889 consensus_meta.cc:287] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.003s
I20260709 13:03:24.473703  8468 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.489912  8536 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:24.484418  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:24.507274  8360 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:24.512221  8393 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:24.526916  8544 raft_consensus.cc:1240] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:24.497748 12885 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.533099  8468 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.488039 13002 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.498862 12976 raft_consensus.cc:740] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:24.519975 12872 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:24.500487 12750 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.517796 12889 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.497361 12908 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.499528 12909 consensus_queue.cc:260] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.533459 12745 consensus_queue.cc:1059] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:03:24.531283 12898 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:24.574404 12976 consensus_queue.cc:260] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.590432 12897 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.543109 12885 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:24.590988 12909 raft_consensus.cc:3060] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:24.615365  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 82274.8us
I20260709 13:03:24.607189 12745 consensus_queue.cc:1243] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:24.626461  8542 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:24.630905 12893 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.631608 12893 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:24.634459  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 2064) took 1372 ms. Trace:
I20260709 13:03:24.635030  8394 rpcz_store.cc:276] 0709 13:03:23.261570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.658158 (+396588us) service_pool.cc:224] Handling call
0709 13:03:24.634216 (+976058us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b540035a554. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:24.634377 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667684224}
I20260709 13:03:24.636930 13065 raft_consensus.cc:3055] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:24.637460 13065 raft_consensus.cc:740] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:24.640991 13009 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.641826  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44080 (request call id 2060) took 1381 ms. Trace:
I20260709 13:03:24.616981 12976 raft_consensus.cc:3060] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.561779 13036 consensus_queue.cc:1059] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:24.573246 13045 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:03:24.645825  8391 rpcz_store.cc:276] 0709 13:03:23.260424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.603161 (+342737us) service_pool.cc:224] Handling call
0709 13:03:24.641581 (+1038420us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540010ca54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134eb2fa 00007fbe184acb17 00007fbe11a276d4 00007fbe11a27662 00007fbe11a27591 00007fbe11a2750c 00007fbe11a267c2 00007fbe1182248c 00007fbe118218c6 00007fbe1182126f
0709 13:03:24.641735 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571737472}
W20260709 13:03:24.646855  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 223523us
I20260709 13:03:24.673178  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.552141 13038 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:03:24.636921 13053 log.cc:927] Time spent T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:03:24.668852  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 154791us
I20260709 13:03:24.681324  8359 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.686697  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:24.689997  8433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.669443 12961 raft_consensus.cc:697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
W20260709 13:03:24.698717 13062 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:03:24.701885 12872 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.685252 12911 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:24.696424 13065 consensus_queue.cc:260] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.702607 12961 consensus_queue.cc:237] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:24.706228 12885 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:24.722630  8359 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.701508 13070 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:24.685407 13036 consensus_queue.cc:1243] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:03:24.738972  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 47067.2us
I20260709 13:03:24.728895  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:24.690083 12987 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:24.787599  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:24.791725  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:24.796975  8391 raft_consensus.cc:2410] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92314b14f5554885a80c3dc87f4beed4 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:03:24.797117  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.675628 13069 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:03:24.747725 13003 consensus_meta.cc:287] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: Time spent flushing consensus metadata: real 0.855s	user 0.013s	sys 0.000s
I20260709 13:03:24.725374 13060 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:24.834882  8540 raft_consensus.cc:1275] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:24.790540 12744 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:24.838124  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 114550us
W20260709 13:03:24.808625 12906 consensus_meta.cc:287] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: Time spent flushing consensus metadata: real 0.549s	user 0.014s	sys 0.000s
I20260709 13:03:24.842325  9032 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:24.849633  8393 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:24.738376 13042 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:03:24.853394  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:24.852305  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:24.855501  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:24.855952  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:24.856539  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
W20260709 13:03:24.850652  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 43737.8us
I20260709 13:03:24.814841 12889 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.857153  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:24.856071  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:24.857944  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:24.803052 12987 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:24.862375 13075 consensus_queue.cc:1048] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:24.863303 13064 log.cc:927] Time spent T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:03:24.850984 12906 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.859952  8393 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:24.860539  8391 raft_consensus.cc:1275] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:03:24.867653  8391 pending_rounds.cc:85] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 10
I20260709 13:03:24.868006  8391 pending_rounds.cc:107] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:03:24.866693  8387 raft_consensus.cc:1240] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:24.868273  8391 raft_consensus.cc:2889] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:24.870275 12987 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:24.874212 13067 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:03:24.837765 13072 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:03:24.794185 13070 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:24.884303  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:24.885212  8394 raft_consensus.cc:2393] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 12: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:24.827368 13003 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.889673 13003 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:24.893178 13063 log.cc:927] Time spent T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:03:24.895756  8465 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:24.809325 12750 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.827394 13011 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:24.901042  8539 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:03:24.853315  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:24.895453 13066 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:03:24.924387 13011 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:24.924737 12877 raft_consensus.cc:3060] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:24.926966 13070 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:24.931092  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:24.931651  8388 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 13: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:24.921855  8465 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:24.938467  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:24.939708  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 79593us
I20260709 13:03:24.942407  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:24.957124 12543 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:03:24.960963  8507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.28.193:35967 timed out after 1.679s (SENT) [suppressed 3 similar messages]
I20260709 13:03:24.962649  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:24.966573  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.976980  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.980482  8386 raft_consensus.cc:3055] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:24.981007  8386 raft_consensus.cc:740] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:24.981814 13076 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:24.965994 12543 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:24.961028 13027 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:25.007242  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 2391) took 1158 ms. Trace:
I20260709 13:03:25.007850  8539 rpcz_store.cc:276] 0709 13:03:23.849099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.849336 (+   237us) service_pool.cc:224] Handling call
0709 13:03:23.870965 (+ 21629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.901610 (+1030645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.006829 (+105219us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000f37d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:25.007111 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368331520}
I20260709 13:03:25.013330 12567 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:25.013964 12567 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:25.014995 12567 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.016561 12567 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:25.025946  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.033420  8463 raft_consensus.cc:1240] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:25.053326 12909 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.054805 12909 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:25.058121 12869 raft_consensus.cc:3055] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:25.058602 12869 raft_consensus.cc:740] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:25.059028 12909 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:25.059487 12869 consensus_queue.cc:260] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.060511 12869 raft_consensus.cc:3060] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.041663 12943 consensus_queue.cc:1059] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:03:25.073742 12906 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:25.077883  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.080542  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:25.081353  8535 raft_consensus.cc:1240] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.084239  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:25.087154  8544 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:25.089073  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:25.094225  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.099910  8540 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16. Ops: [14.10-15.11]
I20260709 13:03:25.105589  8393 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:25.106101  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:25.106746  8390 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:25.106940  8391 raft_consensus.cc:2368] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12.
I20260709 13:03:25.107421  8389 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:25.085552  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:25.109000  8535 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:25.109298  8535 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:25.118265  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:25.123493 12889 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:25.124034 12971 raft_consensus.cc:3055] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:25.117059  8535 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.125649  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:25.127182  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:25.127977  8388 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:25.130478  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:25.124864 12976 consensus_queue.cc:1059] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:03:25.125064 12906 consensus_queue.cc:1059] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:03:25.129506  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:03:25.141345  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.149326  8539 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.151741  8535 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:25.117285 13049 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.124514 12971 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:25.155018  8509 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.147562 12976 consensus_queue.cc:1243] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:25.148262 12906 consensus_queue.cc:1243] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:03:25.159288  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 198350us
I20260709 13:03:25.163067  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:25.131513 13009 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:25.166662  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:25.176659  8540 raft_consensus.cc:3060] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:25.155400  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:25.172529  8388 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:25.131408 13090 raft_consensus.cc:493] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:25.175086  8535 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:25.176003  8544 raft_consensus.cc:2368] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12.
I20260709 13:03:25.125751 13054 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:03:25.156170 13003 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:25.177393  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:25.189196  8539 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:25.131443 12789 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:03:25.157758  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:25.196063  8358 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:25.199537  8540 raft_consensus.cc:2468] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:25.201002 13047 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:25.201421 13047 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:25.201519 12789 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:25.202126 12789 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:25.202286 13047 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.203022 12789 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.203835 13047 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:25.205905 13073 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:25.157845 13049 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.213394 13049 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.215000  8509 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.215647  9060 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 15 LEARNER]: Advancing to term 17
I20260709 13:03:25.217344 13085 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:25.221822 12877 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:25.222489 12877 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:25.223678 12889 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.223553 12877 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.224371  8539 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:25.227339 12870 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:25.234176  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.236299  8468 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:03:25.236804  8468 pending_rounds.cc:85] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting all ops after (but not including) 11
I20260709 13:03:25.237112  8468 pending_rounds.cc:107] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:03:25.237448  8468 raft_consensus.cc:2889] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.241843  8469 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:25.199972  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:25.185766 12976 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:03:25.265678 13091 log.cc:927] Time spent T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:03:25.266292 12909 raft_consensus.cc:3055] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:25.266723 12909 raft_consensus.cc:740] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:25.267877 12909 consensus_queue.cc:260] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.272634  8536 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:25.193473 13090 raft_consensus.cc:515] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:25.263594  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 63707.3us
I20260709 13:03:25.269862 12953 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.269341 12909 raft_consensus.cc:3060] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:25.294714  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:25.237761 12971 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.258986 12878 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:03:25.307268 13090 leader_election.cc:290] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:25.313232  9060 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 LEARNER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:25.320606  8386 consensus_queue.cc:260] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.330025  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:25.262691 12976 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:25.301409 13089 log.cc:927] Time spent T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 13:03:25.346683  8386 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.340866  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:25.352373  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:25.357481  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:25.358559 13065 raft_consensus.cc:3060] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.360337  8391 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:03:25.361188  8387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3378) took 1635 ms. Trace:
I20260709 13:03:25.361599  8387 rpcz_store.cc:276] 0709 13:03:23.726142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.125357 (+399215us) service_pool.cc:224] Handling call
0709 13:03:24.125649 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.868669 (+743020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.360989 (+492320us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b540024ac54. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134e7e01 00007fbe134e683e 00007fbe184ab419 00007fbe11a22bd4 00007fbe11a22b62 00007fbe11a22a91 00007fbe11a22a0c 00007fbe11a21cc2 00007fbe1182248c 00007fbe118218c6
0709 13:03:25.361135 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703828352}
W20260709 13:03:25.362512 13093 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:25.298879 13072 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:03:25.345325 12802 consensus_queue.cc:1048] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:03:25.365991 13047 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.366111 12846 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.334597 12953 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:25.371434  8433 leader_election.cc:400] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12.
I20260709 13:03:25.376953  8433 leader_election.cc:403] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:03:25.330787 12567 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:25.374761  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 43510.9us
W20260709 13:03:25.375455  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 43959.9us
I20260709 13:03:25.377189  8535 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:03:25.390774  8359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.418715  8386 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:25.409020  8433 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:25.441047  8470 raft_consensus.cc:1240] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:25.441234  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.442420  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.442744  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.442793  8462 raft_consensus.cc:1240] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:03:25.443516  8464 raft_consensus.cc:2393] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 13: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:25.370440 12971 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:25.444612  9032 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.446157  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.445511  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.398785 12986 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:25.376770 12953 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:25.456214  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.462149  8395 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:03:25.459764  8464 raft_consensus.cc:1240] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:25.459853  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.350857 12543 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:25.433418 12745 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:03:25.461347  8466 raft_consensus.cc:1240] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.462541  8395 pending_rounds.cc:85] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 10
I20260709 13:03:25.468513  8395 pending_rounds.cc:107] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:03:25.431131 13043 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:25.468904  8395 raft_consensus.cc:2889] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.466948  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.424571 13047 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12.
I20260709 13:03:25.460479  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.465965  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.472990  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.473776  8464 raft_consensus.cc:2393] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 13: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:25.473867  8469 raft_consensus.cc:2410] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:03:25.466389  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.474504  8462 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.430600 13025 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:03:25.451700 13054 raft_consensus.cc:2804] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:25.462005 12930 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:25.432711 12567 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.440856 13072 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:25.464536 12953 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.482585  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.479174  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:25.508322  8462 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 15.
I20260709 13:03:25.510291  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:25.510968  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.521169  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.474457 13000 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:03:25.528872  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.492771 13054 raft_consensus.cc:697] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:25.541661  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.542909  8470 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 13: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:25.543799  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.543960  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.518759 12976 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:25.545251  8464 raft_consensus.cc:1240] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:25.544139  8389 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:03:25.545931  8389 pending_rounds.cc:85] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 4
I20260709 13:03:25.546298  8389 pending_rounds.cc:107] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:03:25.546600  8389 raft_consensus.cc:2889] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.546892  8469 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:25.547942  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.549367  8470 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:25.551234  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.519323 12893 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:25.535634 13103 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:03:25.564654  8464 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:03:25.566545 13100 log.cc:927] Time spent T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:03:25.567190 13054 consensus_queue.cc:237] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.578480 12976 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.610000 13072 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.610399 12976 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:25.611287  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 60228.2us
W20260709 13:03:25.570669  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.612680 12976 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.612759  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.615083 12976 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.550874  8470 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:25.575740  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:25.577769  8463 raft_consensus.cc:1240] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:03:25.619382  8389 raft_consensus.cc:2410] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:25.626224 12543 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:25.602139 13105 log.cc:927] Time spent T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:03:25.610026 12567 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:25.640004  8433 leader_election.cc:400] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 11. Current term is 12.
I20260709 13:03:25.641167  8433 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:25.641594  8394 raft_consensus.cc:1275] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:25.639901 12846 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:25.646359  8467 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:25.654937 12953 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.683866  8466 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:25.685503  8462 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:25.617489  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:25.687692  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 70299.1us
W20260709 13:03:25.687206  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 46132.7us
I20260709 13:03:25.693099 13072 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.698235  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:25.698943  8391 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:25.702122  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.697610  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.706584  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.687814 12953 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.692997 13079 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:25.715530  8391 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:25.719599  8433 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:25.724684  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.725643 13060 raft_consensus.cc:2749] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:25.725991  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.727775  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.722832 12869 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.759608  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.725165 12953 raft_consensus.cc:2804] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:25.724020 13079 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:25.720499 13023 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:03:25.729143 13060 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:25.763545  8359 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.725991 13036 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:25.734189 12870 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.758734 13011 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:25.769122  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.763136 13065 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:25.762215 12953 raft_consensus.cc:697] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:25.762657 12869 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.770910 13011 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.771149 13079 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.768920 12789 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:25.772441 12869 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.769207 12870 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:25.774973 13049 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.775520 13049 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.775903 12870 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:25.776919 12953 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.779079  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:25.777598 13049 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.782945  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:25.783663  8394 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:25.788981  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:25.791378 13049 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:25.791996 13049 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.792419 13049 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:25.789319  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.814815 12869 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:25.814968  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.820708 12869 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.821899 12976 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.822471 12976 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.825145 12869 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:25.826175  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcda97cc34546609f91a249f74d8f85" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.831090  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.831889  8465 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:25.831709  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.833398  8469 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:25.836210 12789 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:03:25.838038  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 428540us
I20260709 13:03:25.827040 13065 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:03:25.843966 13042 consensus_queue.cc:1048] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:25.845263 12789 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.849139 12870 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:25.851207  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.857350 12976 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.857506  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.857936 13038 raft_consensus.cc:493] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:25.858527  8538 raft_consensus.cc:1275] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:25.859429  8535 raft_consensus.cc:1275] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:25.859345 13049 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.860078  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:25.860558  8541 raft_consensus.cc:1275] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:25.861286  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.861519  8540 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:25.864087  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.879518  8542 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:25.873528 13079 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:25.882809 13101 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:25.883217 13049 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.883363 13101 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:25.878083 13038 raft_consensus.cc:515] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:25.888543 13078 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:25.889223  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.890165  8507 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.888960 13101 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:25.890583  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.891304  8539 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:25.892179  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.892720 13101 raft_consensus.cc:2764] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:03:25.893558  8507 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:25.895431  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:25.901981  8358 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:25.903177  8358 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:25.903852 13065 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.896294  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:25.904675 13065 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:25.905121 13065 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.905496 13065 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:25.905928 13038 leader_election.cc:290] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:25.906057 12976 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:25.906651 12976 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:25.907114 12976 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:25.911311 13102 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.375s	user 0.008s	sys 0.005s
I20260709 13:03:25.877942 12789 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.869349 13011 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:25.913893 12789 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.914095 13011 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.915414  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.884088  8468 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:25.923496  8358 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:25.924099  8539 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:25.925347  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.929195 13038 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:25.943454 13078 consensus_queue.cc:1048] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:25.936298 12986 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:03:25.936514 13101 consensus_queue.cc:1059] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:03:25.947974 13101 raft_consensus.cc:3055] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:25.948320 13101 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:25.948623  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:25.949052  9065 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 LEARNER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:25.957098  8541 raft_consensus.cc:1275] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:03:25.961583  8358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.963037  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.964311  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:25.927018 12789 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:25.976596  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:25.982089  8462 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:25.949185 13101 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:25.934403 13011 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:25.990523  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:25.993935  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:25.995314  8389 raft_consensus.cc:2393] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:25.994396  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:26.001160 13120 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.933333 12744 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:03:26.003639  8386 raft_consensus.cc:1275] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:03:26.007063  8386 pending_rounds.cc:85] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 3
I20260709 13:03:26.007395  8386 pending_rounds.cc:107] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:03:26.007584  8386 raft_consensus.cc:2889] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.983352 12745 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.974961 12906 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:26.027864 12906 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.030269 12906 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:26.032035 13054 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:26.001754 13120 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.037993 13120 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:26.040701 12720 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:26.009346 13011 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:26.043115 13011 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.049300 12745 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.052999 12745 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:26.045572 13011 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:26.066735  8388 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:03:25.986117 12893 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.027097  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:26.075019  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 62723.8us
I20260709 13:03:26.076359  8508 leader_election.cc:304] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:26.078621  8461 raft_consensus.cc:1240] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:26.098961  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:26.037441 12976 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:26.102066  8386 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:26.103487  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:26.104683  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:03:26.152208  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 53317.5us
W20260709 13:03:26.156077  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 79820.3us
I20260709 13:03:26.106815  8387 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:03:26.161981 13026 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:26.163420  8433 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:26.080439 12893 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.082772 13065 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.158216 12912 raft_consensus.cc:2749] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:26.158776 12906 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:26.160069 12953 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.237913  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36652 (request call id 4) took 18864 ms. Trace:
I20260709 13:03:26.236290  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:26.166899 13023 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:26.159735 12750 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:03:26.252235  8386 rpcz_store.cc:276] 0709 13:03:07.373330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.383844 (+ 10514us) service_pool.cc:224] Handling call
0709 13:03:07.528275 (+144431us) log.cc:844] Serialized 499 byte log entry
0709 13:03:07.734973 (+206698us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b180016fcc0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103fa3f3 00007fbe103fc7c1 00007fbe103fc779 00007fbe103fc709 00007fbe103fc6d1 00007fbe103fb9cd 000000000038f354 000000000038f199 00007fbe103dd83a
0709 13:03:07.744132 (+  9159us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b180016fcc0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe10374c0a 00007fbe19ab4219 00007fbe103fca40 00007fbe103f74e4 00007fbe103f7455 00007fbe13440b0b 00007fbe134c5b63 00007fbe134ed752 00007fbe184add29
0709 13:03:26.237510 (+18493378us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85860,"raft.queue_time_us":92506,"raft.run_cpu_time_us":2074,"raft.run_wall_time_us":16209,"spinlock_wait_cycles":7773440,"thread_start_us":124227,"threads_started":1,"wal-append.queue_time_us":153805,"wal-append.run_cpu_time_us":3153,"wal-append.run_wall_time_us":1033793}
I20260709 13:03:26.166572 13083 raft_consensus.cc:493] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.264974 13083 raft_consensus.cc:515] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:26.245728 13042 consensus_queue.cc:1059] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:03:26.166366 12789 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:03:26.302067 12976 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:26.259665 12802 consensus_queue.cc:1048] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:03:26.294831 12902 consensus_queue.cc:1048] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:03:26.324743  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:26.263367 12953 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.287779 13079 consensus_queue.cc:1048] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 13:03:26.337558  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 159691us
I20260709 13:03:26.347240 12893 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:26.367523  8341 auto_rebalancer.cc:629] Failed to schedule move for tablet a8ce611680844f5b9bbe7f4813048f1b: Illegal state: Replica 2122d8c723e84e3da22f81f7eeb4b1a9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
W20260709 13:03:26.412372 13115 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:03:26.470134 12953 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:26.470506 13121 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.310s	user 0.004s	sys 0.004s
I20260709 13:03:26.471166 13083 leader_election.cc:290] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:26.472126 13128 log.cc:927] Time spent T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.221s	user 0.001s	sys 0.007s
W20260709 13:03:26.472899 13126 log.cc:927] Time spent T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.135s	user 0.006s	sys 0.001s
W20260709 13:03:26.472978  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 60575.6us
W20260709 13:03:26.483006  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 147066us
W20260709 13:03:26.484077  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.485989 12735 raft_consensus.cc:3055] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:26.486514 12735 raft_consensus.cc:740] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:26.486780 13065 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:26.487401 12735 consensus_queue.cc:260] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.488791 12735 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.490239  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:26.498004  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 159484us
I20260709 13:03:26.502245  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13811dee93af4290bdcf7d73b527d0f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:26.503592 13131 consensus_queue.cc:1048] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:26.504945  8509 leader_election.cc:304] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:26.506618  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.516009  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.518280  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.518788  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:26.519416  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.519878  8470 raft_consensus.cc:2393] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 11: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:26.520051  8466 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:26.520906  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.521835  8539 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:03:26.495728 12976 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:26.524544  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.529109  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:26.530674 12996 raft_consensus.cc:2749] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:26.532374  8544 raft_consensus.cc:3055] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:26.532783  8544 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:26.533461  8544 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.534390  8544 raft_consensus.cc:3060] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:26.522581 13131 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:03:26.535738 13131 consensus_queue.cc:1243] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:26.543041  8465 raft_consensus.cc:1240] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:26.544963  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.554617  8465 raft_consensus.cc:1240] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:26.557161  8544 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:26.570241  8359 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:26.580061  8544 pending_rounds.cc:85] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 7
I20260709 13:03:26.580674  8544 pending_rounds.cc:107] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:03:26.580972  8544 raft_consensus.cc:2889] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:26.575898  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:26.591650  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:26.592954  8465 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:26.545987 12976 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.588294 13083 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.588001 12789 raft_consensus.cc:2749] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:26.561772 12750 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:26.618103 12750 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:26.621167 12750 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:26.604261 13065 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:26.601070 12870 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.631577  8544 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:26.624317 13065 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.623312 13083 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.638969  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:26.664222 13065 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.689747 13083 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:26.690667 12976 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:26.692338  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.693071  8465 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:26.663061 13141 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:03:26.678314 13079 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:26.708483 13065 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:26.715703  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.720392  8539 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:26.748960 13139 log.cc:927] Time spent T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:03:26.754433 13065 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:26.764003 13137 log.cc:927] Time spent T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
W20260709 13:03:26.767524 13127 log.cc:927] Time spent T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.606s	user 0.002s	sys 0.001s
W20260709 13:03:26.768271 13143 log.cc:927] Time spent T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
W20260709 13:03:26.806181  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.817054  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:26.818516  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:26.818701  8464 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:26.842253 13138 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.172s	user 0.001s	sys 0.003s
I20260709 13:03:26.842564 13131 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:26.843961 13131 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.868222 13135 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:03:26.885560  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.901569 13131 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:26.906785 13135 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:26.907802 13135 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:26.908615 12789 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:26.909696 12789 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:26.922047  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.911993 13135 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:26.970036  8464 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:27.007304 12986 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:27.008361 12986 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.010207 12735 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.011147 12735 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.020669  9065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 288) took 1072 ms. Trace:
I20260709 13:03:27.021436  9065 rpcz_store.cc:276] 0709 13:03:25.948008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.948174 (+   166us) service_pool.cc:224] Handling call
0709 13:03:25.948521 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.948884 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:25.962258 (+ 13374us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.739751 (+777493us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18003580c0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe1308723a 00007fbe134f1a2a
0709 13:03:26.915989 (+176238us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.971234 (+ 55245us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.008026 (+ 36792us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.008309 (+   283us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:27.008678 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.019933 (+ 11255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.020158 (+   225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.020235 (+    77us) raft_consensus.cc:1685] finished
0709 13:03:27.020255 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.020430 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48988,"prepare.queue_time_us":148500,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":62630,"raft.run_cpu_time_us":827,"raft.run_wall_time_us":20946,"spinlock_wait_cycles":25477888,"thread_start_us":157490,"threads_started":2,"wal-append.queue_time_us":797319}
I20260709 13:03:26.996830 12789 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.048240  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:27.049293  8464 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:27.062538  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.063040 12986 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:27.097546  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.100071  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:27.102116  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:27.103287 12735 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:27.104272 12744 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:27.104390  8359 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:27.105026 12744 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:27.107502 12745 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:27.107998 12745 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.108480 12745 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:27.107158 12744 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.113343 12789 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.120033 12789 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:27.117317  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 53961.1us
I20260709 13:03:27.132782 12789 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.134613 12893 consensus_queue.cc:1048] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:27.166093  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3414) took 1164 ms. Trace:
I20260709 13:03:27.166761  8388 rpcz_store.cc:276] 0709 13:03:26.001147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.067575 (+ 66428us) service_pool.cc:224] Handling call
0709 13:03:26.067890 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.068209 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.068236 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.068691 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.249944 (+181253us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18003992e0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe1308f4bc 00007fbe103dd48b 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1
0709 13:03:26.250210 (+   266us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:26.250270 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.250382 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.140486 (+890104us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b240011a7b8. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe102809c4 00007fbe1027eacb 00007fbe10439dc9 00007fbe10439a55 00007fbe10438fb0 00007fbe130af488 00007fbe130afbe8 00007fbe13087398 00007fbe1308276a 00007fbe13081bb6
0709 13:03:27.150100 (+  9614us) raft_consensus.cc:1685] finished
0709 13:03:27.150131 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.165815 (+ 15684us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2876,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3678,"spinlock_wait_cycles":41176576,"thread_start_us":13141,"threads_started":1,"wal-append.queue_time_us":29439}
I20260709 13:03:27.171277  8540 raft_consensus.cc:1275] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:03:27.172823  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:27.174145  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:27.177136  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49324 (request call id 2427) took 1314 ms. Trace:
I20260709 13:03:27.177603  8537 rpcz_store.cc:276] 0709 13:03:25.862336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.862456 (+   120us) service_pool.cc:224] Handling call
0709 13:03:25.862734 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.869435 (+  6701us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:25.869467 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.870478 (+  1011us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.984120 (+113642us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:25.984178 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.984275 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.175263 (+1190988us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b2400200c18. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe102809c4 00007fbe1027eacb 00007fbe10439dc9 00007fbe10439a55 00007fbe10438fb0 00007fbe130af488 00007fbe130afbe8 00007fbe13087398 00007fbe1308276a 00007fbe13081bb6
0709 13:03:27.176639 (+  1376us) raft_consensus.cc:1685] finished
0709 13:03:27.176664 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.176930 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6288,"raft.queue_time_us":10270,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":33993088,"thread_start_us":113305,"threads_started":1,"wal-append.queue_time_us":223743}
I20260709 13:03:27.181141  8507 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:27.183151  8507 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:27.182799  8289 catalog_manager.cc:5697] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 10 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:27.184697 13078 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:27.185842 13078 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:27.190507  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.190816  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.198167  8387 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:27.184919  8289 catalog_manager.cc:5697] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 7 to 11, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:27.200150  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:27.217943  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 53981.4us
W20260709 13:03:27.224383 13161 log.cc:927] Time spent T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.144s	user 0.000s	sys 0.003s
I20260709 13:03:27.225308  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:27.227121  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:27.234719 13133 raft_consensus.cc:493] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.235596 13133 raft_consensus.cc:515] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.242730 13054 consensus_queue.cc:1048] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:27.251699  8289 catalog_manager.cc:5697] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 12 to 14, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 14 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:27.254938  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.253722  8289 catalog_manager.cc:5697] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 8, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:27.257936  8289 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 12 to 13, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 13 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.260605  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.261466  8387 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:27.263846  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.271602  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.270792  8508 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:27.294121  8390 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:27.295459  8387 raft_consensus.cc:1240] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Rejecting Update request from peer 92314b14f5554885a80c3dc87f4beed4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:27.265861 13079 raft_consensus.cc:1064] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
W20260709 13:03:27.301369  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 118383us
I20260709 13:03:27.261736 13133 leader_election.cc:290] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.263423  8289 catalog_manager.cc:5697] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.308452  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.322154 13120 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:27.325966 12961 consensus_queue.cc:1059] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:27.327391 12961 raft_consensus.cc:3055] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:27.327682  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 57194.9us
I20260709 13:03:27.327883 12961 raft_consensus.cc:740] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:27.329170 12961 consensus_queue.cc:260] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:27.330945 12961 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:27.333913  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.335883  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:27.277827 12745 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.341786 13120 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:27.343118 13120 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.344758 13101 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:27.351452  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.357290  8390 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:27.358771 12744 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:27.363112 12744 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.365450 12744 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.377925  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:27.370719  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.387048  8389 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
W20260709 13:03:27.435855  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45572.7us
W20260709 13:03:27.440054  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 70885.2us
I20260709 13:03:27.385948 12744 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.449967  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 46631.3us
W20260709 13:03:27.450748  8341 auto_rebalancer.cc:629] Failed to schedule move for tablet 7051c4976daf4ac580117a5b9ecb8de4: Illegal state: Replica d2a645dcec4c479ba4c94d075b1bc98c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
W20260709 13:03:27.452106 13179 log.cc:927] Time spent T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:27.451478  8289 catalog_manager.cc:5697] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 13, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 13 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:27.474368  8507 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:27.497478  8433 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:27.501854 12987 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:27.505420 13043 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.506412 13043 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.458729 12893 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:03:27.532775  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 84014.2us
I20260709 13:03:27.535086 12745 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.512830 12744 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.551031 12870 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
W20260709 13:03:27.565114  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 101328us
I20260709 13:03:27.565776 12745 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:27.577739 12745 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.558317 12750 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.566977  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 104415us
I20260709 13:03:27.576066  8536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56998 (request call id 536) took 1235 ms. Trace:
I20260709 13:03:27.563987 13065 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.568912  8289 catalog_manager.cc:5697] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 7, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 7 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.597390  8544 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:27.598922 13144 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.599882 13144 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.599673  8289 catalog_manager.cc:5697] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 12, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:27.598559  8389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:27.580111 12745 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.560688 12893 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.567513 12953 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:27.604602  8389 raft_consensus.cc:606] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:27.579403 12750 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.568390 13043 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.586824  8536 rpcz_store.cc:276] 0709 13:03:26.340825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.347033 (+  6208us) service_pool.cc:224] Handling call
0709 13:03:26.481052 (+134019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.499797 (+ 18745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.499828 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.507482 (+  7654us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.271414 (+763932us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b18003dbb80. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe192c2de1 00007fbe192cf5b1 00007fbe103dce07 00007fbe19237ab9 00007fbe103f969b 00007fbe103f793f 00007fbe103f9c02 00007fbe1308120b 00007fbe13086d23 00007fbe130870d1 00007fbe134a2a0f
0709 13:03:27.339287 (+ 67873us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:27.339629 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.356029 (+ 16400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.356170 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.575590 (+219420us) raft_consensus.cc:1685] finished
0709 13:03:27.575697 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.575883 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40342,"prepare.queue_time_us":185,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":41255,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":6972,"spinlock_wait_cycles":8689920,"thread_start_us":67547,"threads_started":1,"wal-append.queue_time_us":962474}
I20260709 13:03:27.627977  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.629884  8387 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 17.
I20260709 13:03:27.588534 13065 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.637046  8391 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:27.642171 12750 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.645398 13026 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.646214 13026 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.646710 13184 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.627182  8289 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 13 to 16, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 16 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.647343 13184 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.648567  8289 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 13, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 13 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:27.605433 13133 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:03:27.656872  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:27.620551 12870 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:27.662676 12870 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:27.649669 13184 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.655531  8358 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:27.660686 12893 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:27.672945  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.678781 13069 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:27.669649 12744 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.671943 13065 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.672463 12846 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.637086 12906 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.610525 13101 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:03:27.697994  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.688580 13069 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:27.710575  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 78062.2us
I20260709 13:03:27.726873  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.717849 13069 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.733319  8388 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 14: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:27.717010 12745 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:27.738406  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a45e4473e5464880e36c3f7edc9b4e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.721107 12893 raft_consensus.cc:493] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:27.733690 12846 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.751185 12893 raft_consensus.cc:515] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:27.755013 13026 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.755595  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:27.736426 13144 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.720541 12906 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.760795 12906 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.760928  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.761811  8391 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:27.766822  8387 raft_consensus.cc:1275] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:03:27.736660 13187 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.753511 12893 leader_election.cc:290] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:27.774132  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 88266.8us
W20260709 13:03:27.790139  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 70433.3us
I20260709 13:03:27.751186 12846 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.762379 13079 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:27.809880  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:27.812160 12953 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.812981 12953 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.816277 12953 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.817058  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:27.802352 12745 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.833474  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.862982  8390 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:27.870464 12745 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.872689 12745 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.874264  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.875409  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.875936  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:27.876982  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.878655  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.879765  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.880061 13026 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.880527 13026 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.880646 13131 raft_consensus.cc:1027] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: attempt to promote peer 92314b14f5554885a80c3dc87f4beed4: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:03:27.880945 13026 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.880535  8392 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
I20260709 13:03:27.883836 13147 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:27.884647 13196 log.cc:927] Time spent T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 13:03:27.884895 13197 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.886160  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:27.887761 13197 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.888880  8535 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 7.
W20260709 13:03:27.889976 13193 log.cc:927] Time spent T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:27.891052 13197 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:27.896714 13069 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:27.897965  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 69313.3us
I20260709 13:03:27.899191  8358 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:27.900745  8358 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:27.903494 12745 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:27.903699  8358 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:27.904241 12745 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:27.904989 12745 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:27.795010 13187 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.908209  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:27.909426 13187 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.909623  8433 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:27.910444 13131 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.900888 13069 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:27.910866  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:27.901058  8541 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:27.912040  8433 leader_election.cc:304] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:27.912256 13131 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:27.920217  8358 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:27.922930 12846 raft_consensus.cc:2749] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.925130  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:27.933894  9065 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 LEARNER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:27.935619  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:27.937327 12846 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:27.937821 12846 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.938205 12846 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:27.939445  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.939199 13135 consensus_queue.cc:1048] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:27.939932 13135 consensus_queue.cc:1243] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer 2122d8c723e84e3da22f81f7eeb4b1a9 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:27.929517 12750 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:27.946592  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:27.934312 13079 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:27.947978 13079 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.948536 13079 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:27.957020 13144 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:27.957495 13144 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.958009 13144 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:27.958161  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:27.947115 13187 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:27.959039  8393 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 7: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:27.956324 12750 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:27.959033 13187 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.960728 12750 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:27.962049 13133 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.962566 13133 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.963507 12750 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.965549 13133 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.969702  8389 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:27.962532 13187 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:27.977931 13194 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.978746 13194 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.981467 13194 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:27.982093  8393 pending_rounds.cc:85] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 2
I20260709 13:03:27.982522  8393 pending_rounds.cc:107] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:03:27.982878  8393 raft_consensus.cc:2889] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:27.985105 13023 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:27.986510  8388 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:27.990316  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
W20260709 13:03:27.990588  8509 consensus_peers.cc:597] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f58095c0d8fc462d8edd0f9f658b3eac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.991012  8388 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:27.991973  8544 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:27.971963 13144 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.995386 13026 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:27.996457 13144 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:27.998904  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 93205.7us
I20260709 13:03:27.973580 13131 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:28.014144  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 49728.4us
I20260709 13:03:28.014492  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.015779  8544 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 11.
I20260709 13:03:28.017248  8358 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.035388  8461 raft_consensus.cc:1240] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:28.031646  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.004658 13079 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.047197  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:28.049539  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.050096  8535 raft_consensus.cc:606] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.050617  8535 raft_consensus.cc:614] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:28.050779  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.051446  8468 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 6.
I20260709 13:03:28.057708  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.057943 13144 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:28.058068  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:28.058491  8463 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 6.
I20260709 13:03:28.058775  8464 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.048930  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.035388 13026 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 18 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.040416 12906 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:28.065074  8466 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:28.058677 13144 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.072448  8462 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:28.073009 12906 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:28.073333 13144 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.073889  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd8533706064dd78b4e61de0beb5255" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.074167 12906 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.077659  8464 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:28.079638 12846 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.082322  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.082846  8469 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:28.082572 13202 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:28.091601  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.092449  8470 raft_consensus.cc:2393] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 12: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:28.094504  8387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:36664
I20260709 13:03:28.095242  8387 raft_consensus.cc:606] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.101612 12846 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.106989  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.108896  8466 raft_consensus.cc:2393] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 14: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:28.104295  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.112792  8469 raft_consensus.cc:2393] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 18: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:28.112983  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.114049  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.104429  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.105726  8462 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:28.114064  8468 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
I20260709 13:03:28.106665  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.104468 13079 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.128109  8463 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:28.129417  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 112274us
I20260709 13:03:28.131681  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.143455  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.151479  8507 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.151927 13069 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:28.154203 13197 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.155900  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.157078  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.158133  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.159106 12987 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:28.159282  8433 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:28.159595 12987 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:28.160027 12987 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:28.160254 12846 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:28.161820  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:28.153491  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.162580 13144 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:28.162976 13144 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:28.163357 13144 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.163240 13026 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:28.165091  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.174939  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.178437  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.179665  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.180321  8536 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 7.
I20260709 13:03:28.192875 13194 consensus_queue.cc:1059] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:28.199473  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.201947  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.202495  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.200537  8536 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
W20260709 13:03:28.204768  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 47793.1us
I20260709 13:03:28.204777  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:28.192725 12906 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:28.213964  8508 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:28.228305  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.221028 13026 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:03:28.221616 13131 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:28.238823  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.239480  8388 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.238359  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.243361 13042 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:28.243121 12906 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.243916 13042 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.244323 13042 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.245504 12906 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.248832  8508 leader_election.cc:304] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.250326  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.250211 13198 consensus_queue.cc:1059] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:28.251394 13069 raft_consensus.cc:3055] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:28.251849 13069 raft_consensus.cc:740] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:28.252106 13083 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:28.252704 13069 consensus_queue.cc:260] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.254516  8544 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:28.254956  8544 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:28.256192  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.256735  8389 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:28.226428 12846 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:03:28.259343  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.260432  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.251858  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.259109  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:28.264606 13197 raft_consensus.cc:2749] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:28.279898  8393 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 7.
I20260709 13:03:28.264917  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.268783 12987 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.271629  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.236891 13131 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.280642  8394 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.258072  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:28.308998  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 51003.2us
I20260709 13:03:28.296602  8544 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.299373  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.310117  8389 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.307787  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.315670  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.317047  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.322089  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.322746  8393 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:28.323746  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7219cc411cf6498f8f250f689007874f" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.325054  8508 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:28.315112  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.281893 13069 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.329125  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.321331  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.333946  8538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:28.335150  8538 raft_consensus.cc:606] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:28.339381  8391 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:28.319509 13131 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.346323  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:28.321357 12906 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:28.318709 13194 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:28.355818  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:28.338629 13078 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:28.319110 13198 consensus_queue.cc:1059] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:03:28.374017  8544 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:28.357537 12906 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.351897 13187 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:28.356801 13043 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:28.365620 13147 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:28.366079 13078 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.382719  8358 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.372162 12893 raft_consensus.cc:3055] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:28.369825 13194 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:28.368315 12870 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:03:28.390726 13185 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:28.390522 12912 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:03:28.391844  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.395231 13144 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.396914 12987 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:28.424300  8395 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.389063 13078 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.390180 12893 raft_consensus.cc:740] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:28.413156  8394 raft_consensus.cc:2468] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 18.
I20260709 13:03:28.442526 12893 consensus_queue.cc:260] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.414484 13194 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.443827 12893 raft_consensus.cc:3060] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:28.446502 13213 log.cc:927] Time spent T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:03:28.448525 13144 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.378834 12906 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.451880 13131 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.454175  8463 raft_consensus.cc:1240] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:28.466818  8388 raft_consensus.cc:2468] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 8.
I20260709 13:03:28.468374  8386 raft_consensus.cc:1240] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:28.469920 13131 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.473127  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:28.421236  8389 raft_consensus.cc:2468] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:28.398156 12745 raft_consensus.cc:993] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:28.474833 12745 raft_consensus.cc:1081] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:28.427847  8358 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:28.476346  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 48590.5us
I20260709 13:03:28.477141  8358 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.478541  8358 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.482067 12745 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:28.483009 12745 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.483724 12745 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:28.435948 13042 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.486887  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.486639 13189 raft_consensus.cc:993] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:28.494304  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:28.500471  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.529287 12976 raft_consensus.cc:1081] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:28.506974  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:28.530467  8395 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:28.530884  8470 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.531378  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:28.532749 12976 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:28.532924  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 51499.4us
I20260709 13:03:28.486667 13042 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:28.518649  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 152143us
I20260709 13:03:28.525559 13199 consensus_queue.cc:1059] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:28.537900 13199 raft_consensus.cc:3055] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:28.538288 13199 raft_consensus.cc:740] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:28.539206 13199 consensus_queue.cc:260] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.540434 13199 raft_consensus.cc:3060] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.541123  8358 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.542131 13078 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.543395  8358 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:28.549804  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 169889us
I20260709 13:03:28.550568 12906 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.552976  8544 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:03:28.553422  8544 pending_rounds.cc:85] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 7
I20260709 13:03:28.553651  8544 pending_rounds.cc:107] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:28.585956  8358 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.571338  8464 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:28.566578  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 221435us
W20260709 13:03:28.599057  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 235844us
I20260709 13:03:28.544560 13078 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:28.586108 13189 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:28.553186 12906 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.580989 13038 raft_consensus.cc:3055] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:28.603972 13038 raft_consensus.cc:740] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:28.607586  8470 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
I20260709 13:03:28.605129 13038 consensus_queue.cc:260] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.611306  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.612387  8540 raft_consensus.cc:2368] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8.
I20260709 13:03:28.613857  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.614079 13038 raft_consensus.cc:3060] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.614702  8395 raft_consensus.cc:2368] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8.
I20260709 13:03:28.616411  8293 catalog_manager.cc:5697] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 13 to 14, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 14 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.618053  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.619174  8293 catalog_manager.cc:5697] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 13 to 14, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 14 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.620488  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.621217  8540 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.621356  8293 catalog_manager.cc:5697] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.575569  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:28.627821  8463 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.628993  8508 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:28.556685  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:28.633515  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 76907.7us
I20260709 13:03:28.634488  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.635409  8544 raft_consensus.cc:2889] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:28.629381  8358 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.644503  8358 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.659544  8433 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:28.661211  8433 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:28.664578  8433 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:28.667932  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.674095  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:28.560105 13023 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.675323  8507 leader_election.cc:304] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:28.678952  8358 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.675230  8293 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 9 to 11, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 11 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:28.681875  8358 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.678798  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:28.653995 13198 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:28.678301 13185 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:28.683594 12870 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.686729 13227 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:28.685604 12745 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.687259 13227 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:28.687784 13227 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.690977 13078 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:28.693928 13221 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:28.695066  8465 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:28.681740 12846 raft_consensus.cc:2804] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:28.697968 13225 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.632324 13069 consensus_queue.cc:1059] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:03:28.698328 12846 raft_consensus.cc:697] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:28.699224 13069 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:28.699637 13069 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:28.699396 12846 consensus_queue.cc:237] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.700877 12789 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:28.700623 13069 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.701409 12789 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.703585 13190 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:28.674247 13083 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:03:28.684746  8433 leader_election.cc:400] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8.
I20260709 13:03:28.669373 13189 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.685331  8469 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 8: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:28.653589  8462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:03:28.678733  8461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:03:28.709019  8540 raft_consensus.cc:2468] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 12.
I20260709 13:03:28.709134  8462 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:28.709486  8461 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:28.709614  8462 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.709904  8461 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:28.710085  8508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.704123 13190 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:28.710984  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50742 (request call id 223) took 5453 ms. Trace:
I20260709 13:03:28.705955  8433 leader_election.cc:403] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:03:28.703675 12789 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.682160 13079 raft_consensus.cc:2804] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:28.714900  8293 catalog_manager.cc:5697] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 9 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 10 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.710865 13190 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.683166 13131 raft_consensus.cc:2804] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:28.722790  8543 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:28.722968 13141 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967) with higher term. Message: Invalid argument: T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8.
I20260709 13:03:28.725713  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.716001 13221 raft_consensus.cc:2749] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:28.728287  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.708748 12976 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:28.714485 13198 raft_consensus.cc:697] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:28.722169  8293 catalog_manager.cc:5697] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 10 to 12, leader changed from 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 12 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:28.734647  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 59470.5us
I20260709 13:03:28.730392 13079 raft_consensus.cc:697] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:28.741050 13079 consensus_queue.cc:237] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.744699 13198 consensus_queue.cc:237] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.675922 13023 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.727312 13069 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:28.754458  8462 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.774586  8433 leader_election.cc:400] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 7 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for earlier term 7. Current term is 8.
I20260709 13:03:28.732908 13131 raft_consensus.cc:697] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:28.754074  8461 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.761806 13054 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 8 to 11, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:28.768455 13220 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:28.770172 12870 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:28.771003  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.778693 13228 ts_tablet_manager.cc:933] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.779031 13185 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:28.779672 12750 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:28.781984  8393 raft_consensus.cc:1240] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:03:28.783159  8389 raft_consensus.cc:1240] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:28.784138 13131 consensus_queue.cc:237] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.785684  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.804976  8462 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.807982 13190 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.810068 13185 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.711469  8289 rpcz_store.cc:276] 0709 13:03:23.257868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.258035 (+   167us) service_pool.cc:224] Handling call
0709 13:03:28.710897 (+5452862us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:27.943619 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:27.944328 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:27.944379 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:03:27.944412 (+    33us) tablet.cc:662] Decoding operations
0709 13:03:28.008152 (+ 63740us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:28.008291 (+   139us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:28.008324 (+    33us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:03:28.009511 (+  1187us) tablet.cc:701] Row locks acquired
0709 13:03:28.009582 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:03:28.009759 (+   177us) write_op.cc:270] Start()
0709 13:03:28.031284 (+ 21525us) write_op.cc:276] Timestamp: P: 1783602208009696 usec, L: 0
0709 13:03:28.043520 (+ 12236us) op_driver.cc:348] REPLICATION: starting
0709 13:03:28.058342 (+ 14822us) log.cc:844] Serialized 4384 byte log entry
0709 13:03:28.295875 (+237533us) op_driver.cc:464] REPLICATION: finished
0709 13:03:28.480901 (+185026us) write_op.cc:301] APPLY: starting
0709 13:03:28.480998 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:28.547106 (+ 66108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:28.547218 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:28.592255 (+ 45037us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:28.592586 (+   331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:03:28.592651 (+    65us) write_op.cc:312] APPLY: finished
0709 13:03:28.593023 (+   372us) log.cc:844] Serialized 105 byte log entry
0709 13:03:28.593234 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:28.593374 (+   140us) write_op.cc:454] Released schema lock
0709 13:03:28.593460 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:28.619768 (+ 26308us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:28.619799 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":184756,"apply.run_cpu_time_us":16204,"apply.run_wall_time_us":112967,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50217,"num_ops":11,"prepare.queue_time_us":132454,"prepare.run_cpu_time_us":19566,"prepare.run_wall_time_us":204189,"raft.queue_time_us":135219,"raft.run_cpu_time_us":49778,"raft.run_wall_time_us":194812,"replication_time_us":252171,"thread_start_us":465837,"threads_started":4,"wal-append.queue_time_us":82881}]]}
I20260709 13:03:28.812604 13185 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.813315 13023 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.813768 13187 consensus_queue.cc:1059] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:28.814885 13187 raft_consensus.cc:3055] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:28.815433 13187 raft_consensus.cc:740] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:28.816334 13187 consensus_queue.cc:260] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.818832 13187 raft_consensus.cc:3060] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.824978 13219 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:28.825620 13219 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.794756  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.830825  8392 raft_consensus.cc:3060] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.832274 13078 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36702 (request call id 4) took 1008 ms. Trace:
I20260709 13:03:28.832751 13078 rpcz_store.cc:276] 0709 13:03:27.807251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.808102 (+   851us) service_pool.cc:224] Handling call
0709 13:03:27.900332 (+ 92230us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b58007673d0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe134430aa 00007fbe134c5447 00007fbe134e270a 00007fbe134e376a 00007fbe134e291b 00007fbe134ee03c 00007fbe134ed6b3 00007fbe184add29 00007fbe11a2c1d4 00007fbe11a2c162
0709 13:03:27.914147 (+ 13815us) log.cc:844] Serialized 499 byte log entry
0709 13:03:28.090219 (+176072us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe10320c85 00007fbe103216a2 00007fbe130931db 00007fbe1308eaaf 00007fbe1308286e 00007fbe13081bb6 00007fbe130817d8 00007fbe1308b221 00007fbe1308b1d9 00007fbe1308b169
0709 13:03:28.805488 (+715269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30991,"raft.queue_time_us":30575,"raft.run_cpu_time_us":2070,"raft.run_wall_time_us":38469,"spinlock_wait_cycles":94473344,"thread_start_us":16498,"threads_started":1,"wal-append.queue_time_us":102156}
I20260709 13:03:28.786929  8433 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:28.797192 12870 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.798756  8463 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 15.
I20260709 13:03:28.810092  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.840293  8395 raft_consensus.cc:2393] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 8: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:28.817303 12750 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.844990 13144 raft_consensus.cc:2804] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:28.845604 13144 raft_consensus.cc:697] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:28.846674 13144 consensus_queue.cc:237] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.848742 13190 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.853610 12750 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.854664 13227 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.856946 13227 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:28.858512 13219 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.787698  8461 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:28.794706  8507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.861688  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 74852.6us
I20260709 13:03:28.865756  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.866480  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:28.866043  8541 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 8 to 11, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:28.867623 13189 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:28.869612  8538 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:28.869714  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 66840.6us
I20260709 13:03:28.875015  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.883185  8538 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.886098  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.886794  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:28.887598  8394 raft_consensus.cc:3055] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:28.887953  8394 raft_consensus.cc:740] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:28.888767  8394 consensus_queue.cc:260] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.890374  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.891008  8543 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.891975  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.892715  8544 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:28.892941  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.893754  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.898869  8508 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:28.885888 13227 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:28.900279  8394 raft_consensus.cc:3060] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.886749  8391 raft_consensus.cc:3055] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:28.917084  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.913553  8392 raft_consensus.cc:2468] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 15.
I20260709 13:03:28.932443 13228 tablet_copy_client.cc:323] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:03:28.917316  8391 raft_consensus.cc:740] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:28.936134  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:28.947342  8535 raft_consensus.cc:2368] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 14. Current term is 15.
W20260709 13:03:28.949420  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 50637.1us
I20260709 13:03:28.947314  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:28.958591  8543 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:28.960317  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.962862  8358 leader_election.cc:400] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 14. Current term is 15.
I20260709 13:03:28.963230  8358 leader_election.cc:403] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:28.968734  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:28.970757  8465 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:28.981822  8394 raft_consensus.cc:2468] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:28.939247 12750 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:28.988390  8507 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:28.975266  8391 consensus_queue.cc:260] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:28.963189 13198 raft_consensus.cc:2804] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:28.965700 12870 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:28.982873 13187 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 14. Current term is 15.
W20260709 13:03:29.017431  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 63373.8us
I20260709 13:03:29.024967  8469 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:29.025775  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:29.027599  8463 raft_consensus.cc:1240] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:29.025900  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:29.031008  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:29.032018  8463 raft_consensus.cc:2368] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 14. Current term is 15.
I20260709 13:03:29.032963  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:29.029316  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:29.039201  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:29.006317 13194 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:29.050733  8462 raft_consensus.cc:1240] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:29.051643  8433 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:29.002616 12750 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.069190  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:29.046801 13198 raft_consensus.cc:697] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:29.052907 13044 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.076658  8535 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Rejecting Update request from peer d2a645dcec4c479ba4c94d075b1bc98c for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:29.074805  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:29.039103 12943 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:03:29.071635 13145 raft_consensus.cc:2804] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:29.117990  8538 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:29.078126 13141 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:29.123026  8359 leader_election.cc:400] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 14. Current term is 15.
I20260709 13:03:29.107059 13043 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:29.079921 13144 consensus_queue.cc:1059] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:03:29.139133 13198 consensus_queue.cc:237] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.146349  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:29.147505  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:29.149763  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.149448  8507 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:29.152910  8359 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:29.156621 12870 raft_consensus.cc:2749] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:29.161612 13221 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:29.081354 13044 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:29.168154 13044 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:29.123164 13141 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:29.175323  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:29.174443 13190 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:29.176764 13079 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:29.174543  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 159401us
I20260709 13:03:29.178143  8386 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:29.145828 12976 consensus_queue.cc:1059] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 13:03:29.188582 13237 log.cc:927] Time spent T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:29.170758 13220 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:29.196561  8358 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:29.174553 13141 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.177161 13079 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:29.182754 13190 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:29.183962 13197 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:29.210566 13189 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:29.230367 13197 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:29.231634 12750 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:29.232642  8391 raft_consensus.cc:3060] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.236513  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:29.237267  9065 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:29.241389  8509 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:29.228055 13079 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.210055 13145 raft_consensus.cc:697] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:29.246932 13079 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:29.248073 13145 consensus_queue.cc:237] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.232776 13197 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:29.253875 13042 raft_consensus.cc:993] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:29.226264  9068 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 8 to 11, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:29.270118  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:29.281738  8392 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 11.
W20260709 13:03:29.281950  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 202866us
I20260709 13:03:29.283321  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:29.291878  8386 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:29.290210  8433 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:29.286552  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
W20260709 13:03:29.332137  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 45667.2us
W20260709 13:03:29.334563  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 93278.7us
I20260709 13:03:29.332818  8395 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:03:29.348022  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 65541.6us
I20260709 13:03:29.349992  8394 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:29.358541  8538 raft_consensus.cc:1275] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:03:29.359376  8538 pending_rounds.cc:85] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: Aborting all ops after (but not including) 9
I20260709 13:03:29.359767  8538 pending_rounds.cc:107] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:03:29.360149  8538 raft_consensus.cc:2889] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:29.329517 13023 raft_consensus.cc:2804] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:29.362453  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:29.365877 13225 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:29.345829 13194 raft_consensus.cc:1081] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:29.346043 12943 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:29.367522 12943 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:29.368489 12943 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:29.329741 13131 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:03:29.367475  8542 raft_consensus.cc:1240] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:29.375085 13239 log.cc:927] Time spent T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:03:29.377566  8553 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet f58095c0d8fc462d8edd0f9f658b3eac from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:03:29.378297  8553 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet f58095c0d8fc462d8edd0f9f658b3eac from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-f58095c0d8fc462d8edd0f9f658b3eac
I20260709 13:03:29.384635  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:29.357131  8392 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 8 to 11, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:29.418303  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 56499us
I20260709 13:03:29.450807  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 112) took 3169 ms. Trace:
I20260709 13:03:29.396389 13023 raft_consensus.cc:697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:29.484333  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:29.486368  8392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:29.487030  8392 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:29.487473  8392 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.511229  8392 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:29.451238  8293 rpcz_store.cc:276] 0709 13:03:26.267052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.267620 (+   568us) service_pool.cc:224] Handling call
0709 13:03:29.435878 (+3168258us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:28.926680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:28.927572 (+   892us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:28.927625 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:03:28.927655 (+    30us) tablet.cc:662] Decoding operations
0709 13:03:28.928831 (+  1176us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:28.928938 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:28.928980 (+    42us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:03:28.929722 (+   742us) tablet.cc:701] Row locks acquired
0709 13:03:28.929751 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:03:28.930018 (+   267us) write_op.cc:270] Start()
0709 13:03:28.930186 (+   168us) write_op.cc:276] Timestamp: P: 1783602208929937 usec, L: 0
0709 13:03:28.930219 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:03:28.931189 (+   970us) log.cc:844] Serialized 2434 byte log entry
0709 13:03:28.933863 (+  2674us) op_driver.cc:464] REPLICATION: finished
0709 13:03:28.934390 (+   527us) write_op.cc:301] APPLY: starting
0709 13:03:28.934473 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:29.183824 (+249351us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:29.187760 (+  3936us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:29.223815 (+ 36055us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:29.233566 (+  9751us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:03:29.233617 (+    51us) write_op.cc:312] APPLY: finished
0709 13:03:29.233902 (+   285us) log.cc:844] Serialized 65 byte log entry
0709 13:03:29.234084 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:29.234196 (+   112us) write_op.cc:454] Released schema lock
0709 13:03:29.234257 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:29.234619 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:29.234649 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33494,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":301,"apply.run_cpu_time_us":11259,"apply.run_wall_time_us":300175,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25140,"num_ops":6,"prepare.queue_time_us":66288,"prepare.run_cpu_time_us":4907,"prepare.run_wall_time_us":4905,"replication_time_us":3450,"thread_start_us":65835,"threads_started":1}]]}
I20260709 13:03:29.524173 13243 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:29.536334  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 128071us
W20260709 13:03:29.542728 13248 log.cc:927] Time spent T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:29.534778 13254 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:03:29.542819 13243 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.527597 12943 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:29.584791  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 79876.9us
I20260709 13:03:29.586107 13243 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:29.597267  8392 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:29.586506  8290 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 9, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:29.589159  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:29.601388  8359 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:29.605568  8386 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:03:29.606107  8386 pending_rounds.cc:85] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 7
I20260709 13:03:29.606398  8386 pending_rounds.cc:107] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:03:29.606691  8386 raft_consensus.cc:2889] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:29.609234  8467 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:03:29.610219 13247 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:03:29.611723  8553 tablet_copy_source_session.cc:215] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:29.614694 12953 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:29.615172 12953 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:29.622047 13133 consensus_queue.cc:1048] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:29.625765  8393 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:29.627054  8395 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:29.634546  8542 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 11.
I20260709 13:03:29.616078 12953 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.646927 12943 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:29.648167  8290 catalog_manager.cc:5697] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 7 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.541381 13023 consensus_queue.cc:237] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.667979  8290 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.670533  8290 catalog_manager.cc:5697] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 5 to 7, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 7 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.672204  8290 catalog_manager.cc:5697] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.641963 12870 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:29.582986 13141 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.662262 12846 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:29.673987  8468 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:29.665139 13145 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:29.675108 13141 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:29.666401  8395 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:29.639753 13244 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:03:29.683063  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:29.684480  8391 raft_consensus.cc:2468] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
W20260709 13:03:29.691957  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 46776.5us
W20260709 13:03:29.692560  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 64596.2us
I20260709 13:03:29.698038 12953 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.739001  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:29.739683  9065 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.687026 13141 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:03:29.697569 12870 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:03:29.758734  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 64703us
I20260709 13:03:29.771950 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58095c0d8fc462d8edd0f9f658b3eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:29.778517  8542 raft_consensus.cc:1275] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:29.780488  8535 raft_consensus.cc:1275] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:29.783304  8535 raft_consensus.cc:1275] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:29.759992 13185 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:29.777920 13190 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:29.813230  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:29.819240  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:29.819928  8544 raft_consensus.cc:3055] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:29.820271  8544 raft_consensus.cc:740] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:29.825954  9065 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:29.826757  9068 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:29.833612  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:29.834522  8395 raft_consensus.cc:2393] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 11: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:29.839851  8388 raft_consensus.cc:1240] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:29.834110  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:29.847720 12750 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:29.848523 12750 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.853437 12750 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:29.811614 13190 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:29.861917  8544 consensus_queue.cc:260] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:29.871181  8544 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.797602 13185 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.804643 13262 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:03:29.881505  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 58955.9us
W20260709 13:03:29.881635  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 70897.9us
I20260709 13:03:29.886582  8461 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:29.901661  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:29.902199  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 49744us
I20260709 13:03:29.893046 13190 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.872496 13243 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:29.903528 13190 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.905194 13243 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:29.908774  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:29.909875  8540 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:29.911876  8358 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:29.917712  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:29.916908 12750 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:29.918468  8392 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:29.918427 12750 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:29.919091 12750 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:29.924072  9060 raft_consensus.cc:2368] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12.
I20260709 13:03:29.933363  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:29.934114  8543 raft_consensus.cc:3060] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:29.928092 13101 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:03:29.941746 13244 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.896953 13185 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:29.953059  8392 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 12.
I20260709 13:03:29.947268  8360 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:29.958197  8544 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:29.977164  8543 raft_consensus.cc:2468] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 12.
I20260709 13:03:29.990114  9032 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:03:29.994426  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 47248.4us
I20260709 13:03:29.997599 13189 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:29.998270 13189 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:29.999313 13189 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:30.015987 12953 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.016664 12953 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:29.997691 13192 raft_consensus.cc:2804] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:30.023340 13192 raft_consensus.cc:697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:30.024312 13192 consensus_queue.cc:237] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:29.963971 12750 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.030108  8390 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:30.031913 12750 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:30.037688  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.038087  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.040086  8392 raft_consensus.cc:1275] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:30.054627  8467 raft_consensus.cc:2393] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 10: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:30.056272  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:29.965296 13244 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.066743 13185 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.074397  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 53825.2us
I20260709 13:03:30.090276  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:30.089771 13219 consensus_queue.cc:1048] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:03:30.074615 13145 consensus_queue.cc:1048] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:03:30.073812 13043 consensus_queue.cc:1048] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:30.101362 13197 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.101969 13120 consensus_queue.cc:1048] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:30.108083  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:30.110646  8535 raft_consensus.cc:1275] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:30.111177  8509 leader_election.cc:400] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12.
I20260709 13:03:30.129415  8509 leader_election.cc:403] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:03:30.131614 13194 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.132234 13194 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.146932 12953 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:30.074395 13185 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:30.171983  8509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 63210.2us
I20260709 13:03:30.175110  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:30.176677  8535 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:30.161350 13185 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:30.190491  8358 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:03:30.191497  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 62978.9us
I20260709 13:03:30.201639  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:30.208298  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:30.209000  8538 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:30.211211  8542 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:30.175769 13043 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.181957 12912 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855) with higher term. Message: Invalid argument: T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b for earlier term 11. Current term is 12.
I20260709 13:03:30.238683  8394 raft_consensus.cc:1275] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:30.238801  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:30.234759  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:30.227665 13185 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:30.180429 13197 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.276682  8543 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 10.
I20260709 13:03:30.278177  8358 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:30.284039 13270 raft_consensus.cc:2749] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:30.257777 13185 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.285851 13185 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:30.306030 13278 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:03:30.322026 13273 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:03:30.351884 13231 log.cc:927] Time spent T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.262s	user 0.003s	sys 0.002s
I20260709 13:03:30.362221 13194 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:30.265012 13254 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:03:30.321259 12745 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:30.380755 13185 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.383919 13244 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:30.392683 13197 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:30.393685  8391 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 15: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:30.394832 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58874 (request call id 397) took 1892 ms. Trace:
I20260709 13:03:30.395316 13228 rpcz_store.cc:276] 0709 13:03:28.502827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.502964 (+   137us) service_pool.cc:224] Handling call
0709 13:03:28.801194 (+298230us) ts_tablet_manager.cc:934] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
0709 13:03:29.698408 (+897214us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:30.060286 (+361878us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:30.060400 (+   114us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:30.393828 (+333428us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:30.394289 (+   461us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:30.394679 (+   390us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:30.394745 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":342,"tablet-copy.queue_time_us":202045,"thread_start_us":246627,"threads_started":2}
I20260709 13:03:30.397382 12745 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:30.397617 13268 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:30.398269 13268 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.398494 12745 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.396888 13185 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:30.402194 13268 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:30.429600  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 164179us
I20260709 13:03:30.446749  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:30.447399  8538 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.447489  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:30.448257  8543 raft_consensus.cc:2393] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 13: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:30.409538 13228 tablet_copy_client.cc:806] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:30.471710  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.472416  8464 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:30.472127  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:30.478886  8462 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.534240  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.536670  8468 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:30.542842  8538 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 15.
W20260709 13:03:30.544310  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 237312us
I20260709 13:03:30.547178  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:30.462041 13133 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:03:30.554177  8393 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 15: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:30.533051 13228 tablet_copy_client.cc:670] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:30.564936  8462 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 15.
I20260709 13:03:30.579272  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:30.602048 13133 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.602619 13133 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.604952 13287 raft_consensus.cc:2764] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:03:30.604714 13219 consensus_queue.cc:1048] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:03:30.606407 13285 log.cc:927] Time spent T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:30.612545  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.613309  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.614413  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c257a516245f4698b8937b228b23d23a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.633682  8508 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:30.644577  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:30.638765 13038 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:30.673832  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 94604.9us
I20260709 13:03:30.677417 13144 consensus_queue.cc:1048] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:03:30.672106 13286 log.cc:927] Time spent T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:03:30.687436  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:30.691080  8359 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:30.695472 13189 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:30.702831 13185 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:30.732697  8544 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:03:30.733635  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:30.703714 13218 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
W20260709 13:03:30.745100 13293 log.cc:927] Time spent T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:03:30.748837  8507 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:30.726776 13257 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.762458  8543 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:30.766485  9060 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:03:30.774806  8461 raft_consensus.cc:2393] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 15: Already voted for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in this term.
I20260709 13:03:30.833227 13228 tablet_copy_client.cc:538] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:30.781210 13133 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:30.784879 13120 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:30.786311  8386 raft_consensus.cc:1275] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:30.791042 13257 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.837179 13257 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:30.749708 13185 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:30.795624 13270 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:30.755362 13218 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:30.838500 13185 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.728678 13189 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:30.841989 13189 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:30.847657  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 156660us
I20260709 13:03:30.853415  8543 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:03:30.854796  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.857048  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:30.860967  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:30.857772  8463 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:30.841497 13218 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:30.858405  8293 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index -1 to 11, term changed from 15 to 17, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194), VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added, no longer has a pending config: VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193), VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194), VOTER c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195), NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 17 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:30.846015 12789 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:03:30.872665 12750 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:30.873260 12750 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.871757  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:30.875844  9032 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:30.883689  8508 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:30.889213  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:30.864341 13048 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:03:30.890059  8544 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:30.874011 13257 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:30.885874 13078 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:30.890089 13289 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.913955 12750 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:30.899361 13101 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:30.909189 13044 consensus_queue.cc:1048] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:03:30.935132 13301 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:03:30.902729 13083 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:30.954380 13083 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:30.937583 13101 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.955585 13101 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:30.956614 13083 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:30.907943 13257 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:30.959931 13257 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:30.964663 13189 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:30.982271  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 54153.6us
I20260709 13:03:30.993404  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:31.003909 13228 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
W20260709 13:03:31.077473  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 53666.6us
I20260709 13:03:31.093046  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:31.089596  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:31.104753  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:31.110826  8538 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 14: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
W20260709 13:03:31.111958  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 213165us
I20260709 13:03:31.116945  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:31.017716 13189 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:31.142166  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:31.142933  8390 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
I20260709 13:03:31.144131  8387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:31.144968  8387 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:31.151467  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:31.151749  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:31.152221  8468 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:31.131335 13254 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:31.110123 12789 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:03:31.176800  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:31.186199  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:31.187602  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:31.175558  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 249) took 6013 ms. Trace:
I20260709 13:03:31.192800  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:31.197297  8468 raft_consensus.cc:2393] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 14: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:31.159657 13254 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.207402  8463 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:31.201285 13270 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:31.213898 13101 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.214569 13270 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:31.215101 13270 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:31.216827 13244 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:31.217293 13244 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:31.218695  8538 raft_consensus.cc:2368] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14.
I20260709 13:03:31.217689 13244 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:31.239199  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:31.240216 13300 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:31.240744 13300 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:31.241679 13300 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.209460 13254 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:31.190177  8290 rpcz_store.cc:276] 0709 13:03:25.147335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.153025 (+  5690us) service_pool.cc:224] Handling call
0709 13:03:31.160886 (+6007861us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:29.829378 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:29.830022 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:29.830065 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:03:29.830089 (+    24us) tablet.cc:662] Decoding operations
0709 13:03:29.830766 (+   677us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:29.830878 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:29.830903 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:29.831393 (+   490us) tablet.cc:701] Row locks acquired
0709 13:03:29.831412 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:03:29.831552 (+   140us) write_op.cc:270] Start()
0709 13:03:29.831680 (+   128us) write_op.cc:276] Timestamp: P: 1783602209831507 usec, L: 0
0709 13:03:29.831705 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:03:29.832378 (+   673us) log.cc:844] Serialized 2079 byte log entry
0709 13:03:29.993053 (+160675us) op_driver.cc:464] REPLICATION: finished
0709 13:03:30.279189 (+286136us) write_op.cc:301] APPLY: starting
0709 13:03:30.279291 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:30.282506 (+  3215us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:30.324328 (+ 41822us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:30.712838 (+388510us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:30.713053 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:03:30.713110 (+    57us) write_op.cc:312] APPLY: finished
0709 13:03:30.713395 (+   285us) log.cc:844] Serialized 57 byte log entry
0709 13:03:30.713584 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:30.713707 (+   123us) write_op.cc:454] Released schema lock
0709 13:03:30.717901 (+  4194us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:30.718293 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:30.718327 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1590,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":253180,"apply.run_cpu_time_us":11490,"apply.run_wall_time_us":439086,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25077,"num_ops":5,"prepare.queue_time_us":79068,"prepare.run_cpu_time_us":3341,"prepare.run_wall_time_us":7352,"replication_time_us":154625,"thread_start_us":204922,"threads_started":2}]]}
W20260709 13:03:31.258816  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 49116.5us
I20260709 13:03:31.276398  8358 leader_election.cc:400] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Vote denied by peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791) with higher term. Message: Invalid argument: T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14.
I20260709 13:03:31.250892 13101 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:31.333705  8508 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:31.348645  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:31.349403 13270 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.359328 13194 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.373311  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:31.375445  8462 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:31.380180  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:31.362847 13270 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:31.388722 13268 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:31.401510 12987 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:31.401770  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 68129.9us
I20260709 13:03:31.360013 13194 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.433475  8542 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:31.452250  8535 raft_consensus.cc:2393] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in current term 14: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:31.463757  8462 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 14.
I20260709 13:03:31.466150 12789 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:31.466774  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:31.467675 12789 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:31.468253 12789 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:31.469149 12789 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.487084 13194 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:31.497925  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:31.498840  8463 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:31.502384  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:31.511399  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:31.512354  8468 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
W20260709 13:03:31.488252 13318 log.cc:927] Time spent T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.066s	user 0.004s	sys 0.000s
I20260709 13:03:31.526649  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:31.527704 12987 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:31.528153 12987 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.528503 12987 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:31.580097  8463 raft_consensus.cc:2468] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
I20260709 13:03:31.582080  8508 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:31.586614 13257 raft_consensus.cc:2804] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:31.587165 13257 raft_consensus.cc:697] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:31.588131 13257 consensus_queue.cc:237] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:31.585191 13209 log.cc:927] Time spent T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:03:31.600093  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 89995.7us
W20260709 13:03:31.634884 13317 log.cc:927] Time spent T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:03:31.636504 13321 log.cc:927] Time spent T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:03:31.643368 13244 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.609537 13254 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.647409 13254 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:31.648105  8466 raft_consensus.cc:1240] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:31.655260 13244 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:31.656881  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:31.657861  8462 raft_consensus.cc:2393] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c45599d1dc3b4823b857cf77f276dc7b in current term 14: Already voted for candidate d2a645dcec4c479ba4c94d075b1bc98c in this term.
I20260709 13:03:31.562150  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:31.669493 13315 log.cc:927] Time spent T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.246s	user 0.005s	sys 0.002s
I20260709 13:03:31.672808  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 113) took 1603 ms. Trace:
I20260709 13:03:31.679075 12987 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.682566 12987 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:31.693084  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:31.693845  8466 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:31.673251  8293 rpcz_store.cc:276] 0709 13:03:30.056196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.056408 (+   212us) service_pool.cc:224] Handling call
0709 13:03:30.191230 (+134822us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001608d4. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13451090 00007fbe134eff3a 00007fbe192a61cc 00007fbe193a437e 00007fbe178652a4 00007fbe17865232 00007fbe17865161 00007fbe178650dc 00007fbe17864392 00007fbe1182248c 00007fbe118218c6
0709 13:03:31.659608 (+1468378us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:31.208240 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:31.210862 (+  2622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:31.210900 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:03:31.210919 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:31.211285 (+   366us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:31.211347 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:31.211372 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:31.211570 (+   198us) tablet.cc:701] Row locks acquired
0709 13:03:31.211587 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:03:31.211724 (+   137us) write_op.cc:270] Start()
0709 13:03:31.211831 (+   107us) write_op.cc:276] Timestamp: P: 1783602211211683 usec, L: 0
0709 13:03:31.211852 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:31.212517 (+   665us) log.cc:844] Serialized 595 byte log entry
0709 13:03:31.353125 (+140608us) op_driver.cc:464] REPLICATION: finished
0709 13:03:31.464250 (+111125us) write_op.cc:301] APPLY: starting
0709 13:03:31.464356 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:31.481908 (+ 17552us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:31.485109 (+  3201us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:31.486070 (+   961us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:31.486237 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:03:31.486281 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:31.486483 (+   202us) log.cc:844] Serialized 25 byte log entry
0709 13:03:31.487243 (+   760us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:31.487332 (+    89us) write_op.cc:454] Released schema lock
0709 13:03:31.487375 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:31.487848 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:31.487876 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":123444,"reported_tablets":4,"spinlock_wait_cycles":296839040,"child_traces":[["op",{"apply.queue_time_us":110768,"apply.run_cpu_time_us":3874,"apply.run_wall_time_us":23597,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8317,"num_ops":1,"prepare.queue_time_us":239654,"prepare.run_cpu_time_us":2601,"prepare.run_wall_time_us":14859,"replication_time_us":141134,"thread_start_us":275895,"threads_started":2}]]}
I20260709 13:03:31.713550  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:31.718106  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:31.738055  8466 raft_consensus.cc:2468] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 15.
I20260709 13:03:31.740051  8508 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:31.740901 13262 raft_consensus.cc:2804] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:31.741390 13262 raft_consensus.cc:697] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:31.742297 13262 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.720086 13185 consensus_queue.cc:1059] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:03:31.767262 13268 raft_consensus.cc:3055] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:31.802199  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:31.793368 13268 raft_consensus.cc:740] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:31.829923  8466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47224
I20260709 13:03:31.830631  8466 raft_consensus.cc:606] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: Received request to transfer leadership
I20260709 13:03:31.815176 13288 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:31.850903 13268 consensus_queue.cc:260] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:31.868031 13268 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:31.933552  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:31.959868  8390 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
I20260709 13:03:31.961261  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:31.978991  8288 catalog_manager.cc:5697] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 11 to 12, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.983680  8288 catalog_manager.cc:5697] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
W20260709 13:03:31.990229  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 47162.9us
I20260709 13:03:31.992323  8288 catalog_manager.cc:5697] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.996374 12953 raft_consensus.cc:993] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: : Instructing follower 92314b14f5554885a80c3dc87f4beed4 to start an election
I20260709 13:03:31.996894 13228 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:31.996752  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157886d313c14dff8294260f4377baf4"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:31.997624  8542 raft_consensus.cc:606] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:31.997675  8288 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 9 to 11, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.997090 12953 raft_consensus.cc:1081] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: Signalling peer 92314b14f5554885a80c3dc87f4beed4 to start an election
I20260709 13:03:32.001502  8288 catalog_manager.cc:5697] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 10 to 12, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.003749  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:32.004492  8542 raft_consensus.cc:606] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:32.005119  8542 raft_consensus.cc:614] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:32.005416  8466 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:32.006577  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.010504  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:32.012182  9068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375"
dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
 from {username='slave'} at 127.0.0.1:58892
I20260709 13:03:32.012391  8466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47224
I20260709 13:03:32.013067  9068 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.013119  8466 raft_consensus.cc:606] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: Received request to transfer leadership
I20260709 13:03:32.013535  9068 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.013834 13228 tablet_bootstrap.cc:492] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:03:32.014717 13228 ts_tablet_manager.cc:1403] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 1.011s	user 0.034s	sys 0.024s
I20260709 13:03:32.019807  8542 raft_consensus.cc:606] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:32.028964  9068 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:32.039009 13268 consensus_queue.cc:1059] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:32.039943 13299 raft_consensus.cc:3055] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:32.040596 13299 raft_consensus.cc:740] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:32.041600 13299 consensus_queue.cc:260] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.042681  8507 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:32.042992 13299 raft_consensus.cc:3060] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:32.044447 13343 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:32.044975 13343 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:32.039914  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:32.046154  8390 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.049106 13343 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.051404  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:32.053505  8542 raft_consensus.cc:606] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:32.053651 13311 raft_consensus.cc:993] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:32.054195 13311 raft_consensus.cc:1081] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:32.055138  8542 raft_consensus.cc:614] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:32.062851  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:32.063592  8542 raft_consensus.cc:606] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:32.063548  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:32.064481  8466 raft_consensus.cc:3055] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:32.064805  8466 raft_consensus.cc:740] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:32.065632  8466 consensus_queue.cc:260] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:32.067144  8466 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.070096  8542 raft_consensus.cc:614] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:32.070222 13228 raft_consensus.cc:359] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:32.071352  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:32.071435 13228 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:03:32.072212 13228 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:32.073019  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:03:32.075271  8278 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 48eb2b2d1e724640bdcade4f8baa0375 already in progress [suppressed 1 similar messages]
I20260709 13:03:32.075812  8466 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 18.
I20260709 13:03:32.078815  8390 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 18.
I20260709 13:03:32.083736  9033 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:32.088191  9068 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 18 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:32.089604  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:32.090546  8542 raft_consensus.cc:3060] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.096190  8540 raft_consensus.cc:1240] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:32.095338 13290 raft_consensus.cc:2804] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:32.097935 13290 raft_consensus.cc:697] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 18 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:32.102424  8540 raft_consensus.cc:1240] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Rejecting Update request from peer 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:32.098897 13290 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:32.115345 13344 raft_consensus.cc:993] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:32.115998 12789 consensus_queue.cc:1059] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:32.119221 13344 raft_consensus.cc:1081] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer d2a645dcec4c479ba4c94d075b1bc98c to start an election
I20260709 13:03:32.126331  8468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:03:32.126601 13228 ts_tablet_manager.cc:1434] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.112s	user 0.004s	sys 0.004s
I20260709 13:03:32.126977  8468 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.127403  8468 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.129949  8553 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-f58095c0d8fc462d8edd0f9f658b3eac received from {username='slave'} at 127.0.0.1:56998
I20260709 13:03:32.130497  8553 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-f58095c0d8fc462d8edd0f9f658b3eac on tablet f58095c0d8fc462d8edd0f9f658b3eac with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:32.129966 12789 consensus_queue.cc:1243] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Peer c45599d1dc3b4823b857cf77f276dc7b log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:32.133586 13299 raft_consensus.cc:3055] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:32.134097 13299 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:32.135152 13299 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.138450  8542 raft_consensus.cc:2468] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 18.
I20260709 13:03:32.142895  8468 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.147221  8468 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:32.148272  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:32.148859  8390 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.149592  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:32.150303  8392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "157886d313c14dff8294260f4377baf4"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:32.150810  8392 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.151141  8392 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:32.152410  8389 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:03:32.152777  8389 pending_rounds.cc:85] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 5
I20260709 13:03:32.152994  8389 pending_rounds.cc:107] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:03:32.153214  8389 raft_consensus.cc:2889] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.154824  8542 raft_consensus.cc:3055] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:32.155373  8542 raft_consensus.cc:740] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:32.157677  8390 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:32.159097  8433 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:32.156373  8542 consensus_queue.cc:260] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:32.146428  8278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 71287.3us
I20260709 13:03:32.180769  8466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375"
dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47224
I20260709 13:03:32.181565  8466 raft_consensus.cc:606] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Received request to transfer leadership
I20260709 13:03:32.182001  8466 raft_consensus.cc:614] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:32.167228  8542 raft_consensus.cc:3060] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.166850 12987 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:03:32.171546  8392 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.196492  8392 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:32.174866 13299 raft_consensus.cc:3060] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.167289 13336 raft_consensus.cc:2804] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:32.204062 13336 raft_consensus.cc:697] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:32.210347  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:32.210992  8461 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:32.218549  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:32.219494  8540 raft_consensus.cc:3055] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:32.219885  8540 raft_consensus.cc:740] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:32.228019  8540 consensus_queue.cc:260] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.229548  8540 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:32.205642 13336 consensus_queue.cc:237] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.238989 13302 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.239543 13302 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.240973  8540 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:03:32.243243 13302 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:32.228096  8341 auto_rebalancer.cc:893] Removing replace marker failed: Replica d2a645dcec4c479ba4c94d075b1bc98c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:32.248310  8341 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:03:32.248677  8341 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:03:32.253683  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:32.253463  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 87355us
I20260709 13:03:32.259457  8466 raft_consensus.cc:1275] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:03:32.415038  8390 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:03:32.417732  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:32.420748  8390 pending_rounds.cc:85] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting all ops after (but not including) 9
I20260709 13:03:32.420921  8393 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:32.421238  8390 pending_rounds.cc:107] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:03:32.421831  8390 raft_consensus.cc:2889] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.422690  8542 raft_consensus.cc:2468] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:32.423857  8461 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 8.
I20260709 13:03:32.251386  8358 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
W20260709 13:03:32.493217  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 241933us
I20260709 13:03:32.494273 13300 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:32.596657  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 62000.6us
W20260709 13:03:32.620514 13350 log.cc:927] Time spent T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:03:32.664803  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 132799us
W20260709 13:03:32.708243 13352 log.cc:927] Time spent T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:03:32.712422 12912 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:32.722687  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:32.774675  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 107936us
I20260709 13:03:32.749697 13336 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:32.780720 13336 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.811959 13336 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.793176 13300 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:32.888191 13300 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:32.862025 13365 consensus_queue.cc:1048] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:03:32.925982  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 203398us
W20260709 13:03:32.944629  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 88593.3us
I20260709 13:03:32.967151  8393 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:03:32.960314  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 167160us
W20260709 13:03:32.955713  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 169966us
I20260709 13:03:32.966645  9068 raft_consensus.cc:1217] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:03:32.988400  8466 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:33.003005  8393 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:33.004833  8540 raft_consensus.cc:1275] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:33.007205  8393 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:33.011355  8535 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:33.025758  8463 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:33.032430 13377 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:33.034693 13377 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:33.060974  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 45382.6us
I20260709 13:03:33.079337  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:33.058071 13366 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:03:33.093756 13336 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:33.109705 13311 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:33.118784  8465 raft_consensus.cc:1240] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:33.119354 13353 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.119872 13353 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:33.125444 13199 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:33.122066 13353 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:33.136775 13336 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:33.143433  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:33.145282  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 76812us
I20260709 13:03:33.179126 13365 consensus_queue.cc:1059] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:33.180647 13365 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:33.181015 13365 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:33.181841 13365 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:33.183208 13365 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:33.184237 13367 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:03:33.186728  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 190172us
I20260709 13:03:33.199342  8290 catalog_manager.cc:5697] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.207101  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:33.211755  8290 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 9 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 10 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:33.228250  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:33.262197 13369 consensus_queue.cc:1048] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:33.264745  8540 raft_consensus.cc:2410] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:33.296574  8290 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50098 (request call id 114) took 1323 ms. Trace:
I20260709 13:03:33.297127  8290 rpcz_store.cc:276] 0709 13:03:31.972814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.972974 (+   160us) service_pool.cc:224] Handling call
0709 13:03:33.296504 (+1323530us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:33.240985 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:33.241543 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:33.241587 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:03:33.241603 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:33.242067 (+   464us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:33.242145 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:33.242171 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:33.242487 (+   316us) tablet.cc:701] Row locks acquired
0709 13:03:33.242503 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:03:33.242641 (+   138us) write_op.cc:270] Start()
0709 13:03:33.242747 (+   106us) write_op.cc:276] Timestamp: P: 1783602213242596 usec, L: 0
0709 13:03:33.242768 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:33.243530 (+   762us) log.cc:844] Serialized 913 byte log entry
0709 13:03:33.275109 (+ 31579us) op_driver.cc:464] REPLICATION: finished
0709 13:03:33.275871 (+   762us) write_op.cc:301] APPLY: starting
0709 13:03:33.275984 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:33.277665 (+  1681us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:33.277825 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:33.279501 (+  1676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:33.279701 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:03:33.279774 (+    73us) write_op.cc:312] APPLY: finished
0709 13:03:33.280036 (+   262us) log.cc:844] Serialized 33 byte log entry
0709 13:03:33.280274 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.280390 (+   116us) write_op.cc:454] Released schema lock
0709 13:03:33.280445 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:33.280901 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.280941 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86974,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":488,"apply.run_cpu_time_us":4977,"apply.run_wall_time_us":4977,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8380,"num_ops":2,"prepare.queue_time_us":24922,"prepare.run_cpu_time_us":2887,"prepare.run_wall_time_us":34002,"replication_time_us":32179,"thread_start_us":29324,"threads_started":1}]]}
I20260709 13:03:33.319643  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:33.320312  8463 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 11.
I20260709 13:03:33.326696  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:33.327765 13359 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:33.330945  8288 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50744 (request call id 243) took 8369 ms. Trace:
I20260709 13:03:33.362669  8288 rpcz_store.cc:276] 0709 13:03:24.961415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.967312 (+  5897us) service_pool.cc:224] Handling call
0709 13:03:33.330871 (+8363559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:32.108170 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:32.113842 (+  5672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:32.113881 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:03:32.113900 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:32.114718 (+   818us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:32.114780 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:32.114816 (+    36us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:32.115436 (+   620us) tablet.cc:701] Row locks acquired
0709 13:03:32.115457 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:03:32.115614 (+   157us) write_op.cc:270] Start()
0709 13:03:32.115756 (+   142us) write_op.cc:276] Timestamp: P: 1783602212115567 usec, L: 0
0709 13:03:32.117988 (+  2232us) op_driver.cc:348] REPLICATION: starting
0709 13:03:32.139350 (+ 21362us) log.cc:844] Serialized 2079 byte log entry
0709 13:03:32.745910 (+606560us) op_driver.cc:464] REPLICATION: finished
0709 13:03:32.963689 (+217779us) write_op.cc:301] APPLY: starting
0709 13:03:32.968979 (+  5290us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:33.000609 (+ 31630us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:33.000701 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:33.082408 (+ 81707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:33.082589 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:03:33.082637 (+    48us) write_op.cc:312] APPLY: finished
0709 13:03:33.082867 (+   230us) log.cc:844] Serialized 57 byte log entry
0709 13:03:33.083032 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.083143 (+   111us) write_op.cc:454] Released schema lock
0709 13:03:33.083215 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:33.083544 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.083571 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4665,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":205801,"apply.run_cpu_time_us":8309,"apply.run_wall_time_us":129288,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25077,"num_ops":5,"prepare.queue_time_us":95673,"prepare.run_cpu_time_us":3975,"prepare.run_wall_time_us":40464,"replication_time_us":627720,"thread_start_us":244304,"threads_started":2}]]}
I20260709 13:03:33.380519  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:33.382666 13300 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:33.383100 13300 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.383471 13300 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.403142 13199 raft_consensus.cc:1064] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:03:33.406685 13199 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:33.331799  8289 catalog_manager.cc:5697] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 12, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 12 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.421132  8289 catalog_manager.cc:5697] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.424072 13300 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:33.444274  8468 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:33.445550  9060 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 11 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:33.449100  8390 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:33.460668 12987 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:33.462738 13197 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:33.422999  8289 catalog_manager.cc:5697] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 12 to 14, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 14 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:33.477950 13344 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:03:33.478811  8289 catalog_manager.cc:5697] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.488346  8289 catalog_manager.cc:5697] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 14, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 14 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.490067  8289 catalog_manager.cc:5697] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 15 to 16, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 16 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.491820  8289 catalog_manager.cc:5697] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 8 to 9, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.494338  8289 catalog_manager.cc:5697] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 13 to 14, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 14 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.519942  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:33.520776  8467 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.522411  8289 catalog_manager.cc:5697] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.531332 13042 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:33.524084  8289 catalog_manager.cc:5697] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:33.537565  8289 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 11 to 12, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 12 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.546542  8465 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:33.553930  8467 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:33.555552  8359 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:33.555719  8289 catalog_manager.cc:5697] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 8 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.563201 12789 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:33.563829 12789 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:33.563447  8289 catalog_manager.cc:5697] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 11 to 13, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 13 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } }
I20260709 13:03:33.564680 12789 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:33.571781  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:33.572494  8543 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.573323 13300 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:33.569767  8289 catalog_manager.cc:5697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:33.579389  8289 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:33.585530  8289 catalog_manager.cc:5697] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:33.586889  8289 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:33.559839 13356 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:03:33.594141  8289 catalog_manager.cc:5697] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 7 to 8, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:33.603111  8289 catalog_manager.cc:5697] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.606256  8289 catalog_manager.cc:5697] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:33.611167  8543 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:33.656153  8543 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:33.657404 12789 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:33.656418  8386 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:33.592032  9060 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:33.663282  8468 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:33.730544  8292 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 17 to 18, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 18 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.752677  8289 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50742 (request call id 224) took 3058 ms. Trace:
I20260709 13:03:33.753098  8289 rpcz_store.cc:276] 0709 13:03:30.694812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.695006 (+   194us) service_pool.cc:224] Handling call
0709 13:03:33.752600 (+3057594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:33.643090 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:33.643676 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:33.643713 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:03:33.643729 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:33.645298 (+  1569us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:33.645357 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:33.645385 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:03:33.646917 (+  1532us) tablet.cc:701] Row locks acquired
0709 13:03:33.646940 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:03:33.647108 (+   168us) write_op.cc:270] Start()
0709 13:03:33.647233 (+   125us) write_op.cc:276] Timestamp: P: 1783602213647059 usec, L: 0
0709 13:03:33.647256 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:33.650993 (+  3737us) log.cc:844] Serialized 7907 byte log entry
0709 13:03:33.655055 (+  4062us) op_driver.cc:464] REPLICATION: finished
0709 13:03:33.655513 (+   458us) write_op.cc:301] APPLY: starting
0709 13:03:33.655589 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:33.696472 (+ 40883us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:33.696569 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:33.717968 (+ 21399us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:33.718280 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:03:33.718325 (+    45us) write_op.cc:312] APPLY: finished
0709 13:03:33.718972 (+   647us) log.cc:844] Serialized 180 byte log entry
0709 13:03:33.719809 (+   837us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.720071 (+   262us) write_op.cc:454] Released schema lock
0709 13:03:33.720165 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:33.720880 (+   715us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.720909 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":197630,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":26203,"apply.run_wall_time_us":65321,"cfile_cache_hit":80,"cfile_cache_hit_bytes":83800,"num_ops":20,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":5336,"prepare.run_wall_time_us":8251,"replication_time_us":7653}]]}
I20260709 13:03:33.850834  8293 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 12 to 14, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 14 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.864007  8293 catalog_manager.cc:5697] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 13 to 15, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 15 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:33.901578  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 124107us
I20260709 13:03:33.900213  8293 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 9 to 10, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 10 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.906035  9068 consensus_queue.cc:237] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:33.913419  8293 catalog_manager.cc:5697] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 10 to 13, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 13 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.935688  8543 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:33.936404  8390 raft_consensus.cc:1275] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:33.958560 13240 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:33.984287 13240 consensus_queue.cc:1048] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:33.990340  8292 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:34.013032  8467 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:34.013805 13403 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 11 to 13, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:34.014518  8386 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:34.017554  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50728 (request call id 250) took 2126 ms. Trace:
I20260709 13:03:34.018206  8542 raft_consensus.cc:2955] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:34.018018  8293 rpcz_store.cc:276] 0709 13:03:31.891733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.891878 (+   145us) service_pool.cc:224] Handling call
0709 13:03:34.017488 (+2125610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:33.931392 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:33.931910 (+   518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:33.931947 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:03:33.931959 (+    12us) tablet.cc:662] Decoding operations
0709 13:03:33.932549 (+   590us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:33.932603 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:33.932629 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:33.938425 (+  5796us) tablet.cc:701] Row locks acquired
0709 13:03:33.938444 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:03:33.938578 (+   134us) write_op.cc:270] Start()
0709 13:03:33.938698 (+   120us) write_op.cc:276] Timestamp: P: 1783602213938538 usec, L: 0
0709 13:03:33.938722 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:03:33.939337 (+   615us) log.cc:844] Serialized 1694 byte log entry
0709 13:03:33.941368 (+  2031us) op_driver.cc:464] REPLICATION: finished
0709 13:03:33.941767 (+   399us) write_op.cc:301] APPLY: starting
0709 13:03:33.941870 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:33.943980 (+  2110us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:33.944075 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:33.946323 (+  2248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:33.946481 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:03:33.946532 (+    51us) write_op.cc:312] APPLY: finished
0709 13:03:33.946766 (+   234us) log.cc:844] Serialized 49 byte log entry
0709 13:03:33.946942 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:33.947031 (+    89us) write_op.cc:454] Released schema lock
0709 13:03:33.947077 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:34.008292 (+ 61215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:34.008327 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":220,"apply.run_cpu_time_us":18975,"apply.run_wall_time_us":66488,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16760,"num_ops":4,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":2876,"prepare.run_wall_time_us":8208,"replication_time_us":2526,"spinlock_wait_cycles":5504}]]}
I20260709 13:03:34.014514 13268 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:03:34.043895  8289 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 14 to 15, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 15 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:34.046185  8289 catalog_manager.cc:5697] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 9 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.049113  8289 catalog_manager.cc:5697] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 13 to 14, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 14 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:34.050470  8289 catalog_manager.cc:5697] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 7 to 8, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 8 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:34.104223  8279 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48eb2b2d1e724640bdcade4f8baa0375 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:34.124049  8293 catalog_manager.cc:5697] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 11 to 13, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 18 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.170644  8542 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:34.177291 13353 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:34.200213  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet 48eb2b2d1e724640bdcade4f8baa0375 with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:47224
I20260709 13:03:34.245337 13409 tablet_replica.cc:333] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:34.249482 13409 raft_consensus.cc:2243] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.251379 13409 raft_consensus.cc:2272] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.270732  8289 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
I20260709 13:03:34.317516 13409 ts_tablet_manager.cc:1916] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:34.332296 13042 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.332872 13042 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:34.335150 13042 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:34.339047  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:34.339779  8468 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 15.
I20260709 13:03:34.340255  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" is_pre_election: true
I20260709 13:03:34.342321  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:34.353220 13344 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:34.353811 13344 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.354252 13344 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.367195  8292 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 10 to 14, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 14 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } }
W20260709 13:03:34.413549  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 105968us
I20260709 13:03:34.448908 13344 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:34.452927  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
I20260709 13:03:34.463209 13344 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:34.464244  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:34.464921  8465 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.482214  8542 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:34.489292  8465 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 16.
I20260709 13:03:34.490679  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:34.491535 13344 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:34.494221 13344 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 16 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:34.495095 13344 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:34.505658  9068 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:34.507361 13407 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:34.510327  8393 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:34.513304 13365 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:34.522497 13042 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:34.527412  8386 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:34.532409  9068 raft_consensus.cc:2955] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:34.535416  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f58095c0d8fc462d8edd0f9f658b3eac with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:34.536044  8289 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.594843  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:34.528468 13409 ts_tablet_manager.cc:1929] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:03:34.622323 13409 log.cc:1199] T 48eb2b2d1e724640bdcade4f8baa0375 P d2a645dcec4c479ba4c94d075b1bc98c: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/wals/48eb2b2d1e724640bdcade4f8baa0375
I20260709 13:03:34.596997  8289 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: config changed from index 10 to 11, VOTER d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) evicted. New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:34.688798 13268 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:34.689414 13268 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:34.697271 13268 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:34.698525  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:34.713851  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 65599us
I20260709 13:03:34.725992  8459 tablet_service.cc:1558] Processing DeleteTablet for tablet f58095c0d8fc462d8edd0f9f658b3eac with delete_type TABLET_DATA_TOMBSTONED (TS d2a645dcec4c479ba4c94d075b1bc98c not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:47224
I20260709 13:03:34.748755  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:34.749564  8465 raft_consensus.cc:2368] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16.
I20260709 13:03:34.753846  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet 48eb2b2d1e724640bdcade4f8baa0375 (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:03:34.755334 13409 tablet_replica.cc:333] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:34.756382 13409 raft_consensus.cc:2243] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.757711 13409 raft_consensus.cc:2272] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.767881 13409 ts_tablet_manager.cc:1916] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:34.777768  8359 leader_election.cc:400] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16.
I20260709 13:03:34.778209  8359 leader_election.cc:403] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:34.780045 13268 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.798767 13268 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851) with higher term. Message: Invalid argument: T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2122d8c723e84e3da22f81f7eeb4b1a9 for earlier term 15. Current term is 16.
I20260709 13:03:34.834098  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:34.835676  8536 raft_consensus.cc:606] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:34.871224  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:34.871995  8536 raft_consensus.cc:606] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 16 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:34.875157  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "448878eafac247d592f6889cb1e26a56"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
W20260709 13:03:34.875627  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 95532.5us
I20260709 13:03:34.875937  8536 raft_consensus.cc:606] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:34.894018 13409 ts_tablet_manager.cc:1929] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:03:34.894605 13409 log.cc:1199] T f58095c0d8fc462d8edd0f9f658b3eac P d2a645dcec4c479ba4c94d075b1bc98c: Deleting WAL directory at /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/wals/f58095c0d8fc462d8edd0f9f658b3eac
I20260709 13:03:34.895524  8542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:34.896275  8542 raft_consensus.cc:606] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:34.897929  8278 catalog_manager.cc:5028] TS d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): tablet f58095c0d8fc462d8edd0f9f658b3eac (table test-workload [id=b9a53fe66cca4a81aafc19796f4bc42f]) successfully deleted
I20260709 13:03:34.907091 13199 raft_consensus.cc:993] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:34.907847 13407 raft_consensus.cc:1081] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:34.915798  8536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
mode: GRACEFUL
new_leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:58578
I20260709 13:03:34.916553  8536 raft_consensus.cc:606] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Received request to transfer leadership to TS 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:34.918331  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:34.920344  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:34.920907  8386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:34.930414  8386 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:34.933403  8386 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:34.944393  8467 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:34.946558 13407 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:34.968164  8386 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:34.979844  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:34.980540  8465 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:34.986074  8386 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:34.987203  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:34.993332  8536 raft_consensus.cc:3055] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:34.993649  8536 raft_consensus.cc:740] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:34.994434  8536 consensus_queue.cc:260] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:34.995325  8536 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:34.987422  8465 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:34.992638 13042 raft_consensus.cc:993] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:34.999652  8468 raft_consensus.cc:1240] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Rejecting Update request from peer c45599d1dc3b4823b857cf77f276dc7b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:35.001685 13042 raft_consensus.cc:1081] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:34.992755  8390 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:35.005424  8390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "448878eafac247d592f6889cb1e26a56"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:35.006007  8390 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.006395  8390 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.007899  8536 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 9.
I20260709 13:03:35.007898 13042 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:35.009518  8358 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:35.011027 13268 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:35.011576 13268 raft_consensus.cc:697] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:35.012569 13268 consensus_queue.cc:237] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.025449  8390 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.030658  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:35.033200  8468 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.035104  8390 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:35.055337  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:35.055954  8536 raft_consensus.cc:3055] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:35.056236  8536 raft_consensus.cc:740] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:35.056949  8536 consensus_queue.cc:260] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.057601  8468 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:35.058233  8536 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.058766  8359 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:35.060552 13417 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:35.072926  8536 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 13.
I20260709 13:03:35.114769 13417 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:35.136003  8288 catalog_manager.cc:5697] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 8 to 9, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 9 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.136785 13417 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.150822 13407 raft_consensus.cc:993] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:35.151437 13407 raft_consensus.cc:1081] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 16 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:35.170706 13199 raft_consensus.cc:993] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:35.166116  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:35.171262 13199 raft_consensus.cc:1081] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:35.173830  8389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:35.174407  8389 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.174780  8389 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.185765  8389 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:35.189245  8389 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:35.189461  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:35.190188  8542 raft_consensus.cc:3055] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:03:35.186686  8360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 119052us
I20260709 13:03:35.190526  8542 raft_consensus.cc:740] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:35.194368  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:35.195079  9068 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.199079  8542 consensus_queue.cc:260] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:35.201952  8542 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.208269  9068 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:35.215226  8289 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 12 to 13, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 13 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.221457  8393 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.221975  8393 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.227895  8360 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4; no voters: 
I20260709 13:03:35.228962 13417 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:35.229547 13417 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:35.231166 13417 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:35.239132  8393 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.238760  8542 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:35.245687  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:35.246421  8468 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.250363  8288 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 11 to 12, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.251767  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:35.252400  8542 raft_consensus.cc:3055] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:35.252684  8542 raft_consensus.cc:740] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:35.253345  8393 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:35.253476  8468 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 17.
I20260709 13:03:35.254892  8359 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:35.256111 13417 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:35.256848 13417 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:35.257738 13417 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.261176  8542 consensus_queue.cc:260] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.262530  8542 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.272238  8542 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 17.
I20260709 13:03:35.282927  8288 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 16 to 17, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 17 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.346305 13042 raft_consensus.cc:993] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: : Instructing follower 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:35.346927 13042 raft_consensus.cc:1081] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Signalling peer 2122d8c723e84e3da22f81f7eeb4b1a9 to start an election
I20260709 13:03:35.348685  8388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe"
dest_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:03:35.349238  8388 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.349565  8388 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.373508  8388 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.375905  8388 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:35.376566  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:35.376959  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:35.377223  8463 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.377534  8536 raft_consensus.cc:3055] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:35.377871  8536 raft_consensus.cc:740] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:35.378659  8536 consensus_queue.cc:260] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.379725  8536 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.386339  8463 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:35.387012  8536 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2122d8c723e84e3da22f81f7eeb4b1a9 in term 12.
I20260709 13:03:35.387816  8359 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:35.388733 13417 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:35.389281 13417 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Becoming Leader. State: Replica: 2122d8c723e84e3da22f81f7eeb4b1a9, State: Running, Role: LEADER
I20260709 13:03:35.391157 13417 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:35.416952  8288 catalog_manager.cc:5697] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 reported cstate change: term changed from 11 to 12, leader changed from c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195) to 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193). New cstate: current_term: 12 leader_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.441385  8463 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:35.445744 13425 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:35.471808  8536 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:35.474475 13417 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:35.570436  8468 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:35.573310 13417 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:35.635972  8542 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:35.637586 13424 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:35.735649  9068 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:35.739315 13424 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:35.755484  8536 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:35.758013 13424 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:35.805313  8463 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:35.809402 13417 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:35.836375  8542 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:35.840742 13425 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:35.858278  8543 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:35.868570 13417 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:35.910317  8463 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer 2122d8c723e84e3da22f81f7eeb4b1a9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:35.914095 13417 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:35.921371  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:36.048883  8463 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:03:36.082479  8435 consensus_peers.cc:597] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36596de3826e4546a5476f7471fdbf37. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.082870  8542 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:36.084299  8388 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:36.086143 13401 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:36.087015 13369 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:36.118136  7283 tablet_server.cc:179] TabletServer@127.7.28.193:0 shutting down...
I20260709 13:03:36.138389 13401 raft_consensus.cc:2955] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:03:36.208504  9032 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.209081  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 72236.2us
I20260709 13:03:36.217731  8293 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index -1 to 10, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 12 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.232319  8542 raft_consensus.cc:2955] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:03:36.241263  9032 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.268204  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 95778.1us
I20260709 13:03:36.273906  8542 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:03:36.293455  9032 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.319708  8507 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.338155  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 96801.6us
W20260709 13:03:36.342478  8509 consensus_peers.cc:597] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0c4c676aa374fb6b2efb71a3de7e4bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.343066  8463 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:03:36.348317  8507 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.349116  8507 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.349921 13365 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:36.351184  8507 consensus_peers.cc:597] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.356667  8507 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.357450  8507 consensus_peers.cc:597] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.362129  8507 consensus_peers.cc:597] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.388497  8433 consensus_peers.cc:597] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.391168  8433 consensus_peers.cc:597] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.392349  8433 consensus_peers.cc:597] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.392925  8433 consensus_peers.cc:597] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.396121  9032 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.401139  8433 consensus_peers.cc:597] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.402616  8433 consensus_peers.cc:597] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.403270  8433 consensus_peers.cc:597] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.397270  9032 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.426433  8433 consensus_peers.cc:597] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.438930 13042 raft_consensus.cc:2955] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:36.443342  8463 raft_consensus.cc:2955] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:03:36.552394  8433 consensus_peers.cc:597] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.576048  8289 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index -1 to 9, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
W20260709 13:03:36.612406  9032 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.614809  9032 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.618745  9032 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.648747  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 139844us
W20260709 13:03:36.648962  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 161052us
W20260709 13:03:36.698479  8341 auto_rebalancer.cc:629] Failed to schedule move for tablet 1bb4baf572744c749edb167ac631aabe: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:36.706488  8507 consensus_peers.cc:597] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.735742  8544 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
W20260709 13:03:36.770787  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 45689.2us
W20260709 13:03:36.773376  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 77237.8us
W20260709 13:03:36.791378  8507 consensus_peers.cc:597] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.819562  8507 consensus_peers.cc:597] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.844410  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 57037.4us
I20260709 13:03:36.917779  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:36.928128  7283 tablet_replica.cc:333] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:36.929153  7283 raft_consensus.cc:2243] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.929906  7283 raft_consensus.cc:2272] T c257a516245f4698b8937b228b23d23a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.933049  7283 tablet_replica.cc:333] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:36.934319  7283 raft_consensus.cc:2243] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.967175  7283 raft_consensus.cc:2272] T b79a5acddc004781bbeac307ae4e58d1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:36.980782  8358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 128394us
W20260709 13:03:37.015161  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 192735us
W20260709 13:03:37.016736  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 169482us
W20260709 13:03:37.095074  8509 consensus_peers.cc:597] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855): Couldn't send request to peer 92314b14f5554885a80c3dc87f4beed4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad98149b9fc3438b96dcbd03688e8bb1. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.125634  8507 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 46 similar messages]
W20260709 13:03:37.126516  8507 consensus_peers.cc:597] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.127058  8507 consensus_peers.cc:597] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.137810 13481 ts_tablet_manager.cc:933] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:37.164014 13499 ts_tablet_manager.cc:933] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.190814  7283 tablet_replica.cc:333] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
W20260709 13:03:37.203810  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 138021us
W20260709 13:03:37.223397  8433 consensus_peers.cc:597] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.224506  8433 consensus_peers.cc:597] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.190837  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 165419us
I20260709 13:03:37.237926 13424 raft_consensus.cc:493] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
W20260709 13:03:37.206216  9032 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.206666  8507 consensus_peers.cc:597] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.281200  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 75381.1us
W20260709 13:03:37.285730  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 60376.9us
I20260709 13:03:37.290746  7283 raft_consensus.cc:2243] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:37.287674  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 160146us
I20260709 13:03:37.244800 13417 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.308650 13499 tablet_copy_client.cc:323] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:03:37.240124 13424 raft_consensus.cc:515] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:37.327310  8507 consensus_peers.cc:597] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.329725  8433 consensus_peers.cc:597] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.329936  8507 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.331734  8433 consensus_peers.cc:597] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.333148  8433 consensus_peers.cc:597] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.333480 13417 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.344676 13466 raft_consensus.cc:493] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.345640 13466 raft_consensus.cc:515] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.351507 13494 raft_consensus.cc:493] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:37.355536 13490 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.356624 13490 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.357438 13495 raft_consensus.cc:493] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.358521 13495 raft_consensus.cc:515] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.359731 13466 leader_election.cc:290] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.365113  7283 raft_consensus.cc:2272] T 7219cc411cf6498f8f250f689007874f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:37.368117 13424 leader_election.cc:290] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.372361 13417 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.352818 13494 raft_consensus.cc:515] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.391637 13494 leader_election.cc:290] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.393035 13490 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.403910 13481 tablet_copy_client.cc:323] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.194:32851
I20260709 13:03:37.410116 13495 leader_election.cc:290] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.416352  8480 tablet_copy_service.cc:140] P d2a645dcec4c479ba4c94d075b1bc98c: Received BeginTabletCopySession request for tablet 36596de3826e4546a5476f7471fdbf37 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:48784)
I20260709 13:03:37.417389  8480 tablet_copy_service.cc:161] P d2a645dcec4c479ba4c94d075b1bc98c: Beginning new tablet copy session on tablet 36596de3826e4546a5476f7471fdbf37 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:48784: session id = 92314b14f5554885a80c3dc87f4beed4-36596de3826e4546a5476f7471fdbf37
I20260709 13:03:37.417214  8467 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:37.418752  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.420599  7283 tablet_replica.cc:333] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
W20260709 13:03:37.387547  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 49796.5us
I20260709 13:03:37.424127  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.426435  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.429625 13458 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.430493 13458 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.435597 13458 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.441545  7283 raft_consensus.cc:2243] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:37.450033 13494 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.450841 13494 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.456046 13424 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.456895 13424 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.466566  7283 raft_consensus.cc:2272] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:37.467157  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 125724us
I20260709 13:03:37.469135 13424 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.473414  7283 tablet_replica.cc:333] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:37.474164 13424 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.475471  7283 raft_consensus.cc:2243] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:37.476821  7283 raft_consensus.cc:2272] T 16a45e4473e5464880e36c3f7edc9b4e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:37.475116 13424 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.476979 13507 raft_consensus.cc:493] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:37.478334 13510 raft_consensus.cc:493] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.480862 13510 raft_consensus.cc:515] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.480840 13507 raft_consensus.cc:515] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.483975 13507 leader_election.cc:290] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.484050 13510 leader_election.cc:290] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.492601 13424 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.477391 13466 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.497928 13494 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.498890  8480 tablet_copy_source_session.cc:215] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:37.515164 13481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36596de3826e4546a5476f7471fdbf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.529765 13454 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:37.543753 13507 raft_consensus.cc:493] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.544555 13507 raft_consensus.cc:515] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.547070 13507 leader_election.cc:290] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.549587 13494 raft_consensus.cc:493] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:37.550287 13424 raft_consensus.cc:493] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:37.550431 13494 raft_consensus.cc:515] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.551090 13424 raft_consensus.cc:515] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.539994 13466 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.555730 13417 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.558583  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.559444 13417 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.560010  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.560853 13424 leader_election.cc:290] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.562395  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.561535  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278b4d554f0647ff885c963daff7931d" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.567852  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.556803  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e345f8303cfb4ede8a2072d0adb8061a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.571314 13424 raft_consensus.cc:493] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.576561  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.574916  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.573277  8536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.580698  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668db691226f4f9884a460b2a17f021c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.580881  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.578174 13510 raft_consensus.cc:493] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.578351 13424 raft_consensus.cc:515] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.582129 13510 raft_consensus.cc:515] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.584908 13510 leader_election.cc:290] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.592418 13510 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.593106 13510 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:37.593988 13424 leader_election.cc:290] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.595109  7283 tablet_replica.cc:333] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:37.596112 13510 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.597374  7283 raft_consensus.cc:2243] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:37.602514  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c4c676aa374fb6b2efb71a3de7e4bd" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.606290 13494 leader_election.cc:290] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.606449  8553 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet c0c4c676aa374fb6b2efb71a3de7e4bd from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:03:37.607154  8553 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet c0c4c676aa374fb6b2efb71a3de7e4bd from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-c0c4c676aa374fb6b2efb71a3de7e4bd
I20260709 13:03:37.598484  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.613845 13466 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.616989  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f3b02e50814949b04f7440340f941f" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.618009 13494 raft_consensus.cc:493] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:37.618108 13458 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.622543 13458 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.593667 13417 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.625236 13458 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.628928  9065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8845af07904ef3b3861c0999f3cd1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.630542  9066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48eb2b2d1e724640bdcade4f8baa0375" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.631781  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.632438 13510 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.632078 13494 raft_consensus.cc:515] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.633462  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30077f266a34706854bc7e6a95ad805" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.634335  9063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e26f5f342c48648f0433b885576c00" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.635340  9067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.636313  9069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.637030  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6de9f8d6e504e40b0a5e555abe5c0c0" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.637971 13507 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.638159  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4395bd6ec2454867a133e2c678bcd570" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.638521 13495 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.650779 13496 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.651082 13495 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.651429 13496 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.652405  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.653280 13495 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.650792 13507 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.654237  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.632336  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595c51b9ae043699167a92b109f328e" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.639199 13490 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:37.639495  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687c062d8bc14ccabafd4083b9bbf0e7" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.640165  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2dbc87d7bb4fd1a21aae4da276631c" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.649717 13487 raft_consensus.cc:493] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.650048  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.650319  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.644006 13424 raft_consensus.cc:493] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.661887  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.665447  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.654963 13494 leader_election.cc:290] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.667886 13512 ts_tablet_manager.cc:933] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.653607 13496 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.660228 13490 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.680919 13453 raft_consensus.cc:493] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.675967  8360 leader_election.cc:304] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:37.684226  7283 pending_rounds.cc:70] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Trying to abort 1 pending ops.
I20260709 13:03:37.689810 13453 raft_consensus.cc:515] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.662899 13487 raft_consensus.cc:515] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.676420 13507 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.666774 13424 raft_consensus.cc:515] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.700749 13507 raft_consensus.cc:2749] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.682426 13458 raft_consensus.cc:493] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.682739 13510 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.699810 13495 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:37.713959 13458 raft_consensus.cc:515] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:37.695290 13496 raft_consensus.cc:493] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:37.714039 13495 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.722559 13496 raft_consensus.cc:515] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.713022 13507 raft_consensus.cc:493] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92314b14f5554885a80c3dc87f4beed4)
I20260709 13:03:37.724721 13495 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.724807 13496 leader_election.cc:290] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.725349 13507 raft_consensus.cc:515] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:37.726342 13490 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.727335 13453 leader_election.cc:290] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.727818 13507 leader_election.cc:290] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:37.728052  8553 tablet_copy_source_session.cc:215] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:37.729023 13487 leader_election.cc:290] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.731366 13458 leader_election.cc:290] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.735199  8359 leader_election.cc:304] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.739387 13487 raft_consensus.cc:2749] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:37.741518  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1ecd689cb746dd9dd2359f106c7bac" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.742216  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bdd97906c140e29b99343177f05dc2" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.742786  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a9e66431b042b89cf88391ec860de6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.743606  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcd5c10366d45e5ab1c8562d806d037" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.744057  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.745179  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e60e73cf17e48a2998c2d82eafcb1e3" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.746752  8359 leader_election.cc:304] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.748692  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.751010  8359 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.752246 13458 raft_consensus.cc:2749] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:37.752655  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.755173  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.757665  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.758852 13458 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:37.760212  8359 leader_election.cc:304] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.761114 13510 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.761214  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad98149b9fc3438b96dcbd03688e8bb1" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.761893  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd965dafa3a4024b05decfd805a2903" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.762606  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.758889  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d76276a90a4f889ff8e98f46e90227" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.767058 13458 raft_consensus.cc:2749] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.767864  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b5930e207e40d28682b42cd831b68a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.687929  7283 pending_rounds.cc:77] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: Aborting op as it isn't in flight: id { term: 12 index: 10 } timestamp: 7305634676930809856 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "36596de3826e4546a5476f7471fdbf37" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } } new_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } } }
I20260709 13:03:37.774452  7283 raft_consensus.cc:2917] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Aborting config change with OpId 12.10: Aborted: Op aborted
I20260709 13:03:37.774902  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded976982870447482c4b84286e6340b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.775141  7283 raft_consensus.cc:2889] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:03:37.776202  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.776640  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbf8012591a4011b3ae6451802bb12a" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:37.778189  8507 consensus_peers.cc:597] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.778119  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.779053  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.780776  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2321e967e3f4695a2563f5d8dacc658" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.783603  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bf07df55b74bb7a74bd894b869faef" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.775640  7283 raft_consensus.cc:2272] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:37.792773  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.794569  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.794474  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.796824  8359 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.798177  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:37.800850 13512 tablet_copy_client.cc:323] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Beginning tablet copy session from remote peer at address 127.7.28.195:40791
I20260709 13:03:37.802977 13484 raft_consensus.cc:2955] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:37.811030  8358 leader_election.cc:304] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
W20260709 13:03:37.812484  8359 raft_consensus.cc:2686] T c0c4c676aa374fb6b2efb71a3de7e4bd P 2122d8c723e84e3da22f81f7eeb4b1a9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:37.816039  8359 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.817725  8359 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.818904 13507 raft_consensus.cc:2749] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:37.819401  8358 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:37.820256 13507 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:37.819651  8464 raft_consensus.cc:2955] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:37.822937 13487 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:37.829358 13487 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.830240  8359 leader_election.cc:304] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.830487  8553 tablet_copy_service.cc:140] P c45599d1dc3b4823b857cf77f276dc7b: Received BeginTabletCopySession request for tablet ad98149b9fc3438b96dcbd03688e8bb1 from peer 92314b14f5554885a80c3dc87f4beed4 ({username='slave'} at 127.0.0.1:56998)
I20260709 13:03:37.835908  8359 leader_election.cc:304] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.837508  8359 leader_election.cc:304] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.839145  8553 tablet_copy_service.cc:161] P c45599d1dc3b4823b857cf77f276dc7b: Beginning new tablet copy session on tablet ad98149b9fc3438b96dcbd03688e8bb1 from peer 92314b14f5554885a80c3dc87f4beed4 at {username='slave'} at 127.0.0.1:56998: session id = 92314b14f5554885a80c3dc87f4beed4-ad98149b9fc3438b96dcbd03688e8bb1
I20260709 13:03:37.842975 13499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c4c676aa374fb6b2efb71a3de7e4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.846864 13458 raft_consensus.cc:2749] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.838233 13507 raft_consensus.cc:2749] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:37.858263 13424 leader_election.cc:290] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:37.859036 13453 raft_consensus.cc:2749] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:37.865094  8359 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.868337  8359 leader_election.cc:304] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.869877  8359 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.871228 13510 raft_consensus.cc:2749] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.883841 13510 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.885347  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:37.886857 13481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58892 (request call id 355) took 1041 ms. Trace:
I20260709 13:03:37.887475 13481 rpcz_store.cc:276] 0709 13:03:36.845336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.845470 (+   134us) service_pool.cc:224] Handling call
0709 13:03:37.144063 (+298593us) ts_tablet_manager.cc:934] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: Initiating tablet copy from peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
0709 13:03:37.512972 (+368909us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:37.585641 (+ 72669us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:37.585777 (+   136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:37.811768 (+225991us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:37.837908 (+ 26140us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:37.886656 (+ 48748us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:37.886780 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":448,"tablet-copy.queue_time_us":143188,"thread_start_us":385643,"threads_started":2}
I20260709 13:03:37.883220  8359 leader_election.cc:304] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.892135  8359 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.895728  8359 leader_election.cc:304] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.883347 13424 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:37.897178 13458 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:37.903753 13453 raft_consensus.cc:2749] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:37.904642  8359 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.893633 13487 raft_consensus.cc:2749] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:37.905169  7283 tablet_replica.cc:333] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:37.909343  8359 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:37.912015  8359 raft_consensus.cc:2686] T 36596de3826e4546a5476f7471fdbf37 P 2122d8c723e84e3da22f81f7eeb4b1a9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:37.915867  8359 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.917074 13424 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.911507 13466 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:37.919080  8359 leader_election.cc:304] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.920285  8359 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.910728 13481 tablet_copy_client.cc:806] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:37.921646 13481 tablet_copy_client.cc:670] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:37.921973 13466 raft_consensus.cc:2749] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.926630 13481 tablet_copy_client.cc:538] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:37.933970  8359 leader_election.cc:304] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.936910 13466 raft_consensus.cc:2749] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:37.937383 13510 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:37.938867  7283 raft_consensus.cc:2243] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:37.939848  7283 raft_consensus.cc:2272] T a9bdd97906c140e29b99343177f05dc2 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:37.947398  7283 tablet_replica.cc:333] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:37.948665  7283 raft_consensus.cc:2243] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:37.949370  7283 raft_consensus.cc:2272] T 9cd965dafa3a4024b05decfd805a2903 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:37.945063  8289 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index -1 to 11, NON_VOTER 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) added. New cstate: current_term: 15 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } } }
I20260709 13:03:37.972750 13484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36702 (request call id 6) took 1243 ms. Trace:
I20260709 13:03:37.973344 13484 rpcz_store.cc:276] 0709 13:03:36.729457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.732599 (+  3142us) service_pool.cc:224] Handling call
0709 13:03:36.785696 (+ 53097us) log.cc:844] Serialized 499 byte log entry
0709 13:03:37.291170 (+505474us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b54004b08a0. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe13450571 00007fbe13460142 00007fbe13440eaa 00007fbe13447d53 00007fbe13447cd9 00007fbe13447c69 00007fbe13447c31 00007fbe13446dfd 000000000038f354 000000000038f199 00007fbe103fa475
0709 13:03:37.972651 (+681481us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":17607,"mutex_wait_us":16675,"raft.queue_time_us":24926,"raft.run_cpu_time_us":16601,"raft.run_wall_time_us":499061,"spinlock_wait_cycles":7845632,"thread_start_us":176907,"threads_started":2,"wal-append.queue_time_us":36760,"wal-append.run_cpu_time_us":1714,"wal-append.run_wall_time_us":1002073}
I20260709 13:03:37.980227  8553 tablet_copy_source_session.cc:215] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:37.963783  7283 tablet_replica.cc:333] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:37.989018  8359 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.989951  7283 raft_consensus.cc:2243] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:37.990108  8359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 54562.7us
I20260709 13:03:37.990453 13424 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.990777  7283 raft_consensus.cc:2272] T e4e26f5f342c48648f0433b885576c00 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:37.990935  8359 leader_election.cc:304] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.991815 13510 raft_consensus.cc:2749] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:37.992244  8359 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:37.993844 13510 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:37.994643  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ce611680844f5b9bbe7f4813048f1b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.995253  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6226d3e14545daa1ff24f4a0384182" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:37.996639 13512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad98149b9fc3438b96dcbd03688e8bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.998140  7283 tablet_replica.cc:333] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:37.999342  7283 raft_consensus.cc:2243] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.000504  7283 raft_consensus.cc:2272] T dc7cbb87d4de484e83c3b5c2d4674239 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.003806  7283 tablet_replica.cc:333] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.005239  7283 raft_consensus.cc:2243] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.005990  7283 raft_consensus.cc:2272] T 04d76276a90a4f889ff8e98f46e90227 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.016175  7283 tablet_replica.cc:333] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.017581  7283 raft_consensus.cc:2243] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.019742  7283 raft_consensus.cc:2272] T 55bf07df55b74bb7a74bd894b869faef P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.022835  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0e47b92cf24b70b2ddbf9bafbadc3b" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:38.024621  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0cfe6c1fd994d86a76a6c9fa9428fd6" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:38.025449  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dd397b27604d3c902569919fcf6a04" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:38.027078  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e460bf5e53b8462ebab2155c88820c11" candidate_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:38.029418  7283 tablet_replica.cc:333] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:37.995507 13481 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:03:38.031859  7283 raft_consensus.cc:2243] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.032698  7283 raft_consensus.cc:2272] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.036427  7283 tablet_replica.cc:333] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.037487  7283 raft_consensus.cc:2243] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.038573  7283 raft_consensus.cc:2272] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.041963  7283 tablet_replica.cc:333] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.042917  7283 raft_consensus.cc:2243] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.043787  7283 raft_consensus.cc:2272] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.050810 13499 tablet_copy_client.cc:806] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:38.051574 13499 tablet_copy_client.cc:670] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:38.059654  8359 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:38.061131 13507 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:38.061972  7283 tablet_replica.cc:333] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.062429  8359 leader_election.cc:304] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:38.062930  7283 raft_consensus.cc:2243] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.063777  7283 raft_consensus.cc:2272] T 5c2dbc87d7bb4fd1a21aae4da276631c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.067029  7283 tablet_replica.cc:333] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.068032  7283 raft_consensus.cc:2243] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.068687  7283 raft_consensus.cc:2272] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:38.063141  8359 raft_consensus.cc:2686] T 8b6226d3e14545daa1ff24f4a0384182 P 2122d8c723e84e3da22f81f7eeb4b1a9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:38.071451  8359 leader_election.cc:304] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:38.073462  8359 raft_consensus.cc:2686] T bb0e47b92cf24b70b2ddbf9bafbadc3b P 2122d8c723e84e3da22f81f7eeb4b1a9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:38.075569 13499 tablet_copy_client.cc:538] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:38.074901  8359 leader_election.cc:304] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:38.077725  8359 raft_consensus.cc:2686] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P 2122d8c723e84e3da22f81f7eeb4b1a9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:38.078711  8359 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:38.095754  7283 tablet_replica.cc:333] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.097005 13512 tablet_copy_client.cc:806] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:38.105894 13499 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:03:38.111197 13466 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:38.113721  8359 leader_election.cc:304] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2122d8c723e84e3da22f81f7eeb4b1a9; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:38.116815 13466 raft_consensus.cc:2749] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:38.114988  7283 raft_consensus.cc:2243] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.115722 13512 tablet_copy_client.cc:670] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:38.122380 13512 tablet_copy_client.cc:538] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:38.139058  7283 raft_consensus.cc:2272] T 4395bd6ec2454867a133e2c678bcd570 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.164347  7283 tablet_replica.cc:333] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.172398  7283 raft_consensus.cc:2243] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.180984  7283 raft_consensus.cc:2272] T d2321e967e3f4695a2563f5d8dacc658 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.167999 13512 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap starting.
I20260709 13:03:38.186002  7283 tablet_replica.cc:333] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.191069  7283 raft_consensus.cc:2243] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.191991  7283 raft_consensus.cc:2272] T a30077f266a34706854bc7e6a95ad805 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.199055  7283 tablet_replica.cc:333] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.202773  7283 raft_consensus.cc:2243] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.203655  7283 raft_consensus.cc:2272] T ad98149b9fc3438b96dcbd03688e8bb1 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.207130  7283 tablet_replica.cc:333] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.212471  7283 raft_consensus.cc:2243] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.222232  7283 raft_consensus.cc:2272] T a8ce611680844f5b9bbe7f4813048f1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.270887  7283 tablet_replica.cc:333] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.285398  7283 raft_consensus.cc:2243] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.292484  7283 raft_consensus.cc:2272] T 1ddb6b18052644bcb64034fd9deee9ea P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.337534 13481 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.338575 13481 tablet_bootstrap.cc:492] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:03:38.339332 13481 ts_tablet_manager.cc:1403] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.344s	user 0.043s	sys 0.006s
I20260709 13:03:38.341454  7283 tablet_replica.cc:333] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.343182  7283 raft_consensus.cc:2243] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.344349  7283 raft_consensus.cc:2272] T 448878eafac247d592f6889cb1e26a56 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.349320  7283 tablet_replica.cc:333] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.350370  7283 raft_consensus.cc:2243] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.356809 13481 raft_consensus.cc:359] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:38.357844 13481 raft_consensus.cc:740] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:03:38.358575 13481 consensus_queue.cc:260] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:38.361315 13481 ts_tablet_manager.cc:1434] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 13:03:38.365554  7283 raft_consensus.cc:2272] T 412c0e548a4d4e3f90555631b28d234b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.375456  7283 tablet_replica.cc:333] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.376426  7283 raft_consensus.cc:2243] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.385627  7283 raft_consensus.cc:2272] T 01bec3d6263846f6bc87510cf2213e1e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.387331  8480 tablet_copy_service.cc:342] P d2a645dcec4c479ba4c94d075b1bc98c: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-36596de3826e4546a5476f7471fdbf37 received from {username='slave'} at 127.0.0.1:48784
I20260709 13:03:38.387917  8480 tablet_copy_service.cc:434] P d2a645dcec4c479ba4c94d075b1bc98c: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-36596de3826e4546a5476f7471fdbf37 on tablet 36596de3826e4546a5476f7471fdbf37 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:38.398874 13512 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.401589 13499 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:38.410287  7283 tablet_replica.cc:333] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.413973 13499 tablet_bootstrap.cc:492] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:03:38.414973 13499 ts_tablet_manager.cc:1403] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.309s	user 0.035s	sys 0.009s
I20260709 13:03:38.414052  7283 raft_consensus.cc:2243] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.421496 13512 tablet_bootstrap.cc:492] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: Bootstrap complete.
I20260709 13:03:38.421370 13499 raft_consensus.cc:359] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:38.422432 13499 raft_consensus.cc:740] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:03:38.423189 13512 ts_tablet_manager.cc:1403] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: Time spent bootstrapping tablet: real 0.255s	user 0.039s	sys 0.009s
I20260709 13:03:38.423273 13499 consensus_queue.cc:260] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:38.430166  7283 raft_consensus.cc:2272] T 278b4d554f0647ff885c963daff7931d P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.437889 13512 raft_consensus.cc:359] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:38.442651 13512 raft_consensus.cc:740] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Initialized, Role: LEARNER
I20260709 13:03:38.443607 13512 consensus_queue.cc:260] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: NON_VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: true } }
I20260709 13:03:38.459882 13499 ts_tablet_manager.cc:1434] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:03:38.464385  8553 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-c0c4c676aa374fb6b2efb71a3de7e4bd received from {username='slave'} at 127.0.0.1:56998
I20260709 13:03:38.464936  8553 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-c0c4c676aa374fb6b2efb71a3de7e4bd on tablet c0c4c676aa374fb6b2efb71a3de7e4bd with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:38.467626  7283 tablet_replica.cc:333] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.468593  7283 raft_consensus.cc:2243] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.469302  7283 raft_consensus.cc:2272] T 21a9e66431b042b89cf88391ec860de6 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.471745 13512 ts_tablet_manager.cc:1434] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:03:38.476397  8553 tablet_copy_service.cc:342] P c45599d1dc3b4823b857cf77f276dc7b: Request end of tablet copy session 92314b14f5554885a80c3dc87f4beed4-ad98149b9fc3438b96dcbd03688e8bb1 received from {username='slave'} at 127.0.0.1:56998
I20260709 13:03:38.476893  8553 tablet_copy_service.cc:434] P c45599d1dc3b4823b857cf77f276dc7b: ending tablet copy session 92314b14f5554885a80c3dc87f4beed4-ad98149b9fc3438b96dcbd03688e8bb1 on tablet ad98149b9fc3438b96dcbd03688e8bb1 with peer 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:38.494436  7283 tablet_replica.cc:333] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.495466  7283 raft_consensus.cc:2243] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.497080  7283 raft_consensus.cc:2272] T 89b5930e207e40d28682b42cd831b68a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.507390  7283 tablet_replica.cc:333] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.512257  9064 raft_consensus.cc:1217] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:03:38.530573  7283 raft_consensus.cc:2243] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.533212  7283 raft_consensus.cc:2272] T 1bb4baf572744c749edb167ac631aabe P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.548072  7283 tablet_replica.cc:333] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.549264  7283 raft_consensus.cc:2243] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.550621  7283 raft_consensus.cc:2272] T 157886d313c14dff8294260f4377baf4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.553701  7283 tablet_replica.cc:333] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.554574  7283 raft_consensus.cc:2243] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.559859  7283 raft_consensus.cc:2272] T 687c062d8bc14ccabafd4083b9bbf0e7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.574577  7283 tablet_replica.cc:333] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.575573  7283 raft_consensus.cc:2243] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.576490  7283 raft_consensus.cc:2272] T ded976982870447482c4b84286e6340b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.602860  7283 tablet_replica.cc:333] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.604024  7283 raft_consensus.cc:2243] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.604887  7283 raft_consensus.cc:2272] T e345f8303cfb4ede8a2072d0adb8061a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.621987  7283 tablet_replica.cc:333] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.622865  7283 raft_consensus.cc:2243] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.623976  7283 raft_consensus.cc:2272] T 48eb2b2d1e724640bdcade4f8baa0375 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.635425  7283 tablet_replica.cc:333] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.636343  7283 raft_consensus.cc:2243] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.644728  9064 raft_consensus.cc:1217] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:03:38.646588  7283 raft_consensus.cc:2272] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.652474  7283 tablet_replica.cc:333] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.653868  7283 raft_consensus.cc:2243] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.654682  7283 raft_consensus.cc:2272] T 9a8845af07904ef3b3861c0999f3cd1b P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.678834  7283 tablet_replica.cc:333] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.679687  7283 raft_consensus.cc:2243] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.690434  7283 raft_consensus.cc:2272] T e460bf5e53b8462ebab2155c88820c11 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.712416  9064 raft_consensus.cc:1217] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:03:38.723785  7283 tablet_replica.cc:333] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.724677  7283 raft_consensus.cc:2243] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.734427  7283 raft_consensus.cc:2272] T 6595c51b9ae043699167a92b109f328e P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.746856  7283 tablet_replica.cc:333] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.747655  7283 raft_consensus.cc:2243] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.748353  7283 raft_consensus.cc:2272] T 1e1ecd689cb746dd9dd2359f106c7bac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.751322  7283 tablet_replica.cc:333] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.752166  7283 raft_consensus.cc:2243] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.753374  7283 raft_consensus.cc:2272] T ef4deccb7c274fec97786db5d6131514 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:38.778904  8507 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.782172  7283 tablet_replica.cc:333] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.797410  7283 raft_consensus.cc:2243] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.798161  7283 raft_consensus.cc:2272] T dbbf8012591a4011b3ae6451802bb12a P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:38.800546  8433 consensus_peers.cc:597] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.807971  7283 tablet_replica.cc:333] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.808986  7283 raft_consensus.cc:2243] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.809743  7283 raft_consensus.cc:2272] T 668db691226f4f9884a460b2a17f021c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.830338  7283 tablet_replica.cc:333] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.831931  7283 raft_consensus.cc:2243] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.833882  7283 raft_consensus.cc:2272] T cefa63b714fc469d8c98138fb7dd26f4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:38.834995  8433 consensus_peers.cc:597] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.838769  7283 tablet_replica.cc:333] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.839699  7283 raft_consensus.cc:2243] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.840309  7283 raft_consensus.cc:2272] T 2e60e73cf17e48a2998c2d82eafcb1e3 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.856633  7283 tablet_replica.cc:333] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.857538  7283 raft_consensus.cc:2243] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.858880  7283 raft_consensus.cc:2272] T 7051c4976daf4ac580117a5b9ecb8de4 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.862345  7283 tablet_replica.cc:333] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.863603  7283 raft_consensus.cc:2243] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.864876  7283 raft_consensus.cc:2272] T 0c10e3a2e1f044a0a1a78740e279800c P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.872839  7283 tablet_replica.cc:333] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.873668  7283 raft_consensus.cc:2243] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.874336  7283 raft_consensus.cc:2272] T c8f3b02e50814949b04f7440340f941f P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.877777  7283 tablet_replica.cc:333] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.878787  7283 raft_consensus.cc:2243] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.880260  7283 raft_consensus.cc:2272] T f58095c0d8fc462d8edd0f9f658b3eac P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.888335  7283 tablet_replica.cc:333] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.889153  7283 raft_consensus.cc:2243] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.889904  7283 raft_consensus.cc:2272] T 00dd397b27604d3c902569919fcf6a04 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.899915  7283 tablet_replica.cc:333] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.901188  7283 raft_consensus.cc:2243] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:38.911020  7283 raft_consensus.cc:2272] T 936de44ff6404ac7b9d585ab45c933f9 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.914294  7283 tablet_replica.cc:333] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9: stopping tablet replica
I20260709 13:03:38.915095  7283 raft_consensus.cc:2243] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:38.916007  7283 raft_consensus.cc:2272] T 6fcd5c10366d45e5ab1c8562d806d037 P 2122d8c723e84e3da22f81f7eeb4b1a9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:38.931919 13454 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:38.932543 13454 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:38.958528 13454 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:38.968498  8507 leader_election.cc:336] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:38.959663  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:38.970523  8508 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:38.972523 13365 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:38.977268 13484 raft_consensus.cc:1064] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:03:38.980490 13484 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:39.023985  9064 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:39.034395  8468 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:39.062273 13365 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:39.074332  9032 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.082597 13527 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:39.118644  9032 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.129179 13464 raft_consensus.cc:1064] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:03:39.132432 13464 consensus_queue.cc:237] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:39.168731  8433 consensus_peers.cc:597] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.179828  8433 consensus_peers.cc:597] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.186636  8433 consensus_peers.cc:597] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.202185  9068 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:39.211918 13474 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:39.223875  8540 raft_consensus.cc:1275] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:39.230516 13527 raft_consensus.cc:2955] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.236374 13474 consensus_queue.cc:1048] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:39.239884 13484 raft_consensus.cc:1064] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: attempting to promote NON_VOTER 92314b14f5554885a80c3dc87f4beed4 to VOTER
I20260709 13:03:39.252753 13484 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:39.259382  9064 raft_consensus.cc:2955] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:39.296696  9032 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.298794  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 49137.5us
W20260709 13:03:39.300007  8507 connection.cc:769] client connection to 127.7.28.193:35967 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:03:39.303670  8466 raft_consensus.cc:2955] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:39.331032  9032 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.337942 13527 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.338622 13527 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:39.341595  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 54799.7us
I20260709 13:03:39.342199  8462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:39.342724  8433 connection.cc:769] client connection to 127.7.28.193:35967 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:03:39.343060 13527 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:39.351155  8293 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 11 to 12, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.356899 13536 raft_consensus.cc:2955] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.380434  9068 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEARNER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:39.382175  9064 raft_consensus.cc:2955] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.396306  8462 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:39.399245 13528 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:03:39.400542  8507 consensus_peers.cc:597] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.401119  8507 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.401959  8507 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.402438  8507 consensus_peers.cc:597] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:39.410998 13484 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:39.430549  8507 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.431113  8507 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:39.432192  8507 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.433969 13525 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:39.448649 13484 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.449246 13484 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.452363  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:39.454063 13484 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:39.448817  9032 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.462133  8507 consensus_peers.cc:597] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:39.464193  8507 consensus_peers.cc:597] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.475665  8433 consensus_peers.cc:597] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.476210  8433 consensus_peers.cc:597] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.476651  8433 consensus_peers.cc:597] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:39.477327  8433 consensus_peers.cc:597] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.477880  8433 consensus_peers.cc:597] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.484877  8540 raft_consensus.cc:2955] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:39.488943  8433 consensus_peers.cc:597] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.489671  8507 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.490518  8507 leader_election.cc:336] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.491562  8507 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:39.492332 13484 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:39.497821  8433 consensus_peers.cc:597] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.529976 13536 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.530604 13536 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.532325 13535 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.532914 13536 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.533082 13535 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.536190 13535 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.538463  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:39.539074  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:39.539721  8544 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
W20260709 13:03:39.542208  8507 consensus_peers.cc:597] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.548008 13528 raft_consensus.cc:2955] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.549345  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:39.550227 13535 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:39.550668 13535 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.551064 13535 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.551388  8466 raft_consensus.cc:2955] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:39.559433  8433 leader_election.cc:336] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.560573  8433 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:39.561226 13484 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.561892 13484 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.562474 13536 raft_consensus.cc:2749] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.564281 13484 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:39.565286  8433 leader_election.cc:336] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.567978  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:39.568612  8464 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 17.
I20260709 13:03:39.570374  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:39.571240 13525 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:39.571624 13525 raft_consensus.cc:493] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.571976 13525 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:39.572746  9032 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.572741  8507 leader_election.cc:336] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.577979 13536 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.578517 13536 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.582000 13536 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.588371  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:39.589135  8544 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 15.
I20260709 13:03:39.597400 13535 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.609647  8544 consensus_queue.cc:237] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:39.601684  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:39.615938  9068 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:39.616822 13536 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:39.617244 13536 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.617664 13536 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:39.618481 13484 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.618676 13535 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.619073 13484 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.623090 13527 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:39.626106  8433 consensus_peers.cc:597] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.626727  8433 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.628512  8466 raft_consensus.cc:1275] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:39.630038 13527 consensus_queue.cc:1048] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:39.633497 13529 raft_consensus.cc:2955] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.643831  9068 raft_consensus.cc:2955] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.601444 13525 raft_consensus.cc:515] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.604878  9064 raft_consensus.cc:2955] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.608633  8288 catalog_manager.cc:5697] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: config changed from index 10 to 11, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.656157  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7cbb87d4de484e83c3b5c2d4674239" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:39.656800  8540 raft_consensus.cc:3060] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.661758 13454 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.662550 13454 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.664848 13454 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:39.668761  8540 raft_consensus.cc:2468] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 15.
I20260709 13:03:39.671241 13484 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:39.672091 13536 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:39.672969  8433 leader_election.cc:336] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.675489  8289 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 9 to 10, 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.685492  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:39.687717 13525 leader_election.cc:290] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 18 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:39.688845  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:39.689492  8464 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 8.
W20260709 13:03:39.690872  8507 leader_election.cc:336] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.686659 13536 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.693497  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ddb6b18052644bcb64034fd9deee9ea" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:39.693631  8433 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:39.695469  8464 raft_consensus.cc:3060] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.695982 13535 raft_consensus.cc:2804] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:39.696520 13535 raft_consensus.cc:697] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:39.697077  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c0e548a4d4e3f90555631b28d234b" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:39.697674  8544 raft_consensus.cc:3060] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:39.697377 13535 consensus_queue.cc:237] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:39.694942  8507 leader_election.cc:336] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.701951  8507 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:39.706817 13454 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:39.712217  8508 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:39.713774  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad98149b9fc3438b96dcbd03688e8bb1 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:39.715322 13528 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:39.715816 13528 raft_consensus.cc:493] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.716220 13528 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:39.720729  8544 raft_consensus.cc:2468] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 16.
W20260709 13:03:39.727476  8507 leader_election.cc:336] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:39.728765  8433 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.730968  8289 catalog_manager.cc:5697] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: config changed from index 12 to 13, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 15 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.741355  8433 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:39.745163 13535 raft_consensus.cc:2804] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:39.745713 13535 raft_consensus.cc:697] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:39.746670 13535 consensus_queue.cc:237] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.748436  8464 raft_consensus.cc:2468] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 18.
W20260709 13:03:39.759572  9032 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.749738  8544 consensus_queue.cc:237] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:39.767076  8507 consensus_peers.cc:597] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.760375  8508 leader_election.cc:304] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:39.769616 13528 raft_consensus.cc:515] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.770210 13529 raft_consensus.cc:2804] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:39.771130 13529 raft_consensus.cc:697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 18 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:39.771828 13528 leader_election.cc:290] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:39.772096 13529 consensus_queue.cc:237] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.759207  8464 raft_consensus.cc:2955] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.778332  8288 catalog_manager.cc:5697] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 14 to 15, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 15 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.781453  9068 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:39.783304 13525 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:39.786852  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157886d313c14dff8294260f4377baf4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:39.787532  8466 raft_consensus.cc:3060] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:39.793030 13536 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.793694 13536 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.795302 13454 raft_consensus.cc:2955] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
W20260709 13:03:39.802443  8507 consensus_peers.cc:597] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.808804 13536 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.814744  9068 raft_consensus.cc:2955] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.818346  8468 raft_consensus.cc:1275] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:39.822758 13527 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.831882 13527 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.834395 13527 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:39.823776  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:39.835151  8544 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:39.837337  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:39.839592 13454 consensus_queue.cc:1048] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:39.845214  8466 raft_consensus.cc:2468] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 9.
W20260709 13:03:39.848958  8277 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 48673.4us
I20260709 13:03:39.850088 13536 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.850740 13536 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.852643  8277 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c0c4c676aa374fb6b2efb71a3de7e4bd with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:39.852921 13536 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:39.853585  8277 catalog_manager.cc:4755] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ad98149b9fc3438b96dcbd03688e8bb1: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.853740  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:39.854560 13536 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:39.854971 13536 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.855310 13536 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:39.860788 13535 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.861424 13535 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:39.862064  8433 leader_election.cc:336] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:39.862833  8433 consensus_peers.cc:597] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.863580 13535 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.847395  8508 leader_election.cc:304] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:39.868619  8507 leader_election.cc:336] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:39.869660  8507 consensus_peers.cc:597] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.870916  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:39.871534 13527 raft_consensus.cc:2804] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:39.871670  8544 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 15.
I20260709 13:03:39.872174 13527 raft_consensus.cc:697] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:39.877411  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:39.878412  9032 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.877806  8466 raft_consensus.cc:2955] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.861775 13536 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.882170 13536 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.873123 13527 consensus_queue.cc:237] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.884039  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:39.887773 13533 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:39.888156 13533 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.888499 13533 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:39.890151  8507 consensus_peers.cc:597] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.891390  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448878eafac247d592f6889cb1e26a56" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
W20260709 13:03:39.893379  8433 leader_election.cc:336] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.894115  8544 raft_consensus.cc:3060] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:39.894541  8433 leader_election.cc:336] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:39.894623  8507 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.895043  8433 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:39.895164  8507 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:39.895972 13523 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.895879 13535 raft_consensus.cc:2749] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:39.896602 13523 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:39.899164 13523 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.900559  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:39.895960 13528 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:39.901449  8433 leader_election.cc:336] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.903857  8544 raft_consensus.cc:2468] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:39.905050  8433 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:39.913257 13535 raft_consensus.cc:2804] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:39.913826 13535 raft_consensus.cc:697] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:39.914855 13535 consensus_queue.cc:237] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:39.915678  9032 leader_election.cc:336] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:39.916162  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:39.917826 13460 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:39.910156  8293 catalog_manager.cc:5697] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 15 to 16, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 16 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.910769  8288 catalog_manager.cc:5697] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: config changed from index 10 to 11, VOTER 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) evicted. New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } } }
I20260709 13:03:39.911479 13536 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.959509 13527 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.960083 13527 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.959933 13536 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:39.962108 13533 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:39.965504  8507 consensus_peers.cc:597] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.966709 13533 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:39.963862 13536 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:39.967550  9032 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:39.987476 13529 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:39.988090 13529 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:39.990311 13529 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:39.992002  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:39.999612 13527 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:40.000653  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:40.001324  8466 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:40.002552  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:40.003934 13527 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:40.004329 13527 raft_consensus.cc:493] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.004799 13527 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.006349  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:40.008397  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01bec3d6263846f6bc87510cf2213e1e" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:40.009083  8535 raft_consensus.cc:3060] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.014009 13529 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.014606 13529 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:40.016741 13529 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:40.020496  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:40.019994  8289 catalog_manager.cc:5697] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 17 to 18, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 18 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.026973 13460 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.027607 13460 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.029860 13460 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:40.033377  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:40.034129  8543 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 12.
W20260709 13:03:40.037058  9032 leader_election.cc:336] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.038630  9032 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:40.039799 13460 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:40.040299 13460 raft_consensus.cc:493] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.040684 13460 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.045641 13527 raft_consensus.cc:515] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.047514  8535 raft_consensus.cc:2468] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 16.
I20260709 13:03:40.049069 13525 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.049737 13525 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.052074 13525 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:40.053136  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
W20260709 13:03:40.053378  8507 leader_election.cc:336] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.053880  8468 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
W20260709 13:03:40.054292  8507 leader_election.cc:336] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.054797  8507 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, 92314b14f5554885a80c3dc87f4beed4
I20260709 13:03:40.055176  8508 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:40.058414 13460 raft_consensus.cc:515] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.064231 13529 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:40.068943 13529 raft_consensus.cc:493] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.069377 13529 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:40.071230  8507 leader_election.cc:336] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.071805  8507 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:40.062124 13528 raft_consensus.cc:2749] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:40.074502 13528 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:40.077577  8507 leader_election.cc:336] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.084502  8540 raft_consensus.cc:2393] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2a645dcec4c479ba4c94d075b1bc98c in current term 13: Already voted for candidate c45599d1dc3b4823b857cf77f276dc7b in this term.
I20260709 13:03:40.094794  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb4baf572744c749edb167ac631aabe" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:40.095402  8468 raft_consensus.cc:3060] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.087105 13529 raft_consensus.cc:515] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.100961 13529 leader_election.cc:290] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:40.102434  9032 leader_election.cc:336] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.084529  8433 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:40.118645  8433 leader_election.cc:336] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:40.119505  8433 leader_election.cc:336] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.105425  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d5b84b382e4f0caa0dbe8c50c7cfc7" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:40.121160 13460 leader_election.cc:290] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:40.121438  8464 raft_consensus.cc:3060] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.127885 13554 raft_consensus.cc:2804] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:40.128500 13554 raft_consensus.cc:697] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:40.129398 13554 consensus_queue.cc:237] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.093704 13527 leader_election.cc:290] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:40.106009 13484 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.135251 13484 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.137476 13484 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:40.139024  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58095c0d8fc462d8edd0f9f658b3eac" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:40.139784  8540 raft_consensus.cc:3060] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.140314  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:40.140939  9068 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 10.
I20260709 13:03:40.141718  8433 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:40.144366  8464 raft_consensus.cc:2468] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:40.108389  8468 raft_consensus.cc:2468] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
W20260709 13:03:40.132827  8507 leader_election.cc:336] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.106230  8293 catalog_manager.cc:5697] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 8 to 9, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 9 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.146731  8509 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:40.147321 13535 raft_consensus.cc:2749] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:40.165443 13484 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:40.165892 13484 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.166283 13484 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:40.148052  8508 leader_election.cc:304] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:40.152051 13533 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.169458 13527 raft_consensus.cc:2804] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:40.169899  8535 raft_consensus.cc:1275] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:40.170166 13527 raft_consensus.cc:697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:40.171322 13527 consensus_queue.cc:237] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.167748 13533 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.171727 13535 consensus_queue.cc:1048] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:40.177881 13533 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:40.160733  8540 raft_consensus.cc:2468] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 13.
I20260709 13:03:40.185158 13484 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.187556 13484 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:40.179262  8289 catalog_manager.cc:5697] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 13 to 14, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 14 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:40.192015  9068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4deccb7c274fec97786db5d6131514" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:40.192625  9068 raft_consensus.cc:3060] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:40.195449  8508 leader_election.cc:304] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:40.198649  9032 leader_election.cc:304] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:40.200582 13523 raft_consensus.cc:2804] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:40.200430  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:40.201078 13523 raft_consensus.cc:697] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 13 LEADER]: Becoming Leader. State: Replica: 92314b14f5554885a80c3dc87f4beed4, State: Running, Role: LEADER
I20260709 13:03:40.201246  8540 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 9.
I20260709 13:03:40.204748 13527 raft_consensus.cc:2804] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:40.205428 13527 raft_consensus.cc:697] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
W20260709 13:03:40.205713  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 72919us
W20260709 13:03:40.206326  8507 leader_election.cc:336] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.206503 13527 consensus_queue.cc:237] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.206971 13535 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.207607 13535 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.209380  9068 raft_consensus.cc:2468] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
W20260709 13:03:40.210295  8433 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.213595  8509 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:40.211089 13535 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:40.202075 13523 consensus_queue.cc:237] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.216710 13529 raft_consensus.cc:2804] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:40.217237 13529 raft_consensus.cc:697] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:40.218221 13529 consensus_queue.cc:237] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.219174  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:40.222893 13533 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:40.223322 13533 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.223707 13533 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:40.228929  8433 leader_election.cc:336] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.232127  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:40.234824 13535 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.235510 13535 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:40.237648 13535 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:40.238785  8433 consensus_peers.cc:597] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.244835  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:40.245626  8540 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 13.
I20260709 13:03:40.250752  8433 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:40.252703 13535 raft_consensus.cc:2749] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:40.255347 13533 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.258162 13533 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:40.248363  8289 catalog_manager.cc:5697] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 15 to 16, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 16 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:40.259217  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
I20260709 13:03:40.259997 13554 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:40.260419 13554 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.260978 13554 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.260584  8293 catalog_manager.cc:5697] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 reported cstate change: term changed from 12 to 13, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196). New cstate: current_term: 13 leader_uuid: "92314b14f5554885a80c3dc87f4beed4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.273083 13558 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.274153  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefa63b714fc469d8c98138fb7dd26f4" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:40.274780  8535 raft_consensus.cc:3060] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:40.277455  8433 leader_election.cc:336] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.273708 13558 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.282796 13558 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:40.283198  8433 consensus_peers.cc:597] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.286201 13554 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:40.288424 13554 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:40.283700  8433 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.291196  8535 raft_consensus.cc:2468] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 10.
I20260709 13:03:40.295671  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c10e3a2e1f044a0a1a78740e279800c" candidate_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b"
I20260709 13:03:40.296969  8535 raft_consensus.cc:3060] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:40.296334  9032 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.299530  8433 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:40.301929 13533 raft_consensus.cc:2804] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:40.302455 13533 raft_consensus.cc:697] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:40.303367 13533 consensus_queue.cc:237] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:40.311122  8433 leader_election.cc:336] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.316232  8543 raft_consensus.cc:1275] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:40.317665 13484 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.318110 13536 consensus_queue.cc:1048] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:40.325124  8466 raft_consensus.cc:1275] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:40.324312  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:40.318295 13484 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.326964 13529 consensus_queue.cc:1048] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:03:40.340360  9032 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:40.342532 13523 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:40.347791  7283 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8416)
W20260709 13:03:40.351084  8507 leader_election.cc:336] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.354537  8543 raft_consensus.cc:1275] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:40.358603 13536 consensus_queue.cc:1048] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:40.359817 13484 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:40.360805  8507 leader_election.cc:336] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.364717  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" is_pre_election: true
I20260709 13:03:40.365612  8464 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
W20260709 13:03:40.379070  8507 consensus_peers.cc:597] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.373266  8535 raft_consensus.cc:2468] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a645dcec4c479ba4c94d075b1bc98c in term 14.
I20260709 13:03:40.387313 13454 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.407706 13454 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.432546 13454 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:40.448585  8289 catalog_manager.cc:5697] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 12 to 13, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 13 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.451252  8289 catalog_manager.cc:5697] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 12 to 13, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 13 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.368865  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 
W20260709 13:03:40.470541  8507 leader_election.cc:336] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:40.478238  8507 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.478291 13484 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:40.478888 13484 raft_consensus.cc:493] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
W20260709 13:03:40.479091  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 110342us
I20260709 13:03:40.479403 13484 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.484692  8468 raft_consensus.cc:1275] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:40.491343 13454 consensus_queue.cc:1048] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:40.517869  8289 catalog_manager.cc:5697] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 10 to 11, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 11 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:40.527473  8507 consensus_peers.cc:597] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.534741 13484 raft_consensus.cc:515] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:40.537073 13484 leader_election.cc:290] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:40.540304  8433 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:40.541314 13536 raft_consensus.cc:2804] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:40.541890 13536 raft_consensus.cc:697] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Becoming Leader. State: Replica: d2a645dcec4c479ba4c94d075b1bc98c, State: Running, Role: LEADER
I20260709 13:03:40.542881 13536 consensus_queue.cc:237] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:40.547472  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7051c4976daf4ac580117a5b9ecb8de4" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d2a645dcec4c479ba4c94d075b1bc98c"
I20260709 13:03:40.548154  8466 raft_consensus.cc:3060] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.554783  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:40.555485  9064 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 11.
I20260709 13:03:40.556747  8293 catalog_manager.cc:5697] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 9 to 10, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 10 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:40.562579  8507 leader_election.cc:336] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:40.566666  8433 consensus_peers.cc:597] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.580418  8466 raft_consensus.cc:2468] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:40.583283  8508 leader_election.cc:304] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:40.588600  8509 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9
I20260709 13:03:40.603173 13528 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:40.603701 13528 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2122d8c723e84e3da22f81f7eeb4b1a9)
I20260709 13:03:40.604125 13528 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:40.629613  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 54152.2us
I20260709 13:03:40.642776 13484 raft_consensus.cc:2804] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:40.643465 13484 raft_consensus.cc:697] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:40.644480 13484 consensus_queue.cc:237] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:40.648895  8508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 65713.6us
I20260709 13:03:40.671943  8288 catalog_manager.cc:5697] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c reported cstate change: term changed from 13 to 14, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194). New cstate: current_term: 14 leader_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.681156 13528 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.709419 13528 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Requested vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:40.715145  8288 catalog_manager.cc:5697] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 12 to 13, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 13 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.722616  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936de44ff6404ac7b9d585ab45c933f9" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:40.723338  9064 raft_consensus.cc:3060] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:40.730695  8540 raft_consensus.cc:1275] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Refusing update from remote peer 92314b14f5554885a80c3dc87f4beed4: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:03:40.732968  9064 raft_consensus.cc:2468] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 12.
I20260709 13:03:40.734742  8509 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:40.742575  8536 raft_consensus.cc:1275] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:40.747684  8464 raft_consensus.cc:1275] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:40.753554 13528 raft_consensus.cc:2804] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:40.754158 13528 raft_consensus.cc:697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:40.755090 13528 consensus_queue.cc:237] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:40.763664 13454 consensus_queue.cc:1048] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:40.778390  8507 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:40.781215  8468 raft_consensus.cc:1275] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:40.783154 13484 consensus_queue.cc:1048] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:40.792147  9064 raft_consensus.cc:1275] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:03:40.802871  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 55364.4us
I20260709 13:03:40.797606 13570 consensus_queue.cc:1048] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:03:40.809907 13535 consensus_queue.cc:1048] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:40.814766  8536 raft_consensus.cc:1275] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:40.825696 13535 consensus_queue.cc:1048] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:40.802084 13558 consensus_queue.cc:1048] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 13:03:40.828706  9032 consensus_peers.cc:597] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.828351  8288 catalog_manager.cc:5697] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 11 to 12, leader changed from 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 12 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:40.881574  8433 consensus_peers.cc:597] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.948129  8433 consensus_peers.cc:597] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.045382 13585 log.cc:927] Time spent T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:03:41.091625  8507 consensus_peers.cc:597] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.093101  8507 consensus_peers.cc:597] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.093580  8507 consensus_peers.cc:597] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.127302  8433 consensus_peers.cc:597] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:41.132797  8543 raft_consensus.cc:1275] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Refusing update from remote peer d2a645dcec4c479ba4c94d075b1bc98c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:41.143606  8466 raft_consensus.cc:1275] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:03:41.146085  8277 catalog_manager.cc:4755] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ad98149b9fc3438b96dcbd03688e8bb1: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:41.147725 13570 consensus_queue.cc:1048] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:41.159436  8507 consensus_peers.cc:597] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:41.184907  9064 raft_consensus.cc:1275] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:41.188787 13595 consensus_queue.cc:1048] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:03:41.160660 13554 consensus_queue.cc:1048] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:03:41.258351  8435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:42855, user_credentials={real_user=slave}} blocked reactor thread for 69003.3us
W20260709 13:03:41.264914  8507 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.345024  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 44386.2us
W20260709 13:03:41.348313  7283 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8416)
W20260709 13:03:41.349367  8433 consensus_peers.cc:597] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.358736  8433 consensus_peers.cc:597] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.358572  8507 consensus_peers.cc:597] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.379001  9032 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.423841  8433 consensus_peers.cc:597] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.460086  9032 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.535971  8507 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.616462  8433 consensus_peers.cc:597] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.632579  8507 consensus_peers.cc:597] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.708316  9032 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.743114  8433 consensus_peers.cc:597] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.752939  9032 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.806069  8433 consensus_peers.cc:597] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.806607  8433 consensus_peers.cc:597] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.817830  9032 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.818280  8433 consensus_peers.cc:597] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.875460  8433 consensus_peers.cc:597] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.890743  8433 consensus_peers.cc:597] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.900048  8507 consensus_peers.cc:597] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.938038  8507 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.964968  8433 consensus_peers.cc:597] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.045853  8507 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.047472  8433 consensus_peers.cc:597] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:42.076457  8433 consensus_peers.cc:597] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.139780  8433 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111) [suppressed 459 similar messages]
W20260709 13:03:42.171900  9032 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.236126  8507 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.330796  8507 consensus_peers.cc:597] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.348798  7283 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8416)
W20260709 13:03:42.348544  8433 consensus_peers.cc:597] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.359638  8277 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 92509.3us
W20260709 13:03:42.361227  9032 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.363469  8277 catalog_manager.cc:4755] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ad98149b9fc3438b96dcbd03688e8bb1: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:42.386013  8507 consensus_peers.cc:597] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.532351  8507 consensus_peers.cc:597] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.546110  8433 consensus_peers.cc:597] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:42.574115  8507 consensus_peers.cc:597] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.576422  9032 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.597368  8507 consensus_peers.cc:597] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.677345  9032 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.677408  8507 consensus_peers.cc:597] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.691906  8433 consensus_peers.cc:597] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:42.710390  8507 consensus_peers.cc:597] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:42.822674  8507 consensus_peers.cc:597] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:42.988212  8507 consensus_peers.cc:597] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.127947  8433 consensus_peers.cc:597] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.230844  9032 consensus_peers.cc:597] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.287578  8433 consensus_peers.cc:597] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.320243  8507 consensus_peers.cc:597] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.328681  8433 consensus_peers.cc:597] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.349561  7283 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8416)
W20260709 13:03:43.548703  8507 consensus_peers.cc:597] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.600157  8507 consensus_peers.cc:597] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.700778  8433 consensus_peers.cc:597] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.782753  8507 consensus_peers.cc:597] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.803817  8433 consensus_peers.cc:597] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.840951  8433 consensus_peers.cc:597] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.026407  8433 consensus_peers.cc:597] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.033202  8433 consensus_peers.cc:597] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:44.046818  8433 consensus_peers.cc:597] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.063524  8507 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.087972  8507 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.106431  8433 consensus_peers.cc:597] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.248961  8507 consensus_peers.cc:597] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.272451  8507 consensus_peers.cc:597] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.310225  8433 consensus_peers.cc:597] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:44.340350  8433 consensus_peers.cc:597] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.350788  7283 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8416)
W20260709 13:03:44.361558  8433 consensus_peers.cc:597] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.401897  8433 consensus_peers.cc:597] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.424237  8507 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.478840  8433 consensus_peers.cc:597] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.497026  8433 consensus_peers.cc:597] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.515151  8507 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.548851  8433 consensus_peers.cc:597] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.551010  8277 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 55351.4us
W20260709 13:03:44.567885  8277 catalog_manager.cc:4755] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ad98149b9fc3438b96dcbd03688e8bb1: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:44.620076  9032 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.651144  9032 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.651981  9032 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.675340  9032 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.765491  8507 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.866967  8507 consensus_peers.cc:597] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.868067  8507 consensus_peers.cc:597] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.885231  8433 consensus_peers.cc:597] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.900655  9032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 46050.8us
W20260709 13:03:44.925041  8507 consensus_peers.cc:597] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.925526  9032 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.987896  8507 consensus_peers.cc:597] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.053172  8507 consensus_peers.cc:597] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.124832  8507 consensus_peers.cc:597] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.211366  8507 consensus_peers.cc:597] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.237016  8433 consensus_peers.cc:597] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.315104  9032 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.351387  7283 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8416)
W20260709 13:03:45.355808  8433 consensus_peers.cc:597] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.435587  8507 consensus_peers.cc:597] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.593381  8507 consensus_peers.cc:597] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.603613  9032 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.609776  8433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40791, user_credentials={real_user=slave}} blocked reactor thread for 76983.7us
W20260709 13:03:45.740244  9032 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.780838  8433 consensus_peers.cc:597] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.849817  9032 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.855033  8507 consensus_peers.cc:597] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.888041  8433 consensus_peers.cc:597] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:46.036511  8433 consensus_peers.cc:597] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:46.209900  8507 consensus_peers.cc:597] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:46.322026  8507 consensus_peers.cc:597] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:46.351898  7283 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8416)
W20260709 13:03:46.376077  8433 consensus_peers.cc:597] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.412065  8507 consensus_peers.cc:597] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:46.437830  8433 consensus_peers.cc:597] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.445322  9032 consensus_peers.cc:597] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:46.470438  8433 consensus_peers.cc:597] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.538967  8507 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.574059  8433 consensus_peers.cc:597] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.649528  8433 consensus_peers.cc:597] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:46.722935  8433 consensus_peers.cc:597] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:46.742937  8433 consensus_peers.cc:597] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.772223  8507 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.841554  8507 consensus_peers.cc:597] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.860291  8433 consensus_peers.cc:597] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.892830  8507 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.899899  8433 consensus_peers.cc:597] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.909514  8433 consensus_peers.cc:597] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.910250  8433 consensus_peers.cc:597] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.962275  8433 consensus_peers.cc:597] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.988555  8507 consensus_peers.cc:597] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.014489  9032 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.017706  8507 consensus_peers.cc:597] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.038019  9032 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.070510  8507 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.164942  8507 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111) [suppressed 486 similar messages]
W20260709 13:03:47.166320  8433 consensus_peers.cc:597] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.169091  8507 consensus_peers.cc:597] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.187441  8433 consensus_peers.cc:597] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.226105  9032 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.265113  8507 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.272918  9032 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.277971  8507 consensus_peers.cc:597] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.321913  9032 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.475504  8433 consensus_peers.cc:597] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:47.504802  7283 tablet_server.cc:196] TabletServer@127.7.28.193:0 shutdown complete.
W20260709 13:03:47.632092  8507 consensus_peers.cc:597] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.632782  8507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:35967, user_credentials={real_user=slave}} blocked reactor thread for 72755.1us
W20260709 13:03:47.668784  9033 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:32851, user_credentials={real_user=slave}} blocked reactor thread for 59611us
W20260709 13:03:47.689061  9032 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.693965  8507 consensus_peers.cc:597] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.684355  8433 consensus_peers.cc:597] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:47.762204  8507 consensus_peers.cc:597] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:47.864800  8507 consensus_peers.cc:597] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.918401  8507 consensus_peers.cc:597] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:48.072619  8433 consensus_peers.cc:597] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:48.148061  8507 consensus_peers.cc:597] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:48.169886  8507 consensus_peers.cc:597] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:48.174362  9032 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:48.268040  8433 consensus_peers.cc:597] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:48.289000  7283 tablet_server.cc:179] TabletServer@127.7.28.194:0 shutting down...
W20260709 13:03:48.304517  9032 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:48.308899  9033 consensus_peers.cc:597] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.321058  9033 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.340708  8508 consensus_peers.cc:597] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.345360  9033 consensus_peers.cc:597] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.350683  9032 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:48.371842  9033 consensus_peers.cc:597] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.375425  8508 consensus_peers.cc:597] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.379433  8508 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.407809  9033 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.426724  9033 consensus_peers.cc:597] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.436863  9033 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.484839  8433 consensus_peers.cc:597] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:48.508253  8508 consensus_peers.cc:597] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.518503  8508 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.520563  8508 consensus_peers.cc:597] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.522164  8508 consensus_peers.cc:597] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.532223  8508 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.539391  8508 consensus_peers.cc:597] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.549938  8508 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.559479  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:48.560853  7283 tablet_replica.cc:333] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.562119  7283 raft_consensus.cc:2243] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.563838  7283 raft_consensus.cc:2272] T c257a516245f4698b8937b228b23d23a P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.567335  7283 tablet_replica.cc:333] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.568382  7283 raft_consensus.cc:2243] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.570020  7283 raft_consensus.cc:2272] T 6becd976429a45a3874a10895b19b63e P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.573211  7283 tablet_replica.cc:333] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.574179  7283 raft_consensus.cc:2243] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.575857  7283 raft_consensus.cc:2272] T c0c4c676aa374fb6b2efb71a3de7e4bd P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.579056  7283 tablet_replica.cc:333] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.580250  7283 raft_consensus.cc:2243] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.581300  7283 raft_consensus.cc:2272] T 16a45e4473e5464880e36c3f7edc9b4e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.591895  8508 consensus_peers.cc:597] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.596341  7283 tablet_replica.cc:333] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.597561  7283 raft_consensus.cc:2243] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.598953  7283 raft_consensus.cc:2272] T 4395bd6ec2454867a133e2c678bcd570 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.602197  7283 tablet_replica.cc:333] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.603463  7283 raft_consensus.cc:2243] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.606655  7283 raft_consensus.cc:2272] T a9bdd97906c140e29b99343177f05dc2 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.606722  8433 consensus_peers.cc:597] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:48.608811  9033 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.610961  7283 tablet_replica.cc:333] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.614164  7283 raft_consensus.cc:2243] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.616909  7283 raft_consensus.cc:2272] T 448878eafac247d592f6889cb1e26a56 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.622112  7283 tablet_replica.cc:333] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.623152  7283 raft_consensus.cc:2243] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:48.631589  8508 consensus_peers.cc:597] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.636193  8508 consensus_peers.cc:597] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.647231  8507 consensus_peers.cc:597] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:48.644974  7283 raft_consensus.cc:2272] T e4e26f5f342c48648f0433b885576c00 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.650514  9033 consensus_peers.cc:597] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.651678  7283 tablet_replica.cc:333] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.652706  7283 raft_consensus.cc:2243] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.654013  7283 raft_consensus.cc:2272] T 9cd965dafa3a4024b05decfd805a2903 P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.657231  7283 tablet_replica.cc:333] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.658412  7283 raft_consensus.cc:2243] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.659157  7283 raft_consensus.cc:2272] T ac2457ce91f84cd3860bea5672ef0ab8 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.662348  7283 tablet_replica.cc:333] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.663537  7283 raft_consensus.cc:2243] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.664510  7283 raft_consensus.cc:2272] T 8b6226d3e14545daa1ff24f4a0384182 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.670781  7283 tablet_replica.cc:333] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.671774  7283 raft_consensus.cc:2243] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.672549  7283 raft_consensus.cc:2272] T bb0e47b92cf24b70b2ddbf9bafbadc3b P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.676188  7283 tablet_replica.cc:333] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.677120  7283 raft_consensus.cc:2243] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.678097  7283 raft_consensus.cc:2272] T 5c2dbc87d7bb4fd1a21aae4da276631c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.679345  9033 consensus_peers.cc:597] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.681402  7283 tablet_replica.cc:333] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.682778  7283 raft_consensus.cc:2243] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.684702  7283 raft_consensus.cc:2272] T dc7cbb87d4de484e83c3b5c2d4674239 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.688282  7283 tablet_replica.cc:333] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.689231  7283 raft_consensus.cc:2243] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.690208  7283 raft_consensus.cc:2272] T 04d76276a90a4f889ff8e98f46e90227 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.694013  7283 tablet_replica.cc:333] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.695298  7283 raft_consensus.cc:2243] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:48.712291  9033 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.726502  7283 raft_consensus.cc:2272] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.726552  8277 catalog_manager.cc:4755] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c0c4c676aa374fb6b2efb71a3de7e4bd: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:48.741878  7283 tablet_replica.cc:333] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.743148  7283 raft_consensus.cc:2243] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.743865  7283 raft_consensus.cc:2272] T c6de9f8d6e504e40b0a5e555abe5c0c0 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.746888  7283 tablet_replica.cc:333] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.747853  7283 raft_consensus.cc:2243] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.749357  7283 raft_consensus.cc:2272] T fdd8533706064dd78b4e61de0beb5255 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.755411  8508 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.756011  7283 tablet_replica.cc:333] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.756999  7283 raft_consensus.cc:2243] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.759023  7283 raft_consensus.cc:2272] T a30077f266a34706854bc7e6a95ad805 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.762035  7283 tablet_replica.cc:333] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.763012  7283 raft_consensus.cc:2243] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.765368  7283 raft_consensus.cc:2272] T 412c0e548a4d4e3f90555631b28d234b P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.768754  7283 tablet_replica.cc:333] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.769605  7283 raft_consensus.cc:2243] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.771126  7283 raft_consensus.cc:2272] T 01bec3d6263846f6bc87510cf2213e1e P d2a645dcec4c479ba4c94d075b1bc98c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.773960  7283 tablet_replica.cc:333] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.779099  7283 raft_consensus.cc:2243] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.782514  7283 raft_consensus.cc:2272] T 1ddb6b18052644bcb64034fd9deee9ea P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.785812  7283 tablet_replica.cc:333] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.786680  7283 raft_consensus.cc:2243] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.787935  7283 raft_consensus.cc:2272] T 58f1670d75c14f7588691908d7b2f1cf P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.791224  7283 tablet_replica.cc:333] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
W20260709 13:03:48.796861  8508 consensus_peers.cc:597] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.795184  7283 raft_consensus.cc:2243] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.798770  7283 raft_consensus.cc:2272] T ad98149b9fc3438b96dcbd03688e8bb1 P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.801913  8433 consensus_peers.cc:597] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.817173  8508 consensus_peers.cc:597] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:48.820140  8508 consensus_peers.cc:597] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.818655  7283 tablet_replica.cc:333] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.821496  7283 raft_consensus.cc:2243] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:03:48.854061  8508 consensus_peers.cc:597] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.844251  7283 raft_consensus.cc:2272] T a8ce611680844f5b9bbe7f4813048f1b P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.858803  8508 consensus_peers.cc:597] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.864562  7283 tablet_replica.cc:333] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.878070  7283 raft_consensus.cc:2243] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:48.867089  9032 consensus_peers.cc:597] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:48.888187  7283 raft_consensus.cc:2272] T 21a9e66431b042b89cf88391ec860de6 P d2a645dcec4c479ba4c94d075b1bc98c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.893942  7283 tablet_replica.cc:333] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.894922  7283 raft_consensus.cc:2243] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.898747  7283 raft_consensus.cc:2272] T 278b4d554f0647ff885c963daff7931d P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.901885  7283 tablet_replica.cc:333] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.911270  7283 raft_consensus.cc:2243] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.913341  7283 raft_consensus.cc:2272] T e460bf5e53b8462ebab2155c88820c11 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.920698  7283 tablet_replica.cc:333] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.921700  7283 raft_consensus.cc:2243] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:48.926709  7283 raft_consensus.cc:2272] T 9a8845af07904ef3b3861c0999f3cd1b P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:48.961812  7283 tablet_replica.cc:333] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:48.972028  7283 raft_consensus.cc:2243] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:48.972736  7283 raft_consensus.cc:2272] T e345f8303cfb4ede8a2072d0adb8061a P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:48.973619  8507 consensus_peers.cc:597] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:48.992296  7283 tablet_replica.cc:333] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.010221  7283 raft_consensus.cc:2243] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.014317  7283 raft_consensus.cc:2272] T 687c062d8bc14ccabafd4083b9bbf0e7 P d2a645dcec4c479ba4c94d075b1bc98c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:49.019793  8507 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:49.024217  7283 tablet_replica.cc:333] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.025174  7283 raft_consensus.cc:2243] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.025977  7283 raft_consensus.cc:2272] T ded976982870447482c4b84286e6340b P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.029723  7283 tablet_replica.cc:333] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.030597  7283 raft_consensus.cc:2243] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.031898  7283 raft_consensus.cc:2272] T 89b5930e207e40d28682b42cd831b68a P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.034901  7283 tablet_replica.cc:333] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.035735  7283 raft_consensus.cc:2243] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.036475  7283 raft_consensus.cc:2272] T dbbf8012591a4011b3ae6451802bb12a P d2a645dcec4c479ba4c94d075b1bc98c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.039125  7283 tablet_replica.cc:333] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.040020  7283 raft_consensus.cc:2243] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.041561  7283 raft_consensus.cc:2272] T 6595c51b9ae043699167a92b109f328e P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.044247  7283 tablet_replica.cc:333] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.045078  7283 raft_consensus.cc:2243] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.045763  7283 raft_consensus.cc:2272] T 1e1ecd689cb746dd9dd2359f106c7bac P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.048965  7283 tablet_replica.cc:333] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.049836  7283 raft_consensus.cc:2243] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.051119  7283 raft_consensus.cc:2272] T 6fcd5c10366d45e5ab1c8562d806d037 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.060854  7283 tablet_replica.cc:333] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.061846  7283 raft_consensus.cc:2243] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.065419  7283 raft_consensus.cc:2272] T c8f3b02e50814949b04f7440340f941f P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:49.071024  8507 consensus_peers.cc:597] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:49.078599  7283 tablet_replica.cc:333] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.079550  7283 raft_consensus.cc:2243] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.087230  7283 raft_consensus.cc:2272] T 36596de3826e4546a5476f7471fdbf37 P d2a645dcec4c479ba4c94d075b1bc98c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.099431  7283 tablet_replica.cc:333] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.100360  7283 raft_consensus.cc:2243] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.101415  7283 raft_consensus.cc:2272] T 1bb4baf572744c749edb167ac631aabe P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.108109  7283 tablet_replica.cc:333] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.114180  7283 raft_consensus.cc:2243] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.114948  7283 raft_consensus.cc:2272] T 157886d313c14dff8294260f4377baf4 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.118346  7283 tablet_replica.cc:333] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.119167  7283 raft_consensus.cc:2243] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.127013  7283 raft_consensus.cc:2272] T 13811dee93af4290bdcf7d73b527d0f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.130040  7283 tablet_replica.cc:333] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.130864  7283 raft_consensus.cc:2243] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.131552  7283 raft_consensus.cc:2272] T 668db691226f4f9884a460b2a17f021c P d2a645dcec4c479ba4c94d075b1bc98c [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:49.132411  8507 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:49.143484  7283 tablet_replica.cc:333] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.144544  7283 raft_consensus.cc:2243] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.146064  7283 raft_consensus.cc:2272] T cefa63b714fc469d8c98138fb7dd26f4 P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.152733  7283 tablet_replica.cc:333] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.154516  7283 raft_consensus.cc:2243] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.162454  7283 raft_consensus.cc:2272] T 3476b7ee17e048f38396353721fa682f P d2a645dcec4c479ba4c94d075b1bc98c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.165719  7283 tablet_replica.cc:333] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.166647  7283 raft_consensus.cc:2243] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.167995  7283 raft_consensus.cc:2272] T 00dd397b27604d3c902569919fcf6a04 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.172305  7283 tablet_replica.cc:333] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.173139  7283 raft_consensus.cc:2243] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.174075  7283 raft_consensus.cc:2272] T 0fcda97cc34546609f91a249f74d8f85 P d2a645dcec4c479ba4c94d075b1bc98c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.177234  7283 tablet_replica.cc:333] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.178107  7283 raft_consensus.cc:2243] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.179493  7283 raft_consensus.cc:2272] T 0c10e3a2e1f044a0a1a78740e279800c P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.182986  7283 tablet_replica.cc:333] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.183931  7283 raft_consensus.cc:2243] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:49.185277  7283 raft_consensus.cc:2272] T 2e60e73cf17e48a2998c2d82eafcb1e3 P d2a645dcec4c479ba4c94d075b1bc98c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.188153  7283 tablet_replica.cc:333] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.188993  7283 raft_consensus.cc:2243] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.198518  7283 raft_consensus.cc:2272] T 7051c4976daf4ac580117a5b9ecb8de4 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:49.202196  7283 tablet_replica.cc:333] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c: stopping tablet replica
I20260709 13:03:49.205505  7283 raft_consensus.cc:2243] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:49.206666  7283 raft_consensus.cc:2272] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P d2a645dcec4c479ba4c94d075b1bc98c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:49.227922  8507 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.332218  8507 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.509687  8507 consensus_peers.cc:597] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.520328  9032 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.542092  8507 consensus_peers.cc:597] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.542793  8507 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.565987  9032 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.605849  8507 consensus_peers.cc:597] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.607265  9032 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:49.762254 13640 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:49.762909 13640 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:49.780059  8507 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:49.784539  8508 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:49.786136  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:49.787889 13639 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:49.785598 13640 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:49.812136  9032 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.866849  8507 consensus_peers.cc:597] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:49.913762 13640 raft_consensus.cc:493] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:49.914326 13640 raft_consensus.cc:515] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:49.916378 13640 leader_election.cc:290] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:49.924489  8507 leader_election.cc:336] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:49.925011 13639 raft_consensus.cc:493] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:49.929878 13639 raft_consensus.cc:515] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:49.932057 13639 leader_election.cc:290] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:49.939930  8508 leader_election.cc:336] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:49.940505  8508 leader_election.cc:304] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:49.947582 13631 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:49.948163 13631 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:49.951632 13631 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:49.946973 13639 raft_consensus.cc:2749] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:49.959215  8507 leader_election.cc:336] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:49.961987  9032 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.961544  9033 leader_election.cc:336] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:49.963057  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
W20260709 13:03:49.974387  8508 leader_election.cc:336] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:49.976740  8508 leader_election.cc:304] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:49.981133  9032 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:49.982110 13631 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:49.982583 13639 raft_consensus.cc:2749] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:50.008774  8507 consensus_peers.cc:597] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:50.008867 13631 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.009585 13631 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:50.014290 13640 raft_consensus.cc:493] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.014922 13640 raft_consensus.cc:515] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.017163 13640 leader_election.cc:290] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.022050  9032 leader_election.cc:336] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.022212 13640 raft_consensus.cc:493] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.027693 13640 raft_consensus.cc:515] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.031114 13640 leader_election.cc:290] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:50.023424 13631 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:50.040972 13639 raft_consensus.cc:493] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.041823 13639 raft_consensus.cc:515] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.044263 13639 leader_election.cc:290] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.048053  9033 leader_election.cc:336] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.048676  9033 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.049510 13643 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:50.061338  8507 leader_election.cc:336] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.062068  8508 leader_election.cc:336] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.064922  8508 leader_election.cc:304] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.065943 13640 raft_consensus.cc:2749] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:50.066869  8508 leader_election.cc:336] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:50.069345  8507 leader_election.cc:336] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.072141  8507 leader_election.cc:304] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.074133 13640 raft_consensus.cc:2749] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:50.077730 13640 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.078266 13640 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.082011 13640 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.081938  8508 leader_election.cc:336] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:50.085302  8507 leader_election.cc:336] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.087195  8507 leader_election.cc:304] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.089844 13639 raft_consensus.cc:2749] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:50.090687 13639 raft_consensus.cc:493] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.091207 13639 raft_consensus.cc:515] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.093470 13639 leader_election.cc:290] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.096388  8507 leader_election.cc:336] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.105410  8508 leader_election.cc:336] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.106094  8508 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.107596 13640 raft_consensus.cc:493] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.108296 13640 raft_consensus.cc:515] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.118563 13640 leader_election.cc:290] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:50.121608 13643 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.122359 13643 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:50.124918 13643 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:50.125725 13639 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:50.141989  9032 leader_election.cc:336] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.144587  8507 consensus_peers.cc:597] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:50.149994  8507 leader_election.cc:336] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.153569  8507 leader_election.cc:336] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.154457  8508 leader_election.cc:336] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.155359  8508 leader_election.cc:304] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.158420 13640 raft_consensus.cc:2749] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:50.160281  9033 leader_election.cc:336] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.161716  9033 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.162467 13643 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:50.163478  8508 leader_election.cc:336] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.164032  8508 leader_election.cc:304] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.164930 13640 raft_consensus.cc:2749] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:50.185164 13639 raft_consensus.cc:493] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.185905 13639 raft_consensus.cc:515] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.188130 13639 leader_election.cc:290] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.195825  8507 leader_election.cc:336] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.199009  8508 leader_election.cc:336] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.199461  8508 leader_election.cc:304] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.200963 13640 raft_consensus.cc:2749] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:50.209024 13639 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.209671 13639 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.212288 13639 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.212901  8507 consensus_peers.cc:597] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:50.221210  8508 leader_election.cc:336] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:50.223057  8507 leader_election.cc:336] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.224031  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.225311 13639 raft_consensus.cc:2749] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:50.262425 13640 raft_consensus.cc:493] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.263130 13640 raft_consensus.cc:515] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.266189 13639 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.266865 13639 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:50.271701  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
I20260709 13:03:50.272440  9064 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 13.
I20260709 13:03:50.274282  8509 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:50.275417 13630 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:50.275938 13630 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Starting leader election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.276340 13630 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:50.265668 13640 leader_election.cc:290] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.303020  8507 leader_election.cc:336] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.305258 13639 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:50.305977 13639 raft_consensus.cc:493] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.306510 13639 raft_consensus.cc:515] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } }
I20260709 13:03:50.313903 13639 leader_election.cc:290] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:50.325657 13645 raft_consensus.cc:493] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.332541 13645 raft_consensus.cc:515] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.335530 13630 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:50.335328 13645 leader_election.cc:290] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:50.353159 13630 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Requested vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
W20260709 13:03:50.342715  8507 leader_election.cc:336] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.339682  8508 leader_election.cc:336] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.356666  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f1670d75c14f7588691908d7b2f1cf" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4"
I20260709 13:03:50.360050  9064 raft_consensus.cc:3060] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:50.365352  8508 leader_election.cc:304] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.373162 13640 raft_consensus.cc:2749] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:50.369689  8508 leader_election.cc:336] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:50.386782  8507 leader_election.cc:336] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.387909  9064 raft_consensus.cc:2468] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c45599d1dc3b4823b857cf77f276dc7b in term 14.
I20260709 13:03:50.394991  8509 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4, c45599d1dc3b4823b857cf77f276dc7b; no voters: 
I20260709 13:03:50.397998 13647 raft_consensus.cc:2804] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:50.406463  8508 leader_election.cc:336] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.410673  8508 leader_election.cc:304] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:50.409699  9032 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:50.407454 13647 raft_consensus.cc:697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Becoming Leader. State: Replica: c45599d1dc3b4823b857cf77f276dc7b, State: Running, Role: LEADER
I20260709 13:03:50.413578 13647 consensus_queue.cc:237] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:50.415156 13646 raft_consensus.cc:2749] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:50.415829 13630 raft_consensus.cc:493] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.418974 13630 raft_consensus.cc:515] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.427330 13640 raft_consensus.cc:493] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.428026 13640 raft_consensus.cc:515] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:50.439379  8508 leader_election.cc:336] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.439946  8508 leader_election.cc:304] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:50.441074  8508 leader_election.cc:336] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.444962 13630 leader_election.cc:290] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:50.445806 13639 raft_consensus.cc:2749] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:50.459971  8508 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.451750 13640 leader_election.cc:290] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.464352  8508 leader_election.cc:336] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:50.466861  8507 consensus_peers.cc:597] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:50.469986  7283 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8491)
W20260709 13:03:50.470995  8507 leader_election.cc:336] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.471675  8507 leader_election.cc:304] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.473073 13646 raft_consensus.cc:2749] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:50.476971 13648 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.477592 13648 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:50.473528  8507 leader_election.cc:336] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.478653  8507 leader_election.cc:304] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.481594 13646 raft_consensus.cc:2749] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:50.486636 13648 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), 92314b14f5554885a80c3dc87f4beed4 (127.7.28.196:42855)
I20260709 13:03:50.488058  9064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "c45599d1dc3b4823b857cf77f276dc7b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92314b14f5554885a80c3dc87f4beed4" is_pre_election: true
W20260709 13:03:50.489086  8508 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.506440  8289 catalog_manager.cc:5697] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b reported cstate change: term changed from 13 to 14, leader changed from d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194) to c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195). New cstate: current_term: 14 leader_uuid: "c45599d1dc3b4823b857cf77f276dc7b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.509653  8509 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 92314b14f5554885a80c3dc87f4beed4, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:50.510288 13643 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.520823 13643 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:50.524013 13643 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:50.530309  9033 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:50.533469  8507 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.534624  9032 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:50.535180  9032 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:50.535370  8507 consensus_peers.cc:597] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:50.537947 13643 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:50.535006  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36596de3826e4546a5476f7471fdbf37" candidate_uuid: "92314b14f5554885a80c3dc87f4beed4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c45599d1dc3b4823b857cf77f276dc7b" is_pre_election: true
I20260709 13:03:50.534684 13647 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:50.540746  8535 raft_consensus.cc:2468] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92314b14f5554885a80c3dc87f4beed4 in term 12.
I20260709 13:03:50.559789 13648 raft_consensus.cc:493] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:50.560427 13648 raft_consensus.cc:515] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:50.566177 13648 leader_election.cc:290] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:50.570217  8507 leader_election.cc:336] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:50.578393  8508 leader_election.cc:336] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:50.578927  8508 leader_election.cc:304] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
W20260709 13:03:50.579469  8507 consensus_peers.cc:597] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:50.580111 13648 raft_consensus.cc:2749] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:50.607748  8507 consensus_peers.cc:597] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:50.631559  8508 consensus_peers.cc:597] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.693087  9032 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:50.742549  9033 consensus_peers.cc:597] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.743582  8508 consensus_peers.cc:597] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.777235  8508 consensus_peers.cc:597] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.791664  9033 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.794617  9032 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:50.828425  9033 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.842460  9033 consensus_peers.cc:597] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.843596  8508 consensus_peers.cc:597] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.893141  9064 raft_consensus.cc:1275] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Refusing update from remote peer c45599d1dc3b4823b857cf77f276dc7b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:50.896785 13648 consensus_queue.cc:1048] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:50.905160  9032 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:50.932673  8508 consensus_peers.cc:597] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.933415  8508 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.951537  9033 consensus_peers.cc:597] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:50.999717  9033 consensus_peers.cc:597] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.028371  8508 consensus_peers.cc:597] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.034130  8508 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.044643  8508 consensus_peers.cc:597] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.045397  8508 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.058821  8508 consensus_peers.cc:597] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.079298  9033 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.092240  8507 consensus_peers.cc:597] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:51.096323  9033 consensus_peers.cc:597] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.118119  8508 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.147840  9033 consensus_peers.cc:597] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.191716  8508 consensus_peers.cc:597] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.193380  9033 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.208269  9033 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.224910  8508 consensus_peers.cc:597] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.226540  9032 consensus_peers.cc:597] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:51.227646  8508 consensus_peers.cc:597] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.254359  8508 consensus_peers.cc:597] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.345503  8507 consensus_peers.cc:597] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:51.360488  8507 consensus_peers.cc:597] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.370574  8507 consensus_peers.cc:597] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:51.375815  8508 consensus_peers.cc:597] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.399688  7283 tablet_server.cc:196] TabletServer@127.7.28.194:0 shutdown complete.
I20260709 13:03:51.462042 13648 raft_consensus.cc:493] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:51.463109 13648 raft_consensus.cc:515] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
W20260709 13:03:51.477631  8507 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:51.480341  8508 leader_election.cc:336] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:51.480824  8508 leader_election.cc:304] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:51.482146 13640 raft_consensus.cc:2749] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:51.482923 13648 leader_election.cc:290] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:51.521100  8508 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:51.572790  7283 tablet_server.cc:179] TabletServer@127.7.28.195:0 shutting down...
W20260709 13:03:51.575408  8507 consensus_peers.cc:597] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:51.576907  8508 consensus_peers.cc:597] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.580097  8508 consensus_peers.cc:597] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:51.587363  9032 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:51.603525  8507 consensus_peers.cc:597] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:51.609511 13636 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:51.610150 13636 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:51.612332 13636 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:51.618081  9033 leader_election.cc:336] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:51.621198  9032 leader_election.cc:336] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:51.621702  9032 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:51.622668 13657 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:51.667938 13648 raft_consensus.cc:493] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:51.668506 13648 raft_consensus.cc:515] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:51.670641 13648 leader_election.cc:290] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:51.679158  8508 leader_election.cc:336] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:51.681027  8507 leader_election.cc:336] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:51.682909  8507 leader_election.cc:304] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:51.685441 13640 raft_consensus.cc:2749] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:51.684690  9032 consensus_peers.cc:597] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.690965  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:51.693094  7283 tablet_replica.cc:333] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.694188  7283 raft_consensus.cc:2243] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.694983  7283 raft_consensus.cc:2272] T b79a5acddc004781bbeac307ae4e58d1 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.700944  8507 consensus_peers.cc:597] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.701522  8507 consensus_peers.cc:597] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:51.704452  7283 tablet_replica.cc:333] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.705690  7283 raft_consensus.cc:2243] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.706416  7283 raft_consensus.cc:2272] T c257a516245f4698b8937b228b23d23a P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.709594  7283 tablet_replica.cc:333] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.710523  7283 raft_consensus.cc:2243] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.711328  7283 raft_consensus.cc:2272] T 6becd976429a45a3874a10895b19b63e P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.714176  7283 tablet_replica.cc:333] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.714998  7283 raft_consensus.cc:2243] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.715804  7283 raft_consensus.cc:2272] T 7219cc411cf6498f8f250f689007874f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.718564  7283 tablet_replica.cc:333] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.719424  7283 raft_consensus.cc:2243] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.720530  7283 raft_consensus.cc:2272] T c0c4c676aa374fb6b2efb71a3de7e4bd P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.723266  7283 tablet_replica.cc:333] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.724145  7283 raft_consensus.cc:2243] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.724803  7283 raft_consensus.cc:2272] T 4395bd6ec2454867a133e2c678bcd570 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.727638  7283 tablet_replica.cc:333] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.728814  7283 raft_consensus.cc:2243] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.730298  7283 raft_consensus.cc:2272] T 16a45e4473e5464880e36c3f7edc9b4e P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.733413  7283 tablet_replica.cc:333] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.734283  7283 raft_consensus.cc:2243] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.735025  7283 raft_consensus.cc:2272] T a9bdd97906c140e29b99343177f05dc2 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.737740  7283 tablet_replica.cc:333] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.738722  7283 raft_consensus.cc:2243] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.739440  7283 raft_consensus.cc:2272] T 9cd965dafa3a4024b05decfd805a2903 P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.744596  9032 consensus_peers.cc:597] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.745666  7283 tablet_replica.cc:333] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.749436  7283 raft_consensus.cc:2243] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.750352  7283 raft_consensus.cc:2272] T ac2457ce91f84cd3860bea5672ef0ab8 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.753918  7283 tablet_replica.cc:333] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.755839  7283 raft_consensus.cc:2243] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.757021  7283 raft_consensus.cc:2272] T bb0e47b92cf24b70b2ddbf9bafbadc3b P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.759654  7283 tablet_replica.cc:333] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.760636  7283 raft_consensus.cc:2243] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.761763  7283 raft_consensus.cc:2272] T 5c2dbc87d7bb4fd1a21aae4da276631c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.764917  7283 tablet_replica.cc:333] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.765766  7283 raft_consensus.cc:2243] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.766901  7283 raft_consensus.cc:2272] T ad98149b9fc3438b96dcbd03688e8bb1 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.768047  9032 consensus_peers.cc:597] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.769719  7283 tablet_replica.cc:333] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.770716  7283 raft_consensus.cc:2243] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.771427  7283 raft_consensus.cc:2272] T a8ce611680844f5b9bbe7f4813048f1b P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.774454  7283 tablet_replica.cc:333] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.775349  7283 raft_consensus.cc:2243] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.775966  7283 raft_consensus.cc:2272] T dc7cbb87d4de484e83c3b5c2d4674239 P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.778824  7283 tablet_replica.cc:333] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.779804  7283 raft_consensus.cc:2243] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.780475  7283 raft_consensus.cc:2272] T 55bf07df55b74bb7a74bd894b869faef P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.784396  7283 tablet_replica.cc:333] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.785320  7283 raft_consensus.cc:2243] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.787106  7283 raft_consensus.cc:2272] T f0cfe6c1fd994d86a76a6c9fa9428fd6 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.788326  9032 consensus_peers.cc:597] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.791107  7283 tablet_replica.cc:333] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.792029  7283 raft_consensus.cc:2243] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.792683  7283 raft_consensus.cc:2272] T 448878eafac247d592f6889cb1e26a56 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.795522  7283 tablet_replica.cc:333] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.796404  7283 raft_consensus.cc:2243] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.797488  7283 raft_consensus.cc:2272] T 1ddb6b18052644bcb64034fd9deee9ea P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.800241  7283 tablet_replica.cc:333] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.801057  7283 raft_consensus.cc:2243] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.802739  7283 raft_consensus.cc:2272] T 58f1670d75c14f7588691908d7b2f1cf P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.806273  9032 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:51.807720  9032 consensus_peers.cc:597] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.809049  7283 tablet_replica.cc:333] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.810139  7283 raft_consensus.cc:2243] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.811339  7283 raft_consensus.cc:2272] T e460bf5e53b8462ebab2155c88820c11 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.814630  7283 tablet_replica.cc:333] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.815660  7283 raft_consensus.cc:2243] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.817009  7283 raft_consensus.cc:2272] T d2321e967e3f4695a2563f5d8dacc658 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.820374  7283 tablet_replica.cc:333] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.821349  7283 raft_consensus.cc:2243] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.822096  7283 raft_consensus.cc:2272] T fdd8533706064dd78b4e61de0beb5255 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.824204  9032 consensus_peers.cc:597] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.825300  7283 tablet_replica.cc:333] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.826432  7283 raft_consensus.cc:2243] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.827641  7283 raft_consensus.cc:2272] T a30077f266a34706854bc7e6a95ad805 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.830693  7283 tablet_replica.cc:333] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.831687  7283 raft_consensus.cc:2243] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.832458  7283 raft_consensus.cc:2272] T 412c0e548a4d4e3f90555631b28d234b P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.836948  8507 consensus_peers.cc:597] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:51.840435  7283 tablet_replica.cc:333] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.842773  7283 raft_consensus.cc:2243] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.843731  7283 raft_consensus.cc:2272] T 01bec3d6263846f6bc87510cf2213e1e P c45599d1dc3b4823b857cf77f276dc7b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.846946  7283 tablet_replica.cc:333] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.847901  7283 raft_consensus.cc:2243] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.849148  7283 raft_consensus.cc:2272] T 278b4d554f0647ff885c963daff7931d P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.850240  9032 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.852085  7283 tablet_replica.cc:333] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.853201  7283 raft_consensus.cc:2243] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.854558  7283 raft_consensus.cc:2272] T 21a9e66431b042b89cf88391ec860de6 P c45599d1dc3b4823b857cf77f276dc7b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.857653  7283 tablet_replica.cc:333] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.858693  7283 raft_consensus.cc:2243] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.859943  7283 raft_consensus.cc:2272] T dbbf8012591a4011b3ae6451802bb12a P c45599d1dc3b4823b857cf77f276dc7b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.863420  7283 tablet_replica.cc:333] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.864418  7283 raft_consensus.cc:2243] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.865286  7283 raft_consensus.cc:2272] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.865842 13640 raft_consensus.cc:670] T 687c062d8bc14ccabafd4083b9bbf0e7 P c45599d1dc3b4823b857cf77f276dc7b: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
W20260709 13:03:51.875674  9032 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:51.875870  7283 tablet_replica.cc:333] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.876854  7283 raft_consensus.cc:2243] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.878203  7283 raft_consensus.cc:2272] T e345f8303cfb4ede8a2072d0adb8061a P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.881398  7283 tablet_replica.cc:333] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.882381  7283 raft_consensus.cc:2243] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.883261  7283 raft_consensus.cc:2272] T 48eb2b2d1e724640bdcade4f8baa0375 P c45599d1dc3b4823b857cf77f276dc7b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.886345  7283 tablet_replica.cc:333] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.887337  7283 raft_consensus.cc:2243] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.888165  7283 raft_consensus.cc:2272] T 89b5930e207e40d28682b42cd831b68a P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.891352  7283 tablet_replica.cc:333] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.892307  7283 raft_consensus.cc:2243] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.893581  7283 raft_consensus.cc:2272] T 1e1ecd689cb746dd9dd2359f106c7bac P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.896996  7283 tablet_replica.cc:333] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.898013  7283 raft_consensus.cc:2243] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.899331  7283 raft_consensus.cc:2272] T ef4deccb7c274fec97786db5d6131514 P c45599d1dc3b4823b857cf77f276dc7b [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.900520  9032 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.902566  7283 tablet_replica.cc:333] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.903554  7283 raft_consensus.cc:2243] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.904690  7283 raft_consensus.cc:2272] T 668db691226f4f9884a460b2a17f021c P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.907622  7283 tablet_replica.cc:333] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.908501  7283 raft_consensus.cc:2243] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.909159  7283 raft_consensus.cc:2272] T cefa63b714fc469d8c98138fb7dd26f4 P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.912086  7283 tablet_replica.cc:333] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.913002  7283 raft_consensus.cc:2243] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.914168  7283 raft_consensus.cc:2272] T 157886d313c14dff8294260f4377baf4 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.916921  7283 tablet_replica.cc:333] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.917752  7283 raft_consensus.cc:2243] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.919004  7283 raft_consensus.cc:2272] T 1bb4baf572744c749edb167ac631aabe P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.921983  7283 tablet_replica.cc:333] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.923026  7283 raft_consensus.cc:2243] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.923878  7283 raft_consensus.cc:2272] T 36596de3826e4546a5476f7471fdbf37 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.926743  7283 tablet_replica.cc:333] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.927621  7283 raft_consensus.cc:2243] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.928267  7283 raft_consensus.cc:2272] T f58095c0d8fc462d8edd0f9f658b3eac P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.931217  7283 tablet_replica.cc:333] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.932032  7283 raft_consensus.cc:2243] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.933105  7283 raft_consensus.cc:2272] T 13811dee93af4290bdcf7d73b527d0f4 P c45599d1dc3b4823b857cf77f276dc7b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.935950  7283 tablet_replica.cc:333] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.936862  7283 raft_consensus.cc:2243] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.938290  7283 raft_consensus.cc:2272] T e3d5b84b382e4f0caa0dbe8c50c7cfc7 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.941361  7283 tablet_replica.cc:333] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.942250  7283 raft_consensus.cc:2243] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.942904  7283 raft_consensus.cc:2272] T 00dd397b27604d3c902569919fcf6a04 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.945469  7283 tablet_replica.cc:333] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.946326  7283 raft_consensus.cc:2243] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.950810  7283 raft_consensus.cc:2272] T 936de44ff6404ac7b9d585ab45c933f9 P c45599d1dc3b4823b857cf77f276dc7b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.953578  7283 tablet_replica.cc:333] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.954419  7283 raft_consensus.cc:2243] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.955065  7283 raft_consensus.cc:2272] T 0fcda97cc34546609f91a249f74d8f85 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.958446  7283 tablet_replica.cc:333] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.959255  7283 raft_consensus.cc:2243] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.959981  7283 raft_consensus.cc:2272] T c8f3b02e50814949b04f7440340f941f P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.961997 13640 raft_consensus.cc:493] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:51.962796  7283 tablet_replica.cc:333] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.962567 13640 raft_consensus.cc:515] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } }
I20260709 13:03:51.963639  7283 raft_consensus.cc:2243] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.964321  7283 raft_consensus.cc:2272] T 0c10e3a2e1f044a0a1a78740e279800c P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.967875 13640 leader_election.cc:290] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
I20260709 13:03:51.970750  7283 tablet_replica.cc:333] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
W20260709 13:03:51.971436  8508 leader_election.cc:336] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:51.972811  8507 leader_election.cc:336] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:51.972922  7283 raft_consensus.cc:2243] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.973264  8507 leader_election.cc:304] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c45599d1dc3b4823b857cf77f276dc7b; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:51.973697  7283 raft_consensus.cc:2272] T 2e60e73cf17e48a2998c2d82eafcb1e3 P c45599d1dc3b4823b857cf77f276dc7b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.976424  7283 tablet_replica.cc:333] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.977140  7283 raft_consensus.cc:2243] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.978266  7283 raft_consensus.cc:2272] T 7051c4976daf4ac580117a5b9ecb8de4 P c45599d1dc3b4823b857cf77f276dc7b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.981014  7283 tablet_replica.cc:333] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.981732  7283 raft_consensus.cc:2243] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.982340  7283 raft_consensus.cc:2272] T 6fcd5c10366d45e5ab1c8562d806d037 P c45599d1dc3b4823b857cf77f276dc7b [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.982666  9032 consensus_peers.cc:597] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 -> Peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Couldn't send request to peer c45599d1dc3b4823b857cf77f276dc7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.984942  7283 tablet_replica.cc:333] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b: stopping tablet replica
I20260709 13:03:51.985663  7283 raft_consensus.cc:2243] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.986238  7283 raft_consensus.cc:2272] T 3476b7ee17e048f38396353721fa682f P c45599d1dc3b4823b857cf77f276dc7b [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:52.112556  9032 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:52.131335  9032 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:52.136248 13636 raft_consensus.cc:493] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:52.136885 13636 raft_consensus.cc:515] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
W20260709 13:03:52.152515  9033 leader_election.cc:336] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
I20260709 13:03:52.154398 13636 leader_election.cc:290] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:52.155556  9032 leader_election.cc:336] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:52.156038  9032 leader_election.cc:304] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:52.156774 13636 raft_consensus.cc:2749] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:52.172387  9032 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.28.195:40791: connect: Connection refused (error 111) [suppressed 645 similar messages]
I20260709 13:03:52.317101 13661 raft_consensus.cc:493] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:52.319051 13661 raft_consensus.cc:515] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } attrs { replace: true } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:52.322872 13661 leader_election.cc:290] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:52.331646  9033 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:52.360059  9032 consensus_peers.cc:597] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:52.360549  9032 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:52.360954  9032 leader_election.cc:304] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:52.361982 13661 raft_consensus.cc:2749] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:52.365401  9032 leader_election.cc:336] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Network error: Client connection negotiation failed: client connection to 127.7.28.195:40791: connect: Connection refused (error 111)
W20260709 13:03:52.371631  9032 consensus_peers.cc:597] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:52.737919 13661 raft_consensus.cc:493] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:52.738502 13661 raft_consensus.cc:515] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:52.740655 13661 leader_election.cc:290] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:52.745169  9033 leader_election.cc:336] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:52.746955  9032 leader_election.cc:336] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Network error: Client connection negotiation failed: client connection to 127.7.28.195:40791: connect: Connection refused (error 111)
I20260709 13:03:52.747412  9032 leader_election.cc:304] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:52.748095 13661 raft_consensus.cc:2749] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:52.946234  9032 consensus_peers.cc:597] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:52.956120 13636 raft_consensus.cc:493] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:52.956727 13636 raft_consensus.cc:515] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:52.958894 13636 leader_election.cc:290] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
I20260709 13:03:52.959982 13636 raft_consensus.cc:493] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:52.960561 13636 raft_consensus.cc:515] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:52.962675 13636 leader_election.cc:290] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:52.962770  9033 leader_election.cc:336] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:52.968775  9032 leader_election.cc:336] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Network error: Client connection negotiation failed: client connection to 127.7.28.195:40791: connect: Connection refused (error 111)
I20260709 13:03:52.969376  9032 leader_election.cc:304] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:52.970186 13636 raft_consensus.cc:2749] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:52.970374  9032 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Network error: Client connection negotiation failed: client connection to 127.7.28.195:40791: connect: Connection refused (error 111)
W20260709 13:03:52.978618  9032 leader_election.cc:336] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:52.979051  9032 leader_election.cc:304] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:52.979684 13636 raft_consensus.cc:2749] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:53.019070 13661 raft_consensus.cc:493] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:53.019649 13661 raft_consensus.cc:515] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:53.021745 13661 leader_election.cc:290] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:53.026724  9032 leader_election.cc:336] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:53.028349  9032 leader_election.cc:336] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Network error: Client connection negotiation failed: client connection to 127.7.28.195:40791: connect: Connection refused (error 111)
I20260709 13:03:53.028733  9032 leader_election.cc:304] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:53.029330 13661 raft_consensus.cc:2749] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:53.088263  9033 consensus_peers.cc:597] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.096841  9032 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:53.177467  9032 consensus_peers.cc:597] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:53.182237 13661 raft_consensus.cc:493] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:53.182896 13661 raft_consensus.cc:515] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:53.185122 13661 leader_election.cc:290] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:53.190892  9033 leader_election.cc:336] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:53.191533  9032 leader_election.cc:336] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Network error: Client connection negotiation failed: client connection to 127.7.28.195:40791: connect: Connection refused (error 111)
I20260709 13:03:53.191967  9032 leader_election.cc:304] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: c45599d1dc3b4823b857cf77f276dc7b, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:53.192668 13661 raft_consensus.cc:2749] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:53.290087 13661 raft_consensus.cc:493] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c45599d1dc3b4823b857cf77f276dc7b)
I20260709 13:03:53.290650 13661 raft_consensus.cc:515] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "c45599d1dc3b4823b857cf77f276dc7b" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40791 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:53.292840 13661 leader_election.cc:290] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791)
W20260709 13:03:53.299448  9032 leader_election.cc:336] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
W20260709 13:03:53.300117  9032 leader_election.cc:336] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c45599d1dc3b4823b857cf77f276dc7b (127.7.28.195:40791): Network error: Client connection negotiation failed: client connection to 127.7.28.195:40791: connect: Connection refused (error 111)
I20260709 13:03:53.300513  9032 leader_election.cc:304] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, c45599d1dc3b4823b857cf77f276dc7b
I20260709 13:03:53.301218 13661 raft_consensus.cc:2749] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:53.332860  9033 consensus_peers.cc:597] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.340766  9090 debug-util.cc:398] Leaking SignalData structure 0x7b08003094a0 after lost signal to thread 7286
W20260709 13:03:53.341861  9090 debug-util.cc:398] Leaking SignalData structure 0x7b080034e440 after lost signal to thread 8327
W20260709 13:03:53.343286  9090 debug-util.cc:398] Leaking SignalData structure 0x7b0800309460 after lost signal to thread 9093
W20260709 13:03:53.384799  9033 consensus_peers.cc:597] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.440168  9033 consensus_peers.cc:597] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.483712  9033 consensus_peers.cc:597] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.490955  9033 consensus_peers.cc:597] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.523218  9033 consensus_peers.cc:597] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:53.560708  9033 consensus_peers.cc:597] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.562901  7283 tablet_server.cc:196] TabletServer@127.7.28.195:0 shutdown complete.
W20260709 13:03:53.595504  9032 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Couldn't send request to peer 2122d8c723e84e3da22f81f7eeb4b1a9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:53.643515 13636 raft_consensus.cc:493] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d2a645dcec4c479ba4c94d075b1bc98c)
I20260709 13:03:53.644164 13636 raft_consensus.cc:515] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2122d8c723e84e3da22f81f7eeb4b1a9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 35967 } } peers { permanent_uuid: "d2a645dcec4c479ba4c94d075b1bc98c" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 32851 } } peers { permanent_uuid: "92314b14f5554885a80c3dc87f4beed4" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 42855 } attrs { promote: false } }
I20260709 13:03:53.648039 13636 leader_election.cc:290] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967), d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851)
W20260709 13:03:53.653306  9033 leader_election.cc:336] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111)
W20260709 13:03:53.677549  9032 leader_election.cc:336] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:53.678231  9032 leader_election.cc:304] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92314b14f5554885a80c3dc87f4beed4; no voters: 2122d8c723e84e3da22f81f7eeb4b1a9, d2a645dcec4c479ba4c94d075b1bc98c
I20260709 13:03:53.679080 13636 raft_consensus.cc:2749] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:53.696979  9033 consensus_peers.cc:597] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.700765  7283 tablet_server.cc:179] TabletServer@127.7.28.196:0 shutting down...
W20260709 13:03:53.730558  9033 consensus_peers.cc:597] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.768767  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:53.769649  7283 tablet_replica.cc:333] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.770766  7283 raft_consensus.cc:2243] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.771652  7283 raft_consensus.cc:2272] T ad98149b9fc3438b96dcbd03688e8bb1 P 92314b14f5554885a80c3dc87f4beed4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.774295  7283 tablet_replica.cc:333] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.775167  7283 raft_consensus.cc:2243] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:53.775621  9033 consensus_peers.cc:597] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 -> Peer d2a645dcec4c479ba4c94d075b1bc98c (127.7.28.194:32851): Couldn't send request to peer d2a645dcec4c479ba4c94d075b1bc98c. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:32851: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:53.775964  7283 raft_consensus.cc:2272] T c0c4c676aa374fb6b2efb71a3de7e4bd P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.779294  7283 tablet_replica.cc:333] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.780186  7283 raft_consensus.cc:2243] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.780982  7283 raft_consensus.cc:2272] T 36596de3826e4546a5476f7471fdbf37 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.783754  7283 tablet_replica.cc:333] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.784386  7283 raft_consensus.cc:2243] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.785177  7283 raft_consensus.cc:2272] T ac2457ce91f84cd3860bea5672ef0ab8 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.787406  7283 tablet_replica.cc:333] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.787971  7283 raft_consensus.cc:2243] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.788843  7283 raft_consensus.cc:2272] T 0fcda97cc34546609f91a249f74d8f85 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.791355  7283 tablet_replica.cc:333] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.791980  7283 raft_consensus.cc:2243] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.792847  7283 raft_consensus.cc:2272] T 48eb2b2d1e724640bdcade4f8baa0375 P 92314b14f5554885a80c3dc87f4beed4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.794871  7283 tablet_replica.cc:333] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.795569  7283 raft_consensus.cc:2243] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.796463  7283 raft_consensus.cc:2272] T ded976982870447482c4b84286e6340b P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.798930  7283 tablet_replica.cc:333] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.799729  7283 raft_consensus.cc:2243] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.800848  7283 raft_consensus.cc:2272] T b79a5acddc004781bbeac307ae4e58d1 P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.803727  7283 tablet_replica.cc:333] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.804505  7283 raft_consensus.cc:2243] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.805100  7283 raft_consensus.cc:2272] T 936de44ff6404ac7b9d585ab45c933f9 P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.807641  7283 tablet_replica.cc:333] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.808518  7283 raft_consensus.cc:2243] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.809509  7283 raft_consensus.cc:2272] T 9a8845af07904ef3b3861c0999f3cd1b P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.812233  7283 tablet_replica.cc:333] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.812801  7283 raft_consensus.cc:2243] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.813344  7283 raft_consensus.cc:2272] T ef4deccb7c274fec97786db5d6131514 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.815435  7283 tablet_replica.cc:333] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.816020  7283 raft_consensus.cc:2243] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.816499  7283 raft_consensus.cc:2272] T 6595c51b9ae043699167a92b109f328e P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.818661  7283 tablet_replica.cc:333] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.819211  7283 raft_consensus.cc:2243] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.819986  7283 raft_consensus.cc:2272] T c6de9f8d6e504e40b0a5e555abe5c0c0 P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.822134  7283 tablet_replica.cc:333] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.822741  7283 raft_consensus.cc:2243] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.823861  7283 raft_consensus.cc:2272] T f58095c0d8fc462d8edd0f9f658b3eac P 92314b14f5554885a80c3dc87f4beed4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.826200  7283 tablet_replica.cc:333] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.826771  7283 raft_consensus.cc:2243] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.827263  7283 raft_consensus.cc:2272] T 58f1670d75c14f7588691908d7b2f1cf P 92314b14f5554885a80c3dc87f4beed4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.829272  7283 tablet_replica.cc:333] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.829849  7283 raft_consensus.cc:2243] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.830669  7283 raft_consensus.cc:2272] T 13811dee93af4290bdcf7d73b527d0f4 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.832675  7283 tablet_replica.cc:333] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.833339  7283 raft_consensus.cc:2243] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.834208  7283 raft_consensus.cc:2272] T 04d76276a90a4f889ff8e98f46e90227 P 92314b14f5554885a80c3dc87f4beed4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.836236  7283 tablet_replica.cc:333] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.836787  7283 raft_consensus.cc:2243] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.837666  7283 raft_consensus.cc:2272] T 7219cc411cf6498f8f250f689007874f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.839745  7283 tablet_replica.cc:333] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.840303  7283 raft_consensus.cc:2243] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.841156  7283 raft_consensus.cc:2272] T 55bf07df55b74bb7a74bd894b869faef P 92314b14f5554885a80c3dc87f4beed4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.843173  7283 tablet_replica.cc:333] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.843720  7283 raft_consensus.cc:2243] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.844566  7283 raft_consensus.cc:2272] T fdd8533706064dd78b4e61de0beb5255 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.846838  7283 tablet_replica.cc:333] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.847337  7283 raft_consensus.cc:2243] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.848116  7283 raft_consensus.cc:2272] T 3476b7ee17e048f38396353721fa682f P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.850263  7283 tablet_replica.cc:333] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.850791  7283 raft_consensus.cc:2243] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:53.851289  7283 raft_consensus.cc:2272] T d2321e967e3f4695a2563f5d8dacc658 P 92314b14f5554885a80c3dc87f4beed4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.853493  7283 tablet_replica.cc:333] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.854074  7283 raft_consensus.cc:2243] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.854862  7283 raft_consensus.cc:2272] T 8b6226d3e14545daa1ff24f4a0384182 P 92314b14f5554885a80c3dc87f4beed4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.856839  7283 tablet_replica.cc:333] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.857338  7283 raft_consensus.cc:2243] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.858235  7283 raft_consensus.cc:2272] T e4e26f5f342c48648f0433b885576c00 P 92314b14f5554885a80c3dc87f4beed4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:53.860450  7283 tablet_replica.cc:333] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4: stopping tablet replica
I20260709 13:03:53.860996  7283 raft_consensus.cc:2243] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:03:53.861831  7283 raft_consensus.cc:2272] T 6becd976429a45a3874a10895b19b63e P 92314b14f5554885a80c3dc87f4beed4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.196916  7283 tablet_server.cc:196] TabletServer@127.7.28.196:0 shutdown complete.
I20260709 13:03:54.243736  7283 master.cc:562] Master@127.7.28.254:35733 shutting down...
W20260709 13:03:54.278872  8341 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:54.279157  8341 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:54.279403  8341 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:56.940972  8277 catalog_manager.cc:4755] TS 2122d8c723e84e3da22f81f7eeb4b1a9 (127.7.28.193:35967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ad98149b9fc3438b96dcbd03688e8bb1: Network error: Client connection negotiation failed: client connection to 127.7.28.193:35967: connect: Connection refused (error 111)
I20260709 13:03:57.162387  7283 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:57.163049  7283 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:57.163349  7283 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9c29a936330e465e8f9c7de5c6f8056b: stopping tablet replica
I20260709 13:03:57.287205  7283 master.cc:584] Master@127.7.28.254:35733 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (164525 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:03:57.391237  7283 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.28.254:46727
I20260709 13:03:57.392470  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:57.399046 13664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:57.399331 13667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:57.399363 13665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:57.400250  7283 server_base.cc:1061] running on GCE node
I20260709 13:03:57.403563  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:57.403764  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:57.403875  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602237403865 us; error 0 us; skew 500 ppm
I20260709 13:03:57.404356  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:57.407104  7283 webserver.cc:533] Webserver started at http://127.7.28.254:35399/ using document root <none> and password file <none>
I20260709 13:03:57.407588  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:57.407748  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:57.407969  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:57.409086  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/master-0-root/instance:
uuid: "136e4e7f3c974a86aef81c720891d47e"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:03:57.413648  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:57.417582 13672 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.418625  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:57.418980  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/master-0-root
uuid: "136e4e7f3c974a86aef81c720891d47e"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:03:57.419384  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:57.442392  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:57.443849  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:57.518567  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.254:46727
I20260709 13:03:57.518678 13724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.254:46727 every 8 connection(s)
I20260709 13:03:57.524432 13725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:57.536305 13725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e: Bootstrap starting.
I20260709 13:03:57.541465 13725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:57.546592 13725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e: No bootstrap required, opened a new log
I20260709 13:03:57.548952 13725 raft_consensus.cc:359] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136e4e7f3c974a86aef81c720891d47e" member_type: VOTER }
I20260709 13:03:57.549502 13725 raft_consensus.cc:385] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.549713 13725 raft_consensus.cc:740] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 136e4e7f3c974a86aef81c720891d47e, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.550390 13725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136e4e7f3c974a86aef81c720891d47e" member_type: VOTER }
I20260709 13:03:57.550907 13725 raft_consensus.cc:399] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:57.551105 13725 raft_consensus.cc:493] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:57.551348 13725 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.556021 13725 raft_consensus.cc:515] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136e4e7f3c974a86aef81c720891d47e" member_type: VOTER }
I20260709 13:03:57.556536 13725 leader_election.cc:304] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 136e4e7f3c974a86aef81c720891d47e; no voters: 
I20260709 13:03:57.557638 13725 leader_election.cc:290] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:57.558142 13728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:57.559598 13728 raft_consensus.cc:697] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 1 LEADER]: Becoming Leader. State: Replica: 136e4e7f3c974a86aef81c720891d47e, State: Running, Role: LEADER
I20260709 13:03:57.560446 13728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136e4e7f3c974a86aef81c720891d47e" member_type: VOTER }
I20260709 13:03:57.561049 13725 sys_catalog.cc:565] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:57.568286 13730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 136e4e7f3c974a86aef81c720891d47e. Latest consensus state: current_term: 1 leader_uuid: "136e4e7f3c974a86aef81c720891d47e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136e4e7f3c974a86aef81c720891d47e" member_type: VOTER } }
I20260709 13:03:57.569396 13730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:57.569387 13729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "136e4e7f3c974a86aef81c720891d47e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136e4e7f3c974a86aef81c720891d47e" member_type: VOTER } }
I20260709 13:03:57.570658 13729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:57.573891 13734 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:57.579145 13734 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:57.583855  7283 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:57.591393 13734 catalog_manager.cc:1383] Generated new cluster ID: 0f4f5a72cb7f470295c529b14bfcce4e
I20260709 13:03:57.591828 13734 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:57.614169 13734 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:57.615581 13734 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:57.640897 13734 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e: Generated new TSK 0
I20260709 13:03:57.641606 13734 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:57.655462  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:57.663112 13746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:57.663959 13747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:57.666419 13749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:57.667474  7283 server_base.cc:1061] running on GCE node
I20260709 13:03:57.669341  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:57.669620  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:57.669854  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602237669829 us; error 0 us; skew 500 ppm
I20260709 13:03:57.670483  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:57.673451  7283 webserver.cc:533] Webserver started at http://127.7.28.193:40967/ using document root <none> and password file <none>
I20260709 13:03:57.674099  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:57.674333  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:57.674690  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:57.676064  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/instance:
uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:03:57.681406  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:57.685438 13754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.686512  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:57.686919  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:03:57.687283  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:57.703116  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:57.704401  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:57.706060  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:57.708601  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:57.708848  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.709129  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:57.709326  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.752434  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:40245
I20260709 13:03:57.752556 13816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:40245 every 8 connection(s)
I20260709 13:03:57.758334  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:57.766376 13821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:57.768635 13822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:57.770582  7283 server_base.cc:1061] running on GCE node
W20260709 13:03:57.771624 13824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:57.773155  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:57.773399  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:57.773576 13817 heartbeater.cc:344] Connected to a master server at 127.7.28.254:46727
I20260709 13:03:57.773603  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602237773583 us; error 0 us; skew 500 ppm
I20260709 13:03:57.774232 13817 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:57.774772  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:57.775279 13817 heartbeater.cc:507] Master 127.7.28.254:46727 requested a full tablet report, sending...
I20260709 13:03:57.777736  7283 webserver.cc:533] Webserver started at http://127.7.28.194:36355/ using document root <none> and password file <none>
I20260709 13:03:57.778203 13690 ts_manager.cc:194] Registered new tserver with Master: ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:03:57.778383  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:57.778769  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:57.779161  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:57.780930  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/instance:
uuid: "97c52f3e93434bedbdc9755e64f33d4f"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:03:57.781242 13690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34328
I20260709 13:03:57.786325  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:03:57.790328 13829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.791239  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:57.791574  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-1-root
uuid: "97c52f3e93434bedbdc9755e64f33d4f"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:03:57.791918  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:57.802543  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:57.803833  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:57.805371  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:57.807788  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:57.808036  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.808297  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:57.808475  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.853526  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.194:37379
I20260709 13:03:57.853632 13891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.194:37379 every 8 connection(s)
I20260709 13:03:57.858892  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:57.866217 13895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:57.876173  7283 server_base.cc:1061] running on GCE node
W20260709 13:03:57.876837 13896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:57.877158 13892 heartbeater.cc:344] Connected to a master server at 127.7.28.254:46727
I20260709 13:03:57.877712 13892 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:57.879472 13892 heartbeater.cc:507] Master 127.7.28.254:46727 requested a full tablet report, sending...
W20260709 13:03:57.881753 13898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:57.882793 13690 ts_manager.cc:194] Registered new tserver with Master: 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:03:57.883191  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:57.883479  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:57.883687  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602237883648 us; error 0 us; skew 500 ppm
I20260709 13:03:57.884380  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:57.884608 13690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34338
I20260709 13:03:57.887651  7283 webserver.cc:533] Webserver started at http://127.7.28.195:39977/ using document root <none> and password file <none>
I20260709 13:03:57.888365  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:57.888594  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:57.888887  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:57.890331  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/instance:
uuid: "48967ca777ee43ebaddd57da674bd3e1"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:03:57.895200  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:57.898976 13903 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.900029  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:57.900475  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-2-root
uuid: "48967ca777ee43ebaddd57da674bd3e1"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:03:57.900828  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:57.926110  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:57.927368  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:57.928702  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:57.931246  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:57.931483  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.931739  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:57.931912  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:57.975262  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.195:39185
I20260709 13:03:57.975381 13965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.195:39185 every 8 connection(s)
I20260709 13:03:57.980207  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:57.989019 13969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:57.989496 13970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:57.992650 13972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:57.996178 13966 heartbeater.cc:344] Connected to a master server at 127.7.28.254:46727
I20260709 13:03:57.996742 13966 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:57.997152  7283 server_base.cc:1061] running on GCE node
I20260709 13:03:57.997630 13966 heartbeater.cc:507] Master 127.7.28.254:46727 requested a full tablet report, sending...
I20260709 13:03:57.998234  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:57.998487  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:57.998713  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602237998693 us; error 0 us; skew 500 ppm
I20260709 13:03:57.999507  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:57.999882 13690 ts_manager.cc:194] Registered new tserver with Master: 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:03:58.001669 13690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34354
I20260709 13:03:58.002450  7283 webserver.cc:533] Webserver started at http://127.7.28.196:37131/ using document root <none> and password file <none>
I20260709 13:03:58.003192  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:58.003397  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:58.003698  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:58.004933  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-3-root/instance:
uuid: "26396ddd557646e98bdbd64eba197c05"
format_stamp: "Formatted at 2026-07-09 13:03:58 on dist-test-slave-ll1f"
I20260709 13:03:58.010138  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.006s
I20260709 13:03:58.014071 13977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:58.014992  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:58.015400  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-3-root
uuid: "26396ddd557646e98bdbd64eba197c05"
format_stamp: "Formatted at 2026-07-09 13:03:58 on dist-test-slave-ll1f"
I20260709 13:03:58.015738  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:58.028903  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:58.030352  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:58.031896  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:58.034264  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:58.034512  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:58.034775  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:58.034956  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:58.078510  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.196:37991
I20260709 13:03:58.078605 14039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.196:37991 every 8 connection(s)
I20260709 13:03:58.096764 14040 heartbeater.cc:344] Connected to a master server at 127.7.28.254:46727
I20260709 13:03:58.097126 14040 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:58.098088 14040 heartbeater.cc:507] Master 127.7.28.254:46727 requested a full tablet report, sending...
I20260709 13:03:58.100030 13690 ts_manager.cc:194] Registered new tserver with Master: 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:03:58.100229  7283 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01834375s
I20260709 13:03:58.101523 13690 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34356
I20260709 13:03:58.128861 13690 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34368:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:03:58.393358 14004 tablet_service.cc:1511] Processing CreateTablet for tablet 10de0625f3be4f23896d250d94ffdd2a (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:58.395097 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10de0625f3be4f23896d250d94ffdd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.398945 14003 tablet_service.cc:1511] Processing CreateTablet for tablet 7beb6d7b3ddc4918809eb22abca298db (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:58.400419 14003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beb6d7b3ddc4918809eb22abca298db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.401202 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 983190c267f247bd8c93a67faff1a4f3 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:58.402812 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983190c267f247bd8c93a67faff1a4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.402590 13930 tablet_service.cc:1511] Processing CreateTablet for tablet 10de0625f3be4f23896d250d94ffdd2a (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:58.404088 13930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10de0625f3be4f23896d250d94ffdd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.404567 14001 tablet_service.cc:1511] Processing CreateTablet for tablet b443c5191ca74bf1afcc265171e53dd8 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:58.407034 14000 tablet_service.cc:1511] Processing CreateTablet for tablet 089b79bc7e3c4b9c9cd30f08cde86000 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:58.409886 14005 tablet_service.cc:1511] Processing CreateTablet for tablet 9da06c8013b34581b8df0cae992146fd (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:58.411679 14001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b443c5191ca74bf1afcc265171e53dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.414276 14000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089b79bc7e3c4b9c9cd30f08cde86000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.417589 14005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9da06c8013b34581b8df0cae992146fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.418284 13929 tablet_service.cc:1511] Processing CreateTablet for tablet 7beb6d7b3ddc4918809eb22abca298db (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:58.419840 13929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beb6d7b3ddc4918809eb22abca298db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.403108 14002 tablet_service.cc:1511] Processing CreateTablet for tablet b33baea2ddc640ee86529fb3d422c920 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:58.431236 14002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33baea2ddc640ee86529fb3d422c920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.432271 13928 tablet_service.cc:1511] Processing CreateTablet for tablet 7e08736e8bdd4624ae337513bd3f8903 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:58.434446 13928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e08736e8bdd4624ae337513bd3f8903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.444322 13927 tablet_service.cc:1511] Processing CreateTablet for tablet b443c5191ca74bf1afcc265171e53dd8 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:58.446533 13927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b443c5191ca74bf1afcc265171e53dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.456384 13926 tablet_service.cc:1511] Processing CreateTablet for tablet 089b79bc7e3c4b9c9cd30f08cde86000 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:58.458637 13926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089b79bc7e3c4b9c9cd30f08cde86000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.462244 13999 tablet_service.cc:1511] Processing CreateTablet for tablet 2e88dc464675442b8c7152dbf45e7b8b (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:58.463822 13999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e88dc464675442b8c7152dbf45e7b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.464242 13925 tablet_service.cc:1511] Processing CreateTablet for tablet 7618e0b5f2c44b529f37ee7481482040 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:58.466475 13925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7618e0b5f2c44b529f37ee7481482040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.472295 13924 tablet_service.cc:1511] Processing CreateTablet for tablet 88d02328b2b94a7092dbb3d0645862c0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:58.474496 13924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d02328b2b94a7092dbb3d0645862c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.484169 13998 tablet_service.cc:1511] Processing CreateTablet for tablet 88d02328b2b94a7092dbb3d0645862c0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:58.485700 13998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d02328b2b94a7092dbb3d0645862c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.501340 13997 tablet_service.cc:1511] Processing CreateTablet for tablet e80b52ff804c4785baad8cca54adc6a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:58.503043 13997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80b52ff804c4785baad8cca54adc6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.515951 13996 tablet_service.cc:1511] Processing CreateTablet for tablet 71bebeea22ca415e8b677798ee3cea04 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:58.517526 13996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bebeea22ca415e8b677798ee3cea04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.524226 13923 tablet_service.cc:1511] Processing CreateTablet for tablet e80b52ff804c4785baad8cca54adc6a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:58.526400 13923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80b52ff804c4785baad8cca54adc6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.532267 13922 tablet_service.cc:1511] Processing CreateTablet for tablet 01fa4d4f818b438ab5523c23fc40d3a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:58.534423 13922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fa4d4f818b438ab5523c23fc40d3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.560300 13782 tablet_service.cc:1511] Processing CreateTablet for tablet 9da06c8013b34581b8df0cae992146fd (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:58.560823 13781 tablet_service.cc:1511] Processing CreateTablet for tablet 983190c267f247bd8c93a67faff1a4f3 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:58.561889 13782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9da06c8013b34581b8df0cae992146fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.562539 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983190c267f247bd8c93a67faff1a4f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:58.579694 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:58.580462 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 983190c267f247bd8c93a67faff1a4f3 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:58.581463 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 9da06c8013b34581b8df0cae992146fd (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:58.582032 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983190c267f247bd8c93a67faff1a4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.582940 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9da06c8013b34581b8df0cae992146fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.591037 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 7beb6d7b3ddc4918809eb22abca298db (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:58.592662 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beb6d7b3ddc4918809eb22abca298db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.604187 14060 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:03:58.605659 13780 tablet_service.cc:1511] Processing CreateTablet for tablet 10de0625f3be4f23896d250d94ffdd2a (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:58.606166 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 7e08736e8bdd4624ae337513bd3f8903 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:58.608237 13779 tablet_service.cc:1511] Processing CreateTablet for tablet 7e08736e8bdd4624ae337513bd3f8903 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:58.608906 13929 tablet_service.cc:1511] Processing CreateTablet for tablet b86368c5ec644579a96e52be386c82f6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:58.610437 13929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86368c5ec644579a96e52be386c82f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.611146 13777 tablet_service.cc:1511] Processing CreateTablet for tablet b443c5191ca74bf1afcc265171e53dd8 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:58.615260 13775 tablet_service.cc:1511] Processing CreateTablet for tablet 2e88dc464675442b8c7152dbf45e7b8b (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:58.617731 13778 tablet_service.cc:1511] Processing CreateTablet for tablet b33baea2ddc640ee86529fb3d422c920 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:58.625830 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b443c5191ca74bf1afcc265171e53dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.617329 13930 tablet_service.cc:1511] Processing CreateTablet for tablet 217b4b051be04869b067d3f67aa80a4e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:58.630272 13853 tablet_service.cc:1511] Processing CreateTablet for tablet b33baea2ddc640ee86529fb3d422c920 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:58.631783 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33baea2ddc640ee86529fb3d422c920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.634506 13930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b4b051be04869b067d3f67aa80a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.643579 13852 tablet_service.cc:1511] Processing CreateTablet for tablet 089b79bc7e3c4b9c9cd30f08cde86000 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:58.644356 13850 tablet_service.cc:1511] Processing CreateTablet for tablet 2e88dc464675442b8c7152dbf45e7b8b (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:58.645258 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089b79bc7e3c4b9c9cd30f08cde86000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.613610 13776 tablet_service.cc:1511] Processing CreateTablet for tablet 7618e0b5f2c44b529f37ee7481482040 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:58.646943 13849 tablet_service.cc:1511] Processing CreateTablet for tablet e80b52ff804c4785baad8cca54adc6a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:58.648324 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80b52ff804c4785baad8cca54adc6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.651124 13848 tablet_service.cc:1511] Processing CreateTablet for tablet 01fa4d4f818b438ab5523c23fc40d3a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:58.652678 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fa4d4f818b438ab5523c23fc40d3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.653107 13773 tablet_service.cc:1511] Processing CreateTablet for tablet 01fa4d4f818b438ab5523c23fc40d3a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:58.646943 13851 tablet_service.cc:1511] Processing CreateTablet for tablet 7618e0b5f2c44b529f37ee7481482040 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:58.654681 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e08736e8bdd4624ae337513bd3f8903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.651351 13774 tablet_service.cc:1511] Processing CreateTablet for tablet 88d02328b2b94a7092dbb3d0645862c0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:58.656375 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 6464fa5a5f594fbd9f27a2a6f7988481 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:58.658669 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6464fa5a5f594fbd9f27a2a6f7988481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.660657 13851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7618e0b5f2c44b529f37ee7481482040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.671280 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e88dc464675442b8c7152dbf45e7b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.671463 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e08736e8bdd4624ae337513bd3f8903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.672322 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d02328b2b94a7092dbb3d0645862c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.674887 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e88dc464675442b8c7152dbf45e7b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.682240 13773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fa4d4f818b438ab5523c23fc40d3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.683561 13778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33baea2ddc640ee86529fb3d422c920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.685127 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7618e0b5f2c44b529f37ee7481482040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.687124 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10de0625f3be4f23896d250d94ffdd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.704926 13924 tablet_service.cc:1511] Processing CreateTablet for tablet ea20a419556e46b0b003c05c54815dc6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:58.706514 13924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea20a419556e46b0b003c05c54815dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.708582 14001 tablet_service.cc:1511] Processing CreateTablet for tablet b86368c5ec644579a96e52be386c82f6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:58.693168 13923 tablet_service.cc:1511] Processing CreateTablet for tablet 4207a5906547482096df3ec41328292e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:58.722630 14001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86368c5ec644579a96e52be386c82f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.731691 14061 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:03:58.732389 13926 tablet_service.cc:1511] Processing CreateTablet for tablet 27502a3045c14fbdaebb0312b250740e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:58.725737 13927 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7f9c6781bb4725847b8d5169cd3c02 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:58.735042 13923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4207a5906547482096df3ec41328292e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.756011 13926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27502a3045c14fbdaebb0312b250740e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.734903 13928 tablet_service.cc:1511] Processing CreateTablet for tablet b40d85c0caf94564b29d7771bd4691f4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:58.661561 13925 tablet_service.cc:1511] Processing CreateTablet for tablet bc903e0b117245dbaafd89c8bcf21cb5 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:58.758652 13925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc903e0b117245dbaafd89c8bcf21cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.759357 14002 tablet_service.cc:1511] Processing CreateTablet for tablet 8809c926517048778c24dfaab0d66305 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:58.762224 13927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7f9c6781bb4725847b8d5169cd3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.762550 14000 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7f9c6781bb4725847b8d5169cd3c02 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:58.765547 13999 tablet_service.cc:1511] Processing CreateTablet for tablet ea20a419556e46b0b003c05c54815dc6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:58.766155 13928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40d85c0caf94564b29d7771bd4691f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.769047 13997 tablet_service.cc:1511] Processing CreateTablet for tablet 80485db7c3b94a4db01541f0e19253f4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:58.737424 14005 tablet_service.cc:1511] Processing CreateTablet for tablet b83902dd19424f4d9f3707d53bafb0b5 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:58.740442 14004 tablet_service.cc:1511] Processing CreateTablet for tablet c9f494f81f71485b85b9551431ff68d0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:58.743814 13996 tablet_service.cc:1511] Processing CreateTablet for tablet bc903e0b117245dbaafd89c8bcf21cb5 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:58.747671 13852 tablet_service.cc:1511] Processing CreateTablet for tablet 71bebeea22ca415e8b677798ee3cea04 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:58.775259 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bebeea22ca415e8b677798ee3cea04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.748823 14003 tablet_service.cc:1511] Processing CreateTablet for tablet 217b4b051be04869b067d3f67aa80a4e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:58.751214 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 217b4b051be04869b067d3f67aa80a4e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:58.778883 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b4b051be04869b067d3f67aa80a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.751929 13922 tablet_service.cc:1511] Processing CreateTablet for tablet c9f494f81f71485b85b9551431ff68d0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:58.782349 13996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc903e0b117245dbaafd89c8bcf21cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.782677 13922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f494f81f71485b85b9551431ff68d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.784485 13817 heartbeater.cc:499] Master 127.7.28.254:46727 was elected leader, sending a full tablet report...
I20260709 13:03:58.785228 14003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b4b051be04869b067d3f67aa80a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.786362 14000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7f9c6781bb4725847b8d5169cd3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.787878 13779 tablet_service.cc:1511] Processing CreateTablet for tablet 71bebeea22ca415e8b677798ee3cea04 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:58.791887 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bebeea22ca415e8b677798ee3cea04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.790016 14002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8809c926517048778c24dfaab0d66305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.798952 13781 tablet_service.cc:1511] Processing CreateTablet for tablet b86368c5ec644579a96e52be386c82f6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:58.809145 13998 tablet_service.cc:1511] Processing CreateTablet for tablet b40d85c0caf94564b29d7771bd4691f4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:58.815546 13998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40d85c0caf94564b29d7771bd4691f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.817330 13999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea20a419556e46b0b003c05c54815dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.819532 14060 tablet_bootstrap.cc:654] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.819784 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f494f81f71485b85b9551431ff68d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.821631 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86368c5ec644579a96e52be386c82f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.822135 14005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83902dd19424f4d9f3707d53bafb0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.834008 13997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80485db7c3b94a4db01541f0e19253f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.818506 13929 tablet_service.cc:1511] Processing CreateTablet for tablet 84199221e2c348f0a790594df18c571e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:58.852802 14062 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:03:58.876717 13929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84199221e2c348f0a790594df18c571e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.876333 13926 tablet_service.cc:1511] Processing CreateTablet for tablet 894a0cf3d92b439ba443a8b917912a68 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:58.877947 13926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894a0cf3d92b439ba443a8b917912a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.880086 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 6464fa5a5f594fbd9f27a2a6f7988481 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:58.881563 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6464fa5a5f594fbd9f27a2a6f7988481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.894760 13892 heartbeater.cc:499] Master 127.7.28.254:46727 was elected leader, sending a full tablet report...
I20260709 13:03:58.869622 13927 tablet_service.cc:1511] Processing CreateTablet for tablet 9be03c00128f434fa58d0cc4ac20c104 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:58.919983 13776 tablet_service.cc:1511] Processing CreateTablet for tablet c9f494f81f71485b85b9551431ff68d0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:58.922542 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f494f81f71485b85b9551431ff68d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.923483 13927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be03c00128f434fa58d0cc4ac20c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.894954 13782 tablet_service.cc:1511] Processing CreateTablet for tablet b83902dd19424f4d9f3707d53bafb0b5 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:58.934834 13782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83902dd19424f4d9f3707d53bafb0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.939003 13780 tablet_service.cc:1511] Processing CreateTablet for tablet 4207a5906547482096df3ec41328292e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:58.940394 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4207a5906547482096df3ec41328292e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.942953 14061 tablet_bootstrap.cc:654] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.945010 13931 tablet_service.cc:1511] Processing CreateTablet for tablet e1adcb00abdc43c4a025388310386956 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:58.947373 14063 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:03:58.948180 13930 tablet_service.cc:1511] Processing CreateTablet for tablet 31306f2bb4a647168863d2675faf7f05 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:58.962809 13930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31306f2bb4a647168863d2675faf7f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.963536 14062 tablet_bootstrap.cc:654] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.963762 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 6464fa5a5f594fbd9f27a2a6f7988481 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:58.965109 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6464fa5a5f594fbd9f27a2a6f7988481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.951134 13850 tablet_service.cc:1511] Processing CreateTablet for tablet b83902dd19424f4d9f3707d53bafb0b5 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:58.966562 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83902dd19424f4d9f3707d53bafb0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.967487 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1adcb00abdc43c4a025388310386956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.970968 13855 tablet_service.cc:1511] Processing CreateTablet for tablet ea20a419556e46b0b003c05c54815dc6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:58.972353 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea20a419556e46b0b003c05c54815dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.956743 13851 tablet_service.cc:1511] Processing CreateTablet for tablet 8809c926517048778c24dfaab0d66305 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:58.973732 14063 tablet_bootstrap.cc:654] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:58.983130 13924 tablet_service.cc:1511] Processing CreateTablet for tablet cd9a5b7830c74a849bdaee0374a8cabf (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:58.984499 13924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9a5b7830c74a849bdaee0374a8cabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.951421 13849 tablet_service.cc:1511] Processing CreateTablet for tablet bc903e0b117245dbaafd89c8bcf21cb5 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:58.954265 13853 tablet_service.cc:1511] Processing CreateTablet for tablet 4207a5906547482096df3ec41328292e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:58.989071 13848 tablet_service.cc:1511] Processing CreateTablet for tablet 27502a3045c14fbdaebb0312b250740e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:58.989224 13774 tablet_service.cc:1511] Processing CreateTablet for tablet 8809c926517048778c24dfaab0d66305 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:58.990782 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8809c926517048778c24dfaab0d66305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.996928 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 80485db7c3b94a4db01541f0e19253f4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:58.978256 13851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8809c926517048778c24dfaab0d66305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.981544 13775 tablet_service.cc:1511] Processing CreateTablet for tablet 80485db7c3b94a4db01541f0e19253f4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:58.969625 14000 tablet_service.cc:1511] Processing CreateTablet for tablet 84199221e2c348f0a790594df18c571e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:58.975682 13778 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7f9c6781bb4725847b8d5169cd3c02 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:59.011656 13966 heartbeater.cc:499] Master 127.7.28.254:46727 was elected leader, sending a full tablet report...
I20260709 13:03:59.042392 13996 tablet_service.cc:1511] Processing CreateTablet for tablet 894a0cf3d92b439ba443a8b917912a68 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:59.042980 13778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7f9c6781bb4725847b8d5169cd3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:58.976764 13773 tablet_service.cc:1511] Processing CreateTablet for tablet 27502a3045c14fbdaebb0312b250740e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:59.046073 13852 tablet_service.cc:1511] Processing CreateTablet for tablet 9be03c00128f434fa58d0cc4ac20c104 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:59.046676 13773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27502a3045c14fbdaebb0312b250740e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.054792 13998 tablet_service.cc:1511] Processing CreateTablet for tablet 31306f2bb4a647168863d2675faf7f05 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:59.042397 14000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84199221e2c348f0a790594df18c571e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.023515 13923 tablet_service.cc:1511] Processing CreateTablet for tablet 2834b53c6ebc41a7998a283270aaa5ee (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:59.024492 14060 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:03:59.058295 14060 ts_tablet_manager.cc:1403] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.455s	user 0.010s	sys 0.018s
I20260709 13:03:59.058624 13923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2834b53c6ebc41a7998a283270aaa5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.027419 14061 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:03:59.062178 14061 ts_tablet_manager.cc:1403] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.331s	user 0.010s	sys 0.012s
I20260709 13:03:59.062230 13996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894a0cf3d92b439ba443a8b917912a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.065929 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4207a5906547482096df3ec41328292e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.066709 13922 tablet_service.cc:1511] Processing CreateTablet for tablet 7f75e791139c44b88609259665a1315b (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:59.067368 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc903e0b117245dbaafd89c8bcf21cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.068136 13922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f75e791139c44b88609259665a1315b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.069321 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80485db7c3b94a4db01541f0e19253f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.029881 13928 tablet_service.cc:1511] Processing CreateTablet for tablet 17b73e3362554ac58453d81770b9ad6f (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:59.030224 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 84199221e2c348f0a790594df18c571e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:59.031726 13925 tablet_service.cc:1511] Processing CreateTablet for tablet 17b2ce1afe6d47889a4314aacc80c2d1 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:59.033380 13997 tablet_service.cc:1511] Processing CreateTablet for tablet 17b2ce1afe6d47889a4314aacc80c2d1 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:59.086885 13928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b73e3362554ac58453d81770b9ad6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.087656 13925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2ce1afe6d47889a4314aacc80c2d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.052237 14001 tablet_service.cc:1511] Processing CreateTablet for tablet d165767a6eb84e0ab6e475cb48c542ae (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:59.071144 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80485db7c3b94a4db01541f0e19253f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.034533 13927 tablet_service.cc:1511] Processing CreateTablet for tablet d3ea2a360d5a4c0b86b352b5c79e3756 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:59.096107 13927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ea2a360d5a4c0b86b352b5c79e3756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.071106 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be03c00128f434fa58d0cc4ac20c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.093314 13780 tablet_service.cc:1511] Processing CreateTablet for tablet 894a0cf3d92b439ba443a8b917912a68 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:59.074860 14061 raft_consensus.cc:359] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.099086 14061 raft_consensus.cc:385] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.099277 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894a0cf3d92b439ba443a8b917912a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.099435 14061 raft_consensus.cc:740] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.100672 14061 consensus_queue.cc:260] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.104341 14040 heartbeater.cc:499] Master 127.7.28.254:46727 was elected leader, sending a full tablet report...
I20260709 13:03:59.061313 14060 raft_consensus.cc:359] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.107277 14060 raft_consensus.cc:385] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.107731 14060 raft_consensus.cc:740] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.108057 13998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31306f2bb4a647168863d2675faf7f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.109220 13997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2ce1afe6d47889a4314aacc80c2d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.076212 13781 tablet_service.cc:1511] Processing CreateTablet for tablet b40d85c0caf94564b29d7771bd4691f4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:59.112206 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40d85c0caf94564b29d7771bd4691f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.113526 13926 tablet_service.cc:1511] Processing CreateTablet for tablet 160582a28a9446428b13a46b942d62dc (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:59.112226 14060 consensus_queue.cc:260] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:58.973838 14004 tablet_service.cc:1511] Processing CreateTablet for tablet 92c8aaedf9904579b4f3e13ba43661bc (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:59.092724 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 9be03c00128f434fa58d0cc4ac20c104 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:59.084229 13782 tablet_service.cc:1511] Processing CreateTablet for tablet 92c8aaedf9904579b4f3e13ba43661bc (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:59.122442 14060 ts_tablet_manager.cc:1434] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:03:59.123710 14060 tablet_bootstrap.cc:492] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:03:59.124758 14063 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:03:59.125365 14063 ts_tablet_manager.cc:1403] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.178s	user 0.020s	sys 0.007s
I20260709 13:03:59.128840 14063 raft_consensus.cc:359] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.129659 14063 raft_consensus.cc:385] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.130020 14063 raft_consensus.cc:740] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.130870 14063 consensus_queue.cc:260] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.134421 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be03c00128f434fa58d0cc4ac20c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.145977 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27502a3045c14fbdaebb0312b250740e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.147120 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84199221e2c348f0a790594df18c571e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.152067 14062 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:03:59.152629 14062 ts_tablet_manager.cc:1403] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.300s	user 0.021s	sys 0.005s
I20260709 13:03:59.154446 13776 tablet_service.cc:1511] Processing CreateTablet for tablet e1adcb00abdc43c4a025388310386956 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:59.155148 14001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d165767a6eb84e0ab6e475cb48c542ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.155983 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1adcb00abdc43c4a025388310386956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.156143 14062 raft_consensus.cc:359] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.157080 14062 raft_consensus.cc:385] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.157446 14062 raft_consensus.cc:740] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.158408 14062 consensus_queue.cc:260] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.132822 14003 tablet_service.cc:1511] Processing CreateTablet for tablet cd9a5b7830c74a849bdaee0374a8cabf (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:59.164609 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c8aaedf9904579b4f3e13ba43661bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.169888 14005 tablet_service.cc:1511] Processing CreateTablet for tablet df17443f0bfc4fd69e14026addccdbf0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:59.172745 14002 tablet_service.cc:1511] Processing CreateTablet for tablet 2834b53c6ebc41a7998a283270aaa5ee (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:59.174718 13779 tablet_service.cc:1511] Processing CreateTablet for tablet d165767a6eb84e0ab6e475cb48c542ae (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:59.175498 13926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160582a28a9446428b13a46b942d62dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.177963 13999 tablet_service.cc:1511] Processing CreateTablet for tablet 17b73e3362554ac58453d81770b9ad6f (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:59.178905 13924 tablet_service.cc:1511] Processing CreateTablet for tablet 10a7704202b34ee8a6faee074094ba82 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:59.184667 13923 tablet_service.cc:1511] Processing CreateTablet for tablet 335fd22e76d14ce5822297f3f534fb0c (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:59.187970 14063 ts_tablet_manager.cc:1434] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.004s
I20260709 13:03:59.149822 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 92c8aaedf9904579b4f3e13ba43661bc (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:59.222409 14063 tablet_bootstrap.cc:492] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:03:59.222190 13922 tablet_service.cc:1511] Processing CreateTablet for tablet 8184075bc04f4f209f3b9d4f56d1522a (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:59.222393 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c8aaedf9904579b4f3e13ba43661bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.228145 13923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335fd22e76d14ce5822297f3f534fb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.231695 14063 tablet_bootstrap.cc:654] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.234529 13922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8184075bc04f4f209f3b9d4f56d1522a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.235277 13780 tablet_service.cc:1511] Processing CreateTablet for tablet d3ea2a360d5a4c0b86b352b5c79e3756 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:59.225195 13778 tablet_service.cc:1511] Processing CreateTablet for tablet 31306f2bb4a647168863d2675faf7f05 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:03:59.237953 13967 tablet.cc:2406] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:59.239753 13854 tablet_service.cc:1511] Processing CreateTablet for tablet e1adcb00abdc43c4a025388310386956 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:59.241303 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1adcb00abdc43c4a025388310386956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.196974 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 17b2ce1afe6d47889a4314aacc80c2d1 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:59.207028 13929 tablet_service.cc:1511] Processing CreateTablet for tablet 54fb16a8c2034fd2bbc250bf493ee9ca (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:59.242780 13929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fb16a8c2034fd2bbc250bf493ee9ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.244655 13773 tablet_service.cc:1511] Processing CreateTablet for tablet df17443f0bfc4fd69e14026addccdbf0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:59.219434 14071 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.221025 14061 ts_tablet_manager.cc:1434] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.158s	user 0.004s	sys 0.012s
I20260709 13:03:59.246673 14071 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.247663 14061 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:03:59.261231 14071 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:03:59.262936 14005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df17443f0bfc4fd69e14026addccdbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.263321 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2ce1afe6d47889a4314aacc80c2d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.273072 13996 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc6c842bcd947ef97971e5b80b2fce4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:59.269209 13782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c8aaedf9904579b4f3e13ba43661bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.309090 13925 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6ce7c8d44a4c72a07abbf0467105e6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:59.310774 13850 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6ce7c8d44a4c72a07abbf0467105e6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:59.312316 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6ce7c8d44a4c72a07abbf0467105e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.315798 13930 tablet_service.cc:1511] Processing CreateTablet for tablet f3d96cc6c31040cead99c79b8a080c49 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:59.317993 13778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31306f2bb4a647168863d2675faf7f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.318498 13924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a7704202b34ee8a6faee074094ba82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.318985 13775 tablet_service.cc:1511] Processing CreateTablet for tablet 2834b53c6ebc41a7998a283270aaa5ee (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:59.320372 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2834b53c6ebc41a7998a283270aaa5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.321596 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d165767a6eb84e0ab6e475cb48c542ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.325917 13999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b73e3362554ac58453d81770b9ad6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.326216 13930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d96cc6c31040cead99c79b8a080c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.330209 13773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df17443f0bfc4fd69e14026addccdbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.293913 14061 tablet_bootstrap.cc:654] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.335871 14062 ts_tablet_manager.cc:1434] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.183s	user 0.007s	sys 0.018s
I20260709 13:03:59.315919 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 244ea1e7aee643d2b606db7cd01d5346 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:59.321209 13848 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbed8f0ccba4b5fabb54cdb9abcead1 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:59.341399 13925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6ce7c8d44a4c72a07abbf0467105e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.357532 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244ea1e7aee643d2b606db7cd01d5346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.358355 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbed8f0ccba4b5fabb54cdb9abcead1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.362357 13853 tablet_service.cc:1511] Processing CreateTablet for tablet d165767a6eb84e0ab6e475cb48c542ae (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:59.363855 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d165767a6eb84e0ab6e475cb48c542ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.354626 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ea2a360d5a4c0b86b352b5c79e3756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.367250 14003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9a5b7830c74a849bdaee0374a8cabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.372797 14062 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:03:59.386289 14061 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:03:59.386884 14061 ts_tablet_manager.cc:1403] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.139s	user 0.004s	sys 0.024s
I20260709 13:03:59.390959 13997 tablet_service.cc:1511] Processing CreateTablet for tablet 160582a28a9446428b13a46b942d62dc (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:59.396505 14000 tablet_service.cc:1511] Processing CreateTablet for tablet 10a7704202b34ee8a6faee074094ba82 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:59.411222 13774 tablet_service.cc:1511] Processing CreateTablet for tablet 7f75e791139c44b88609259665a1315b (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:59.412672 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f75e791139c44b88609259665a1315b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.413501 13781 tablet_service.cc:1511] Processing CreateTablet for tablet 23ba395804274ae6b50899d3c4839734 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:59.417986 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ba395804274ae6b50899d3c4839734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.399861 13998 tablet_service.cc:1511] Processing CreateTablet for tablet 23ba395804274ae6b50899d3c4839734 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:59.382115 14070 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.421412 14070 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.424067 14070 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:03:59.406819 13855 tablet_service.cc:1511] Processing CreateTablet for tablet df17443f0bfc4fd69e14026addccdbf0 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:59.385871 13849 tablet_service.cc:1511] Processing CreateTablet for tablet cd9a5b7830c74a849bdaee0374a8cabf (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:59.412586 13926 tablet_service.cc:1511] Processing CreateTablet for tablet 8797238dd5cd494e936f80a38430878c (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:59.425233 13929 tablet_service.cc:1511] Processing CreateTablet for tablet a350bf7b4479428fa79f9b4aa9036423 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:59.402845 13927 tablet_service.cc:1511] Processing CreateTablet for tablet ec8e2fbb0a1541e7b82f6112cabed288 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:59.400810 13851 tablet_service.cc:1511] Processing CreateTablet for tablet d3ea2a360d5a4c0b86b352b5c79e3756 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:59.431618 14060 tablet_bootstrap.cc:654] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.443994 13996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc6c842bcd947ef97971e5b80b2fce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.417639 14001 tablet_service.cc:1511] Processing CreateTablet for tablet 54fb16a8c2034fd2bbc250bf493ee9ca (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:59.458261 13929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350bf7b4479428fa79f9b4aa9036423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.464193 14002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2834b53c6ebc41a7998a283270aaa5ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.447209 14061 raft_consensus.cc:359] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:03:59.475093 13778 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc6c842bcd947ef97971e5b80b2fce4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:59.476555 13778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc6c842bcd947ef97971e5b80b2fce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.490531 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 160582a28a9446428b13a46b942d62dc (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:59.491997 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160582a28a9446428b13a46b942d62dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.508544 13927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8e2fbb0a1541e7b82f6112cabed288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.509675 14005 tablet_service.cc:1511] Processing CreateTablet for tablet f3d96cc6c31040cead99c79b8a080c49 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:59.510910 14062 tablet_bootstrap.cc:654] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.511071 13997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160582a28a9446428b13a46b942d62dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.512976 14069 raft_consensus.cc:493] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.477106 14061 raft_consensus.cc:385] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.543319 14063 tablet_bootstrap.cc:492] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:03:59.543948 14063 ts_tablet_manager.cc:1403] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.322s	user 0.024s	sys 0.019s
I20260709 13:03:59.544710 14061 raft_consensus.cc:740] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.517063 14004 tablet_service.cc:1511] Processing CreateTablet for tablet 8184075bc04f4f209f3b9d4f56d1522a (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:59.546478 14061 consensus_queue.cc:260] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:03:59.522133 14000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a7704202b34ee8a6faee074094ba82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.523495 13926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8797238dd5cd494e936f80a38430878c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.513523 14069 raft_consensus.cc:515] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.531255 13851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ea2a360d5a4c0b86b352b5c79e3756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.533443 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 17b73e3362554ac58453d81770b9ad6f (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:59.548982 13931 tablet_service.cc:1511] Processing CreateTablet for tablet 045c882b5c9b44cb867d853eb82d3f86 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:59.520951 13930 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbed8f0ccba4b5fabb54cdb9abcead1 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:59.550096 14068 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.558535 14069 leader_election.cc:290] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:03:59.570580 14068 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:03:59.571590 14063 raft_consensus.cc:359] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:03:59.572386 14063 raft_consensus.cc:385] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.573683 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b73e3362554ac58453d81770b9ad6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.572660 14063 raft_consensus.cc:740] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.573616 14068 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:03:59.596859 14061 ts_tablet_manager.cc:1434] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.210s	user 0.004s	sys 0.009s
I20260709 13:03:59.598625 14061 tablet_bootstrap.cc:492] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:03:59.604887 13776 tablet_service.cc:1511] Processing CreateTablet for tablet 335fd22e76d14ce5822297f3f534fb0c (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:59.549779 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc6c842bcd947ef97971e5b80b2fce4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 13:03:59.611943 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:59.586736 14004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8184075bc04f4f209f3b9d4f56d1522a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.589287 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df17443f0bfc4fd69e14026addccdbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.533535 13852 tablet_service.cc:1511] Processing CreateTablet for tablet 7f75e791139c44b88609259665a1315b (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:59.636806 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335fd22e76d14ce5822297f3f534fb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.639263 13930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbed8f0ccba4b5fabb54cdb9abcead1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.644584 13999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 29) took 1077 ms. Trace:
I20260709 13:03:59.631573 14063 consensus_queue.cc:260] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:03:59.657989 14070 raft_consensus.cc:493] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.658535 14070 raft_consensus.cc:515] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:03:59.662577 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9a5b7830c74a849bdaee0374a8cabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.675205 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 335fd22e76d14ce5822297f3f534fb0c (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:59.677883 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f75e791139c44b88609259665a1315b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.678491 14070 leader_election.cc:290] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:03:59.681674 13999 rpcz_store.cc:276] 0709 13:03:58.567648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.176996 (+609348us) service_pool.cc:224] Handling call
0709 13:03:59.271823 (+ 94827us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b58000c4598. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe1851b831 00007fbe184f8ac3 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82 00007fbe1192c9b1
0709 13:03:59.272064 (+   241us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.272202 (+   138us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.476881 (+204679us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.642412 (+165531us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.644519 (+  2107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10210688}
I20260709 13:03:59.684341 13999 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef26422e31c46fe8f63d4388ae021a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:59.688059 13779 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6ce7c8d44a4c72a07abbf0467105e6 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:59.653427 13848 tablet_service.cc:1511] Processing CreateTablet for tablet 10a7704202b34ee8a6faee074094ba82 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:59.699812 13998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ba395804274ae6b50899d3c4839734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.701889 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a7704202b34ee8a6faee074094ba82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.704648 14001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fb16a8c2034fd2bbc250bf493ee9ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.713578 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335fd22e76d14ce5822297f3f534fb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.647248 13775 tablet_service.cc:1511] Processing CreateTablet for tablet 54fb16a8c2034fd2bbc250bf493ee9ca (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:59.690649 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6ce7c8d44a4c72a07abbf0467105e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.758425 13931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 045c882b5c9b44cb867d853eb82d3f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.760382 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc6c842bcd947ef97971e5b80b2fce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.788950 14085 raft_consensus.cc:493] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.693411 13850 tablet_service.cc:1511] Processing CreateTablet for tablet 23ba395804274ae6b50899d3c4839734 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:59.789605 14085 raft_consensus.cc:515] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:03:59.790719 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ba395804274ae6b50899d3c4839734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.792613 14085 leader_election.cc:290] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:03:59.774396 13777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 32) took 1035 ms. Trace:
I20260709 13:03:59.784365 13782 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 22) took 1084 ms. Trace:
I20260709 13:03:59.760264 14005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d96cc6c31040cead99c79b8a080c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.771031 13781 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 34) took 1031 ms. Trace:
I20260709 13:03:59.796844 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fb16a8c2034fd2bbc250bf493ee9ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.791712 13776 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 33) took 1052 ms. Trace:
I20260709 13:03:59.822983 13776 rpcz_store.cc:276] 0709 13:03:58.739131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.603911 (+864780us) service_pool.cc:224] Handling call
0709 13:03:59.618920 (+ 15009us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.630538 (+ 11618us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.777826 (+147288us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.791026 (+ 13200us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.791624 (+   598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.811811 13781 rpcz_store.cc:276] 0709 13:03:58.739461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.388887 (+649426us) service_pool.cc:224] Handling call
0709 13:03:59.417478 (+ 28591us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.417581 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.627405 (+209824us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.770369 (+142964us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.770954 (+   585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.829468 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:03:59.821343 13774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 30) took 1081 ms. Trace:
I20260709 13:03:59.833019 13778 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 31) took 1093 ms. Trace:
I20260709 13:03:59.798280 13777 rpcz_store.cc:276] 0709 13:03:58.738801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.450411 (+711610us) service_pool.cc:224] Handling call
0709 13:03:59.491505 (+ 41094us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.491602 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.610742 (+119140us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.773680 (+162938us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.774315 (+   635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.851585 13854 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 33) took 1116 ms. Trace:
I20260709 13:03:59.857049 13780 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 27) took 1155 ms. Trace:
I20260709 13:03:59.859884 13850 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 34) took 1124 ms. Trace:
I20260709 13:03:59.908883 13850 rpcz_store.cc:276] 0709 13:03:58.735095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.692066 (+956971us) service_pool.cc:224] Handling call
0709 13:03:59.790177 (+ 98111us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.790290 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.851316 (+ 61026us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.859159 (+  7843us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.859814 (+   655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.910065 14060 tablet_bootstrap.cc:492] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:03:59.910652 14060 ts_tablet_manager.cc:1403] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.787s	user 0.025s	sys 0.019s
I20260709 13:03:59.911160 13850 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef26422e31c46fe8f63d4388ae021a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:59.912714 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef26422e31c46fe8f63d4388ae021a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.798537 13782 rpcz_store.cc:276] 0709 13:03:58.699452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.082679 (+383227us) service_pool.cc:224] Handling call
0709 13:03:59.163628 (+ 80949us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b5800000c98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe1851b831 00007fbe184f8ac3 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82 00007fbe1192c9b1
0709 13:03:59.163798 (+   170us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.163896 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.642355 (+478459us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.783845 (+141490us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.784292 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66586880}
I20260709 13:03:59.862378 13781 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef26422e31c46fe8f63d4388ae021a4 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:59.881376 13778 rpcz_store.cc:276] 0709 13:03:58.738459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.446804 (+708345us) service_pool.cc:224] Handling call
0709 13:03:59.476078 (+ 29274us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.476170 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.590254 (+114084us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.794567 (+204313us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.831714 (+ 37147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.914712 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef26422e31c46fe8f63d4388ae021a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.915210 13782 tablet_service.cc:1511] Processing CreateTablet for tablet 244ea1e7aee643d2b606db7cd01d5346 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:59.915694 13778 tablet_service.cc:1511] Processing CreateTablet for tablet e974506c09fa4bc481abf11343fdbf3e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:59.916613 13782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244ea1e7aee643d2b606db7cd01d5346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.865907 13851 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 27) took 1133 ms. Trace:
I20260709 13:03:59.869014 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:03:59.841288 13774 rpcz_store.cc:276] 0709 13:03:58.738048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.410234 (+672186us) service_pool.cc:224] Handling call
0709 13:03:59.412143 (+  1909us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.412259 (+   116us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.616560 (+204301us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.761162 (+144602us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.819706 (+ 58544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.920042 13774 tablet_service.cc:1511] Processing CreateTablet for tablet 045c882b5c9b44cb867d853eb82d3f86 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:59.921433 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 045c882b5c9b44cb867d853eb82d3f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.836403 13867 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:03:59.840339 13999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef26422e31c46fe8f63d4388ae021a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:59.923264 13907 leader_election.cc:343] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.875972 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:03:59.924049 14015 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:03:59.862527 14063 ts_tablet_manager.cc:1434] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.318s	user 0.010s	sys 0.015s
I20260709 13:03:59.924579 13757 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:03:59.925848 14063 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:03:59.883523 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbed8f0ccba4b5fabb54cdb9abcead1 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:59.930573 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbed8f0ccba4b5fabb54cdb9abcead1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.930469 13927 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57228 (request call id 43) took 1058 ms. Trace:
I20260709 13:03:59.931042 13927 rpcz_store.cc:276] 0709 13:03:58.872075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.367474 (+495399us) service_pool.cc:224] Handling call
0709 13:03:59.458518 (+ 91044us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.466177 (+  7659us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.723474 (+257297us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.929952 (+206478us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.930406 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.933200 13778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e974506c09fa4bc481abf11343fdbf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.925693 13851 rpcz_store.cc:276] 0709 13:03:58.732793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.399559 (+666766us) service_pool.cc:224] Handling call
0709 13:03:59.530723 (+131164us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.530842 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.654052 (+123210us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.865303 (+211251us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.865838 (+   535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.936058 13851 tablet_service.cc:1511] Processing CreateTablet for tablet 8797238dd5cd494e936f80a38430878c (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:59.892719 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089b79bc7e3c4b9c9cd30f08cde86000" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:03:59.896482 14061 tablet_bootstrap.cc:654] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:59.902458 13776 tablet_service.cc:1511] Processing CreateTablet for tablet f3d96cc6c31040cead99c79b8a080c49 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:59.905565 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:03:59.907853 13780 rpcz_store.cc:276] 0709 13:03:58.701130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.225526 (+524396us) service_pool.cc:224] Handling call
0709 13:03:59.236226 (+ 10700us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.236326 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.673930 (+437604us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.856410 (+182480us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.856965 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.880856 13853 tablet_service.cc:1511] Processing CreateTablet for tablet 8184075bc04f4f209f3b9d4f56d1522a (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:59.969089 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d96cc6c31040cead99c79b8a080c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.969780 13780 tablet_service.cc:1511] Processing CreateTablet for tablet c945695696fc4b6a9ad5becbe6a236a7 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:03:59.969501 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 45091.2us
I20260709 13:03:59.971235 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c945695696fc4b6a9ad5becbe6a236a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.886524 13773 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 28) took 1185 ms. Trace:
I20260709 13:03:59.880510 14062 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:03:59.978430 14062 ts_tablet_manager.cc:1403] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.625s	user 0.019s	sys 0.012s
W20260709 13:03:59.943612 13831 leader_election.cc:343] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:59.947860 13851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8797238dd5cd494e936f80a38430878c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.951329 13855 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 28) took 1218 ms. Trace:
I20260709 13:03:59.959345 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:03:59.917829 13779 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 36) took 1177 ms. Trace:
I20260709 13:03:59.961577 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089b79bc7e3c4b9c9cd30f08cde86000" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:03:59.978579 14060 raft_consensus.cc:359] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:03:59.994082 14060 raft_consensus.cc:385] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:59.987923 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:03:59.985744 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8184075bc04f4f209f3b9d4f56d1522a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.994669 13866 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:03:59.987452 13779 rpcz_store.cc:276] 0709 13:03:58.740135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.687014 (+946879us) service_pool.cc:224] Handling call
0709 13:03:59.689514 (+  2500us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.689740 (+   226us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.899922 (+210182us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.916567 (+ 16645us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.917564 (+   997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.995613 14060 raft_consensus.cc:740] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.996572 13779 tablet_service.cc:1511] Processing CreateTablet for tablet ec8e2fbb0a1541e7b82f6112cabed288 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:59.996673 14060 consensus_queue.cc:260] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:03:59.986307 14015 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:03:59.998095 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8e2fbb0a1541e7b82f6112cabed288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:59.983292 13773 rpcz_store.cc:276] 0709 13:03:58.701451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.243656 (+542205us) service_pool.cc:224] Handling call
0709 13:03:59.245583 (+  1927us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.245779 (+   196us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.663039 (+417260us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.885898 (+222859us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.886454 (+   556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.004909 13997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 31) took 1435 ms. Trace:
I20260709 13:04:00.005475 13997 rpcz_store.cc:276] 0709 13:03:58.569347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.389842 (+820495us) service_pool.cc:224] Handling call
0709 13:03:59.392099 (+  2257us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.392219 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.776564 (+384345us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.004243 (+227679us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.004834 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.993477 14063 tablet_bootstrap.cc:654] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.008392 13848 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 32) took 1274 ms. Trace:
I20260709 13:03:59.985988 13855 rpcz_store.cc:276] 0709 13:03:58.733121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.405863 (+672742us) service_pool.cc:224] Handling call
0709 13:03:59.530539 (+124676us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b5800110d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2eee 0000000000375939 00007fbe184361e0 00007fbe1851b84c 00007fbe184f8ac3 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82 00007fbe1192c9b1
0709 13:03:59.532095 (+  1556us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.532191 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.787289 (+255098us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.873720 (+ 86431us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.951263 (+ 77543us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12760832}
I20260709 13:04:00.011938 13855 tablet_service.cc:1511] Processing CreateTablet for tablet e974506c09fa4bc481abf11343fdbf3e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:03:59.988395 13832 leader_election.cc:343] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.013288 13832 leader_election.cc:304] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:00.014333 14094 raft_consensus.cc:2749] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.015029 13980 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:00.015990 14085 raft_consensus.cc:2804] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.016357 14085 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.016713 14085 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.021931 13996 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 30) took 1453 ms. Trace:
I20260709 13:04:00.022418 13996 rpcz_store.cc:276] 0709 13:03:58.568502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.272017 (+703515us) service_pool.cc:224] Handling call
0709 13:03:59.274231 (+  2214us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.274348 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.857347 (+582999us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.021381 (+164034us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.021863 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.023666 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:00.024386 13792 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:00.025318 14060 ts_tablet_manager.cc:1434] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.000s
I20260709 13:04:00.026304 13996 tablet_service.cc:1511] Processing CreateTablet for tablet e974506c09fa4bc481abf11343fdbf3e (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:00.027923 13833 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
W20260709 13:03:59.986588 13906 leader_election.cc:343] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.030746 13906 leader_election.cc:304] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.030884 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:00.031497 13792 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
W20260709 13:04:00.031761 13906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 45369.6us
I20260709 13:03:59.981662 14062 raft_consensus.cc:359] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.032596 14094 raft_consensus.cc:2804] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.032503 14069 raft_consensus.cc:2749] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.033190 14094 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.033591 14094 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:59.907128 13854 rpcz_store.cc:276] 0709 13:03:58.734765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.674112 (+939347us) service_pool.cc:224] Handling call
0709 13:03:59.676327 (+  2215us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.676435 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.804220 (+127785us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.850990 (+ 46770us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.851513 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.032927 14062 raft_consensus.cc:385] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.035509 14062 raft_consensus.cc:740] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.036298 14062 consensus_queue.cc:260] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.036449 13854 tablet_service.cc:1511] Processing CreateTablet for tablet a350bf7b4479428fa79f9b4aa9036423 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:00.040740 14085 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.041102 14094 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.009091 13848 rpcz_store.cc:276] 0709 13:03:58.734435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.652064 (+917629us) service_pool.cc:224] Handling call
0709 13:03:59.701310 (+ 49246us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.701437 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.943409 (+241972us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.007818 (+ 64409us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.008330 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.991816 13931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57228 (request call id 42) took 1120 ms. Trace:
I20260709 13:03:59.984414 13930 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57228 (request call id 39) took 1113 ms. Trace:
I20260709 13:04:00.030217 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.071775 13930 rpcz_store.cc:276] 0709 13:03:58.870859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.507119 (+636260us) service_pool.cc:224] Handling call
0709 13:03:59.580882 (+ 73763us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.589438 (+  8556us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.895347 (+305909us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.983797 (+ 88450us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.984344 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.067970 13996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e974506c09fa4bc481abf11343fdbf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.029987 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:00.068748 13775 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 35) took 1329 ms. Trace:
I20260709 13:04:00.078950 13775 rpcz_store.cc:276] 0709 13:03:58.739765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.646166 (+906401us) service_pool.cc:224] Handling call
0709 13:03:59.722288 (+ 76122us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.722396 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.901518 (+179122us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.068214 (+166696us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.068687 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.070722 13852 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 30) took 1337 ms. Trace:
I20260709 13:04:00.063350 13931 rpcz_store.cc:276] 0709 13:03:58.871771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.543893 (+672122us) service_pool.cc:224] Handling call
0709 13:03:59.617118 (+ 73225us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800421e98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c31a2 00007fbe19304bb9 00007fbe18435d88 00007fbe184f8b80 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82 00007fbe1192c9b1 00007fbe1192c92c
0709 13:03:59.617204 (+    86us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.617317 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.922413 (+305096us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.991181 (+ 68768us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:59.991747 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933504}
I20260709 13:04:00.080540 13852 rpcz_store.cc:276] 0709 13:03:58.733752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.532501 (+798749us) service_pool.cc:224] Handling call
0709 13:03:59.639901 (+107400us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.657042 (+ 17141us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.869405 (+212363us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:59.997648 (+128243us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.070365 (+ 72717us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5800110d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c31a2 00007fbe19304bb9 00007fbe18435d88 00007fbe184fc973 00007fbe184f870f 00007fbe184f8ecd 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82
0709 13:04:00.070666 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37700992}
I20260709 13:04:00.067795 13857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 31) took 1333 ms. Trace:
I20260709 13:04:00.082401 14094 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:00.083274 13852 tablet_service.cc:1511] Processing CreateTablet for tablet c945695696fc4b6a9ad5becbe6a236a7 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:04:00.081202 13979 leader_election.cc:343] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.084692 13782 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 41) took 1290 ms. Trace:
I20260709 13:04:00.082125 13857 rpcz_store.cc:276] 0709 13:03:58.734099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.548866 (+814767us) service_pool.cc:224] Handling call
0709 13:03:59.606171 (+ 57305us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.606262 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.852777 (+246515us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.023005 (+170228us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.067467 (+ 44462us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b5800110d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c330e 00007fbe19304bf9 00007fbe18435e51 00007fbe184fcb1b 00007fbe184f870f 00007fbe184f8ecd 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82
0709 13:04:00.067733 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6698240}
I20260709 13:04:00.086782 14060 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:00.088531 14001 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 34) took 1442 ms. Trace:
I20260709 13:04:00.089154 14001 rpcz_store.cc:276] 0709 13:03:58.646223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.416674 (+770451us) service_pool.cc:224] Handling call
0709 13:03:59.477361 (+ 60687us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.502648 (+ 25287us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.927669 (+425021us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.087872 (+160203us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.088471 (+   599us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.090683 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e974506c09fa4bc481abf11343fdbf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.091107 14005 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 37) took 1435 ms. Trace:
I20260709 13:04:00.091535 14005 rpcz_store.cc:276] 0709 13:03:58.655519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.508669 (+853150us) service_pool.cc:224] Handling call
0709 13:03:59.510642 (+  1973us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.510769 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.016670 (+505901us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.090467 (+ 73797us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.091027 (+   560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.091118 14098 raft_consensus.cc:2804] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.008486 13997 tablet_service.cc:1511] Processing CreateTablet for tablet 8797238dd5cd494e936f80a38430878c (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:00.095144 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:00.094444 14098 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.095827 13997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8797238dd5cd494e936f80a38430878c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.095984 14015 raft_consensus.cc:2393] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 97c52f3e93434bedbdc9755e64f33d4f in current term 1: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:00.096067 14098 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.093544 14005 tablet_service.cc:1511] Processing CreateTablet for tablet 244ea1e7aee643d2b606db7cd01d5346 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:00.066902 13998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 33) took 1495 ms. Trace:
I20260709 13:04:00.085101 13782 rpcz_store.cc:276] 0709 13:03:58.794779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.914204 (+1119425us) service_pool.cc:224] Handling call
0709 13:03:59.916154 (+  1950us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.916253 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.999484 (+ 83231us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.084145 (+ 84661us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.084634 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.102180 13998 rpcz_store.cc:276] 0709 13:03:58.571154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.398870 (+827716us) service_pool.cc:224] Handling call
0709 13:03:59.418709 (+ 19839us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.418808 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.976647 (+557839us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.066317 (+ 89670us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.066835 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646}
I20260709 13:04:00.103223 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c945695696fc4b6a9ad5becbe6a236a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.104212 13856 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 29) took 1370 ms. Trace:
I20260709 13:04:00.102962 14005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244ea1e7aee643d2b606db7cd01d5346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.104632 13856 rpcz_store.cc:276] 0709 13:03:58.733425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.532436 (+799011us) service_pool.cc:224] Handling call
0709 13:03:59.573159 (+ 40723us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.573278 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.891364 (+318086us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.103464 (+212100us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.104145 (+   681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.103086 14069 raft_consensus.cc:493] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.105484 14001 tablet_service.cc:1511] Processing CreateTablet for tablet c945695696fc4b6a9ad5becbe6a236a7 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:00.106060 14069 raft_consensus.cc:515] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.106853 14001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c945695696fc4b6a9ad5becbe6a236a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.108595 14069 leader_election.cc:290] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.031814 14000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 32) took 1461 ms. Trace:
I20260709 13:04:00.067746 13848 tablet_service.cc:1511] Processing CreateTablet for tablet 045c882b5c9b44cb867d853eb82d3f86 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:00.110401 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb6d7b3ddc4918809eb22abca298db" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.111239 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 045c882b5c9b44cb867d853eb82d3f86. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:00.113427 13906 leader_election.cc:343] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.072460 13849 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 26) took 1340 ms. Trace:
I20260709 13:04:00.124807 13777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 39) took 1383 ms. Trace:
I20260709 13:04:00.122347 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350bf7b4479428fa79f9b4aa9036423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.123101 13998 tablet_service.cc:1511] Processing CreateTablet for tablet a350bf7b4479428fa79f9b4aa9036423 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:00.123775 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb6d7b3ddc4918809eb22abca298db" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.124652 13849 rpcz_store.cc:276] 0709 13:03:58.732461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.384862 (+652401us) service_pool.cc:224] Handling call
0709 13:03:59.457739 (+ 72877us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800110d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe1851b831 00007fbe184f8ac3 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82 00007fbe1192c9b1
0709 13:03:59.531530 (+ 73791us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.531641 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.908220 (+376579us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.012194 (+103974us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.063536 (+ 51342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2694016}
I20260709 13:04:00.110008 14000 rpcz_store.cc:276] 0709 13:03:58.570281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.395519 (+825238us) service_pool.cc:224] Handling call
0709 13:03:59.411223 (+ 15704us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.411325 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.920023 (+508698us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.031250 (+111227us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.031750 (+   500us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.126772 13850 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 37) took 1390 ms. Trace:
I20260709 13:04:00.128901 14003 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 26) took 1564 ms. Trace:
I20260709 13:04:00.131067 13778 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 40) took 1336 ms. Trace:
I20260709 13:04:00.131616 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
W20260709 13:04:00.131789 13981 leader_election.cc:343] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.133911 13781 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 37) took 1393 ms. Trace:
I20260709 13:04:00.134359 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:00.145835 13866 raft_consensus.cc:2393] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 1: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
I20260709 13:04:00.162601 13781 rpcz_store.cc:276] 0709 13:03:58.740440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.830659 (+1090219us) service_pool.cc:224] Handling call
0709 13:03:59.914189 (+ 83530us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.914296 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.951248 (+ 36952us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.133323 (+182075us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.133844 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.146044 14063 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:00.165370 14063 ts_tablet_manager.cc:1403] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.240s	user 0.020s	sys 0.011s
I20260709 13:04:00.167510 13926 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57228 (request call id 38) took 1297 ms. Trace:
I20260709 13:04:00.167994 13926 rpcz_store.cc:276] 0709 13:03:58.870537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.411703 (+541166us) service_pool.cc:224] Handling call
0709 13:03:59.445757 (+ 34054us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.450355 (+  4598us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.999539 (+549184us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.166950 (+167411us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.167443 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:00.146456 13906 leader_election.cc:343] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.143019 14003 rpcz_store.cc:276] 0709 13:03:58.564848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.080651 (+515803us) service_pool.cc:224] Handling call
0709 13:03:59.206112 (+125461us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.206262 (+   150us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.902048 (+695786us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.128352 (+226304us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.128834 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.147053 13981 leader_election.cc:304] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.141631 13850 rpcz_store.cc:276] 0709 13:03:58.736084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.910098 (+1174014us) service_pool.cc:224] Handling call
0709 13:03:59.912162 (+  2064us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.912279 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.013548 (+101269us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.095896 (+ 82348us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.126706 (+ 30810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.169888 14063 raft_consensus.cc:359] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.169493 13906 leader_election.cc:304] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:00.170998 14063 raft_consensus.cc:385] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.147413 14000 tablet_service.cc:1511] Processing CreateTablet for tablet ec8e2fbb0a1541e7b82f6112cabed288 (DEFAULT_TABLE table=test-workload [id=2f2ad2c70aac4c07883147f35b73041f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:00.171381 14062 ts_tablet_manager.cc:1434] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.193s	user 0.018s	sys 0.025s
I20260709 13:04:00.150595 14061 tablet_bootstrap.cc:492] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:00.171818 14069 raft_consensus.cc:2749] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.143069 13778 rpcz_store.cc:276] 0709 13:03:58.794447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.914763 (+1120316us) service_pool.cc:224] Handling call
0709 13:03:59.916608 (+  1845us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.916702 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.040966 (+124264us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.130542 (+ 89576us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.131004 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.172561 14061 ts_tablet_manager.cc:1403] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.574s	user 0.019s	sys 0.014s
I20260709 13:04:00.172662 14062 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:00.174144 14060 tablet_bootstrap.cc:654] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.175797 14061 raft_consensus.cc:359] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.176577 14061 raft_consensus.cc:385] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.151192 13780 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 43) took 1317 ms. Trace:
I20260709 13:04:00.144675 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:00.136240 14085 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.179497 13780 rpcz_store.cc:276] 0709 13:03:58.833540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.968746 (+1135206us) service_pool.cc:224] Handling call
0709 13:03:59.970775 (+  2029us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.970870 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.085279 (+114409us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.150437 (+ 65158us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.151101 (+   664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.171414 14063 raft_consensus.cc:740] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.156944 14002 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 28) took 1590 ms. Trace:
I20260709 13:04:00.182840 14002 rpcz_store.cc:276] 0709 13:03:58.566777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.171770 (+604993us) service_pool.cc:224] Handling call
0709 13:03:59.370754 (+198984us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b58000c4598. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe1851b831 00007fbe184f8ac3 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82 00007fbe1192c9b1
0709 13:03:59.377050 (+  6296us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.383960 (+  6910us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.983871 (+599911us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.155608 (+171737us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.156885 (+  1277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72469248}
I20260709 13:04:00.157334 13998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350bf7b4479428fa79f9b4aa9036423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.158730 13774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 42) took 1344 ms. Trace:
I20260709 13:04:00.184984 13833 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.185321 13776 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 38) took 1444 ms. Trace:
I20260709 13:04:00.136924 13777 rpcz_store.cc:276] 0709 13:03:58.741152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.882385 (+1141233us) service_pool.cc:224] Handling call
0709 13:03:59.930107 (+ 47722us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.930193 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.990290 (+ 60097us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.124222 (+133932us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.124740 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.184163 13774 rpcz_store.cc:276] 0709 13:03:58.814287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.919094 (+1104807us) service_pool.cc:224] Handling call
0709 13:03:59.920897 (+  1803us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.921018 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.126622 (+205604us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.158144 (+ 31522us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.158666 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.186645 13996 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 39) took 1474 ms. Trace:
I20260709 13:04:00.187064 13996 rpcz_store.cc:276] 0709 13:03:58.711830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.025268 (+1313438us) service_pool.cc:224] Handling call
0709 13:04:00.027195 (+  1927us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.027293 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.124394 (+ 97101us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.186099 (+ 61705us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.186582 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.189081 14070 raft_consensus.cc:2749] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.189324 13851 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 38) took 1452 ms. Trace:
I20260709 13:04:00.155118 14101 raft_consensus.cc:493] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.206295 14101 raft_consensus.cc:515] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.206087 13851 rpcz_store.cc:276] 0709 13:03:58.736457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.934952 (+1198495us) service_pool.cc:224] Handling call
0709 13:03:59.947347 (+ 12395us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.947447 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.061509 (+114062us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.188794 (+127285us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.189269 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.208122 14098 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.209511 13791 raft_consensus.cc:2393] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:00.156313 14004 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 35) took 1501 ms. Trace:
I20260709 13:04:00.211663 14004 rpcz_store.cc:276] 0709 13:03:58.654503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.516101 (+861598us) service_pool.cc:224] Handling call
0709 13:03:59.547720 (+ 31619us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.547827 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:59.861371 (+313544us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.139494 (+278123us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.156248 (+ 16754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.181950 14085 raft_consensus.cc:2749] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.194562 14000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8e2fbb0a1541e7b82f6112cabed288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.195086 14063 consensus_queue.cc:260] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.216168 14063 ts_tablet_manager.cc:1434] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:04:00.217293 14063 tablet_bootstrap.cc:492] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:00.176896 14061 raft_consensus.cc:740] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.218401 14061 consensus_queue.cc:260] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.201413 14062 tablet_bootstrap.cc:654] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.185700 13776 rpcz_store.cc:276] 0709 13:03:58.740773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.830832 (+1090059us) service_pool.cc:224] Handling call
0709 13:03:59.964968 (+134136us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.965073 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.034089 (+ 69016us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.184793 (+150704us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.185265 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.203066 14005 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 40) took 1435 ms. Trace:
I20260709 13:04:00.220902 14061 ts_tablet_manager.cc:1434] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:04:00.224531 14005 rpcz_store.cc:276] 0709 13:03:58.767415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.092552 (+1325137us) service_pool.cc:224] Handling call
0709 13:04:00.102395 (+  9843us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.102517 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.150761 (+ 48244us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.193333 (+ 42572us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.202971 (+  9638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.223702 14101 leader_election.cc:290] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:00.235291 14061 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:00.235819 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e08736e8bdd4624ae337513bd3f8903" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.225008 13853 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 35) took 1489 ms. Trace:
W20260709 13:04:00.238623 13981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 107035us
I20260709 13:04:00.240026 13981 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.240867 14085 raft_consensus.cc:2749] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.240594 13998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 41) took 1421 ms. Trace:
I20260709 13:04:00.236711 14001 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 42) took 1389 ms. Trace:
I20260709 13:04:00.242272 13997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 38) took 1531 ms. Trace:
I20260709 13:04:00.250310 13997 rpcz_store.cc:276] 0709 13:03:58.710620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.007482 (+1296862us) service_pool.cc:224] Handling call
0709 13:04:00.095306 (+ 87824us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.095412 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.163906 (+ 68494us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.225104 (+ 61198us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.242196 (+ 17092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.246676 14061 tablet_bootstrap.cc:654] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.249502 13998 rpcz_store.cc:276] 0709 13:03:58.819286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.103341 (+1284055us) service_pool.cc:224] Handling call
0709 13:04:00.142818 (+ 39477us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.155972 (+ 13154us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.198190 (+ 42218us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.205918 (+  7728us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.238987 (+ 33069us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:00.249002 13757 leader_election.cc:343] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.250145 14001 rpcz_store.cc:276] 0709 13:03:58.858042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.104530 (+1246488us) service_pool.cc:224] Handling call
0709 13:04:00.106394 (+  1864us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.106486 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.202898 (+ 96412us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.222940 (+ 20042us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.233148 (+ 10208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.246734 14063 tablet_bootstrap.cc:654] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.263026 13854 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 41) took 1492 ms. Trace:
I20260709 13:04:00.268186 13852 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 43) took 1414 ms. Trace:
I20260709 13:04:00.269327 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:00.270320 14015 raft_consensus.cc:2393] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:00.268813 13852 rpcz_store.cc:276] 0709 13:03:58.854185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.082178 (+1227993us) service_pool.cc:224] Handling call
0709 13:04:00.102737 (+ 20559us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.102855 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.118646 (+ 15791us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.265878 (+147232us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.268103 (+  2225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.238727 13853 rpcz_store.cc:276] 0709 13:03:58.735414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.723351 (+987937us) service_pool.cc:224] Handling call
0709 13:03:59.968799 (+245448us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.968931 (+   132us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.162222 (+193291us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.197403 (+ 35181us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.224180 (+ 26777us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.277808 14060 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:00.278723 14060 ts_tablet_manager.cc:1403] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.192s	user 0.027s	sys 0.009s
I20260709 13:04:00.280092 13848 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 42) took 1460 ms. Trace:
I20260709 13:04:00.280742 13848 rpcz_store.cc:276] 0709 13:03:58.819533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.066425 (+1246892us) service_pool.cc:224] Handling call
0709 13:04:00.110694 (+ 44269us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.110800 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.196561 (+ 85761us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.279530 (+ 82969us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.280028 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.281925 13855 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55008 (request call id 40) took 1544 ms. Trace:
I20260709 13:04:00.282472 13999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 36) took 1627 ms. Trace:
I20260709 13:04:00.282411 13855 rpcz_store.cc:276] 0709 13:03:58.737124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.010958 (+1273834us) service_pool.cc:224] Handling call
0709 13:04:00.072294 (+ 61336us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.090255 (+ 17961us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.133675 (+ 43420us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.281330 (+147655us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.281858 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.283005 13999 rpcz_store.cc:276] 0709 13:03:58.655074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.683272 (+1028198us) service_pool.cc:224] Handling call
0709 13:03:59.685265 (+  1993us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.685373 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.099526 (+414153us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.281855 (+182329us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.282403 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":358}
I20260709 13:04:00.266901 13854 rpcz_store.cc:276] 0709 13:03:58.770249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.035462 (+1265213us) service_pool.cc:224] Handling call
0709 13:04:00.081045 (+ 45583us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b5800110d98. stack: 00007fbe103c8343 00007fbe103c8240 00007fbe0fd571d4 00007fbe19a95304 00007fbe19a95299 00007fbe10282db1 00007fbe103c2b71 00007fbe103c2a22 00007fbe192dbc09 00007fbe18435ee0 00007fbe1851b831 00007fbe184f8ac3 00007fbe184a7400 00007fbe1192caf4 00007fbe1192ca82 00007fbe1192c9b1
0709 13:04:00.113882 (+ 32837us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.121920 (+  8038us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.244965 (+123045us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.262463 (+ 17498us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.262960 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19661184}
I20260709 13:04:00.286746 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:00.289425 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e08736e8bdd4624ae337513bd3f8903" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.291148 13866 raft_consensus.cc:2393] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
W20260709 13:04:00.291603 13756 leader_election.cc:343] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.291985 13756 leader_election.cc:304] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:00.292827 14102 raft_consensus.cc:2749] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.293147 13757 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:00.294337 14102 raft_consensus.cc:2749] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.298043 13779 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55106 (request call id 44) took 1436 ms. Trace:
I20260709 13:04:00.298703 13779 rpcz_store.cc:276] 0709 13:03:58.862770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.995584 (+1132814us) service_pool.cc:224] Handling call
0709 13:03:59.997590 (+  2006us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:59.997688 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.225181 (+227493us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.297279 (+ 72098us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.297955 (+   676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.287357 14098 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.305404 14060 raft_consensus.cc:359] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.307145 14060 raft_consensus.cc:385] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.307643 14060 raft_consensus.cc:740] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.308789 14060 consensus_queue.cc:260] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.309957 14061 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:00.309824 14000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46798 (request call id 43) took 1415 ms. Trace:
I20260709 13:04:00.310761 14061 ts_tablet_manager.cc:1403] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.016s
I20260709 13:04:00.310719 14000 rpcz_store.cc:276] 0709 13:03:58.894567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.146369 (+1251802us) service_pool.cc:224] Handling call
0709 13:04:00.171725 (+ 25356us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:00.171836 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:00.258702 (+ 86866us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.308963 (+ 50261us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:00.309708 (+   745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.314726 14063 tablet_bootstrap.cc:492] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:00.314555 14061 raft_consensus.cc:359] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.315521 14061 raft_consensus.cc:385] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.315606 14063 ts_tablet_manager.cc:1403] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.016s
I20260709 13:04:00.315941 14061 raft_consensus.cc:740] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.316939 14061 consensus_queue.cc:260] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.320133 14060 ts_tablet_manager.cc:1434] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:04:00.320621 14061 ts_tablet_manager.cc:1434] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:00.320255 14063 raft_consensus.cc:359] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.321436 14063 raft_consensus.cc:385] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.321827 14063 raft_consensus.cc:740] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.322669 14061 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:00.322830 14063 consensus_queue.cc:260] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.323938 14062 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:00.324992 14060 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:00.325275 14062 ts_tablet_manager.cc:1403] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.153s	user 0.027s	sys 0.013s
I20260709 13:04:00.329077 14062 raft_consensus.cc:359] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.330010 14062 raft_consensus.cc:385] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.330361 14062 raft_consensus.cc:740] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.333014 14063 ts_tablet_manager.cc:1434] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:04:00.333031 14061 tablet_bootstrap.cc:654] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.334964 14062 consensus_queue.cc:260] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.334532 14063 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:00.335954 14060 tablet_bootstrap.cc:654] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.337365 14062 ts_tablet_manager.cc:1434] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:00.338780 14062 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:00.345821 14062 tablet_bootstrap.cc:654] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.347441 14063 tablet_bootstrap.cc:654] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.357386 14060 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:00.358304 14060 ts_tablet_manager.cc:1403] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.005s
I20260709 13:04:00.363570 14060 raft_consensus.cc:359] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.365231 14060 raft_consensus.cc:385] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.365717 14060 raft_consensus.cc:740] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.368772 14060 consensus_queue.cc:260] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.370460 14062 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:00.371210 14062 ts_tablet_manager.cc:1403] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.014s
I20260709 13:04:00.372503 14061 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:00.373093 14061 ts_tablet_manager.cc:1403] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.001s
I20260709 13:04:00.375204 14060 ts_tablet_manager.cc:1434] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:04:00.374982 14062 raft_consensus.cc:359] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.375823 14062 raft_consensus.cc:385] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.376150 14062 raft_consensus.cc:740] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.376462 14060 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:00.376618 14061 raft_consensus.cc:359] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.376969 14062 consensus_queue.cc:260] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.377801 14061 raft_consensus.cc:385] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.378208 14061 raft_consensus.cc:740] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.379419 14062 ts_tablet_manager.cc:1434] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:00.379078 14061 consensus_queue.cc:260] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.380506 14062 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:00.382197 14061 ts_tablet_manager.cc:1434] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:04:00.383467 14061 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:00.385946 14069 raft_consensus.cc:493] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.386657 14069 raft_consensus.cc:515] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.389047 14062 tablet_bootstrap.cc:654] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.391799 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:00.385335 14060 tablet_bootstrap.cc:654] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:00.395190 13907 leader_election.cc:343] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.395584 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.396598 14015 raft_consensus.cc:2468] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:00.398003 13906 leader_election.cc:304] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.398922 14069 leader_election.cc:290] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:00.399668 14069 raft_consensus.cc:493] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.400251 14069 raft_consensus.cc:515] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.404633 14069 leader_election.cc:290] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.405289 14063 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:00.405372 14069 raft_consensus.cc:2804] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.406474 14069 raft_consensus.cc:493] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.406926 14069 raft_consensus.cc:3060] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.407106 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:00.408869 13907 leader_election.cc:343] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.409983 14062 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:00.410547 14062 ts_tablet_manager.cc:1403] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.002s
I20260709 13:04:00.412942 14061 tablet_bootstrap.cc:654] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.413743 14062 raft_consensus.cc:359] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.414534 14062 raft_consensus.cc:385] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.414820 14062 raft_consensus.cc:740] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.415331 14069 raft_consensus.cc:515] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.415649 14062 consensus_queue.cc:260] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.416224 14103 raft_consensus.cc:493] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.416882 14103 raft_consensus.cc:515] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.418077 14062 ts_tablet_manager.cc:1434] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:00.419250 14062 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:00.421428 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:00.423610 13981 leader_election.cc:343] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.427021 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:00.432343 13980 leader_election.cc:343] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.432675 14062 tablet_bootstrap.cc:654] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.433202 13980 leader_election.cc:304] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.435329 14085 raft_consensus.cc:2749] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.408867 14063 ts_tablet_manager.cc:1403] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.009s
I20260709 13:04:00.438887 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:00.440279 14060 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:00.440824 14060 ts_tablet_manager.cc:1403] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.016s
W20260709 13:04:00.440933 13907 leader_election.cc:343] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.430372 14103 leader_election.cc:290] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.442101 14069 leader_election.cc:290] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:00.441417 14063 raft_consensus.cc:359] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.444515 14063 raft_consensus.cc:385] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.445084 14063 raft_consensus.cc:740] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.446175 14063 consensus_queue.cc:260] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:00.451753 13906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 53848.3us
I20260709 13:04:00.455055 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.455577 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:00.456295 14015 raft_consensus.cc:3060] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.456485 14063 ts_tablet_manager.cc:1434] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.005s
I20260709 13:04:00.457643 14063 tablet_bootstrap.cc:492] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:00.457696 14060 raft_consensus.cc:359] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.458730 14060 raft_consensus.cc:385] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.459054 14060 raft_consensus.cc:740] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.459914 14060 consensus_queue.cc:260] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:00.461673 13906 leader_election.cc:343] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.463549 13906 leader_election.cc:304] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.464552 14060 ts_tablet_manager.cc:1434] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.007s
I20260709 13:04:00.464862 14069 raft_consensus.cc:2749] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.465833 14060 tablet_bootstrap.cc:492] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:00.466548 14062 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:00.467110 14062 ts_tablet_manager.cc:1403] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.048s	user 0.003s	sys 0.013s
I20260709 13:04:00.470578 14062 raft_consensus.cc:359] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.471410 14062 raft_consensus.cc:385] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.471740 14062 raft_consensus.cc:740] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.472885 14061 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:00.473114 14060 tablet_bootstrap.cc:654] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.472651 14062 consensus_queue.cc:260] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.473490 14061 ts_tablet_manager.cc:1403] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.030s
I20260709 13:04:00.477162 14061 raft_consensus.cc:359] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.478030 14061 raft_consensus.cc:385] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.478385 14061 raft_consensus.cc:740] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.479350 14094 raft_consensus.cc:493] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.479233 14061 consensus_queue.cc:260] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.480118 14094 raft_consensus.cc:515] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.481904 14061 ts_tablet_manager.cc:1434] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:00.486150 14061 tablet_bootstrap.cc:492] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:00.486683 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e88dc464675442b8c7152dbf45e7b8b" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.487838 14094 leader_election.cc:290] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:00.489147 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e88dc464675442b8c7152dbf45e7b8b" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:00.490108 14094 raft_consensus.cc:493] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:00.490346 13832 leader_election.cc:343] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.490629 14094 raft_consensus.cc:515] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
W20260709 13:04:00.491463 13833 leader_election.cc:343] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.491906 13833 leader_election.cc:304] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.492534 14062 ts_tablet_manager.cc:1434] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.007s
I20260709 13:04:00.493028 14070 raft_consensus.cc:2749] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.493805 14062 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:00.493583 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb6d7b3ddc4918809eb22abca298db" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.494530 13941 raft_consensus.cc:2468] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:00.496058 13831 leader_election.cc:304] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:00.497058 14070 raft_consensus.cc:2804] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.497273 14061 tablet_bootstrap.cc:654] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.500895 14060 tablet_bootstrap.cc:492] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:00.501401 14060 ts_tablet_manager.cc:1403] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.009s
I20260709 13:04:00.497504 14070 raft_consensus.cc:493] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.503113 14070 raft_consensus.cc:3060] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.505827 14094 leader_election.cc:290] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.508113 14015 raft_consensus.cc:2468] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:00.508201 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb6d7b3ddc4918809eb22abca298db" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.508980 14014 raft_consensus.cc:2468] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:00.510680 14063 tablet_bootstrap.cc:654] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.504468 14060 raft_consensus.cc:359] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.514854 14060 raft_consensus.cc:385] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.515311 14060 raft_consensus.cc:740] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.515450 13906 leader_election.cc:304] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.515054 14070 raft_consensus.cc:515] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.516396 14069 raft_consensus.cc:2804] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.516546 14060 consensus_queue.cc:260] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.517017 14069 raft_consensus.cc:697] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:00.519143 14060 ts_tablet_manager.cc:1434] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:00.518872 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb6d7b3ddc4918809eb22abca298db" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:00.519747 13941 raft_consensus.cc:3060] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.519335 14069 consensus_queue.cc:237] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.520298 14060 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:00.519477 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb6d7b3ddc4918809eb22abca298db" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:00.525831 14015 raft_consensus.cc:3060] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.529481 13941 raft_consensus.cc:2468] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:00.531584 13831 leader_election.cc:304] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:00.532208 14063 tablet_bootstrap.cc:492] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:00.532528 14094 raft_consensus.cc:2804] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.532552 14061 tablet_bootstrap.cc:492] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:00.532752 14063 ts_tablet_manager.cc:1403] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.009s
I20260709 13:04:00.533383 14061 ts_tablet_manager.cc:1403] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.011s
I20260709 13:04:00.536561 14062 tablet_bootstrap.cc:654] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.536929 14061 raft_consensus.cc:359] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.537813 14061 raft_consensus.cc:385] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.538163 14061 raft_consensus.cc:740] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.539834 14060 tablet_bootstrap.cc:654] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.546842 14114 raft_consensus.cc:493] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.542022 14061 consensus_queue.cc:260] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.547510 14114 raft_consensus.cc:515] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.549325 14061 ts_tablet_manager.cc:1434] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:00.541570 14070 leader_election.cc:290] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.551031 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80b52ff804c4785baad8cca54adc6a4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.552731 14015 raft_consensus.cc:2468] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:00.554198 14063 raft_consensus.cc:359] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.555027 14063 raft_consensus.cc:385] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.555364 14063 raft_consensus.cc:740] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
W20260709 13:04:00.555537 13906 leader_election.cc:343] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.556372 14114 leader_election.cc:290] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.556337 14063 consensus_queue.cc:260] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.558666 14063 ts_tablet_manager.cc:1434] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:04:00.559721 14063 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:00.562913 14061 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:00.563462 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80b52ff804c4785baad8cca54adc6a4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.566705 14063 tablet_bootstrap.cc:654] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:00.571482 13906 leader_election.cc:343] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.572199 13906 leader_election.cc:304] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:00.573537 14069 raft_consensus.cc:2749] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.581856 14094 raft_consensus.cc:697] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:00.582886 14062 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:00.583676 14062 ts_tablet_manager.cc:1403] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.090s	user 0.029s	sys 0.015s
I20260709 13:04:00.583005 14094 consensus_queue.cc:237] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.587426 14123 raft_consensus.cc:493] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.587103 14062 raft_consensus.cc:359] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.588393 14062 raft_consensus.cc:385] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.588138 14123 raft_consensus.cc:515] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.588831 14062 raft_consensus.cc:740] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.589211 14061 tablet_bootstrap.cc:654] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.590065 14062 consensus_queue.cc:260] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.587119 13688 catalog_manager.cc:5697] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.592221 14060 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:00.592909 14060 ts_tablet_manager.cc:1403] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.008s
I20260709 13:04:00.593537 14062 ts_tablet_manager.cc:1434] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:04:00.594784 14062 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:00.595988 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:00.596812 13791 raft_consensus.cc:2468] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:00.597020 14123 leader_election.cc:290] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:00.597201 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.596520 14060 raft_consensus.cc:359] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.598112 14060 raft_consensus.cc:385] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.598052 13941 raft_consensus.cc:2468] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:00.599016 13833 leader_election.cc:304] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:00.599944 14060 raft_consensus.cc:740] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.600497 14123 raft_consensus.cc:2804] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.601059 14060 consensus_queue.cc:260] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.604331 14060 ts_tablet_manager.cc:1434] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:00.605983 14060 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:00.613579 14060 tablet_bootstrap.cc:654] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.601089 14123 raft_consensus.cc:493] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.614137 14123 raft_consensus.cc:3060] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:00.616358 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:00.621326 14063 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:00.622057 14063 ts_tablet_manager.cc:1403] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.001s
I20260709 13:04:00.625316 14062 tablet_bootstrap.cc:654] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.625802 14063 raft_consensus.cc:359] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.627466 14063 raft_consensus.cc:385] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.627835 14063 raft_consensus.cc:740] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.628856 14063 consensus_queue.cc:260] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.629571 14123 raft_consensus.cc:515] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.633042 13687 catalog_manager.cc:5697] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.634600 14063 ts_tablet_manager.cc:1434] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:04:00.635823 14063 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:00.636718 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:00.637604 13941 raft_consensus.cc:3060] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.638247 14061 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:00.638787 14061 ts_tablet_manager.cc:1403] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.016s
I20260709 13:04:00.642009 14098 raft_consensus.cc:493] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.643137 14063 tablet_bootstrap.cc:654] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.642973 14098 raft_consensus.cc:515] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.645427 14098 leader_election.cc:290] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.648285 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.649722 13941 raft_consensus.cc:2468] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:00.651655 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.650708 14123 leader_election.cc:290] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:00.652684 13940 raft_consensus.cc:2468] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:00.641979 14061 raft_consensus.cc:359] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.653771 14061 raft_consensus.cc:385] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.654225 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:00.655166 13791 raft_consensus.cc:3060] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.659292 14062 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:00.659973 14062 ts_tablet_manager.cc:1403] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.012s
I20260709 13:04:00.662300 13831 leader_election.cc:304] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:00.663491 13756 leader_election.cc:304] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:00.649349 14015 raft_consensus.cc:2468] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:00.664611 14060 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:00.665055 14103 raft_consensus.cc:493] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.665380 14060 ts_tablet_manager.cc:1403] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.005s
I20260709 13:04:00.665570 14103 raft_consensus.cc:515] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.668813 14060 raft_consensus.cc:359] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.669631 14060 raft_consensus.cc:385] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.669996 14060 raft_consensus.cc:740] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.670414 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089b79bc7e3c4b9c9cd30f08cde86000" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.671175 13866 raft_consensus.cc:2468] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:00.670931 14060 consensus_queue.cc:260] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.672700 13791 raft_consensus.cc:2468] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:00.672878 13980 leader_election.cc:304] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:00.673552 14060 ts_tablet_manager.cc:1434] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:00.670006 14123 raft_consensus.cc:2804] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.673705 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089b79bc7e3c4b9c9cd30f08cde86000" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.674337 14085 raft_consensus.cc:2804] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.674582 14123 raft_consensus.cc:697] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:00.674922 14060 tablet_bootstrap.cc:492] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
W20260709 13:04:00.675522 13979 leader_election.cc:343] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.674870 14085 raft_consensus.cc:493] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.675729 14123 consensus_queue.cc:237] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.676409 14098 raft_consensus.cc:2804] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.676767 14103 leader_election.cc:290] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:00.676975 14098 raft_consensus.cc:493] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.676476 14085 raft_consensus.cc:3060] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.677456 14098 raft_consensus.cc:3060] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.682615 14060 tablet_bootstrap.cc:654] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.682319 14062 raft_consensus.cc:359] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.683221 14062 raft_consensus.cc:385] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.683568 14062 raft_consensus.cc:740] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.687390 14098 raft_consensus.cc:515] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.687886 14085 raft_consensus.cc:515] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.654245 14061 raft_consensus.cc:740] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.694766 14061 consensus_queue.cc:260] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.695199 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089b79bc7e3c4b9c9cd30f08cde86000" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:00.696223 13866 raft_consensus.cc:3060] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.698163 14061 ts_tablet_manager.cc:1434] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.000s
I20260709 13:04:00.699853 14061 tablet_bootstrap.cc:492] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:00.705571 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:00.706669 13940 raft_consensus.cc:3060] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.709501 14123 raft_consensus.cc:493] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.710366 14123 raft_consensus.cc:515] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.716130 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80b52ff804c4785baad8cca54adc6a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.716387 14123 leader_election.cc:290] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.716553 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80b52ff804c4785baad8cca54adc6a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.716941 13941 raft_consensus.cc:2468] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
W20260709 13:04:00.718323 13832 leader_election.cc:343] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.719132 13831 leader_election.cc:304] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:00.720541 14123 raft_consensus.cc:2804] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.721068 14123 raft_consensus.cc:493] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.721657 14123 raft_consensus.cc:3060] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.722000 14062 consensus_queue.cc:260] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.724359 14062 ts_tablet_manager.cc:1434] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:04:00.726322 14098 leader_election.cc:290] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.726552 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:00.727662 14015 raft_consensus.cc:3060] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.728500 13940 raft_consensus.cc:2468] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:00.730150 14062 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:00.730051 13756 leader_election.cc:304] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:00.731060 14098 raft_consensus.cc:2804] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.731609 14098 raft_consensus.cc:697] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:00.732529 14098 consensus_queue.cc:237] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.738700 14061 tablet_bootstrap.cc:654] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.740089 14114 raft_consensus.cc:493] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.740656 14114 raft_consensus.cc:515] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.726459 14063 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:00.743403 14063 ts_tablet_manager.cc:1403] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.108s	user 0.024s	sys 0.008s
I20260709 13:04:00.744791 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7618e0b5f2c44b529f37ee7481482040" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:00.745500 13866 raft_consensus.cc:2468] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:00.747758 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089b79bc7e3c4b9c9cd30f08cde86000" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:00.747136 14102 raft_consensus.cc:493] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.746421 14085 leader_election.cc:290] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:00.752158 14102 raft_consensus.cc:515] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.752573 14015 raft_consensus.cc:2468] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:00.752686 13980 leader_election.cc:304] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
W20260709 13:04:00.753805 13979 leader_election.cc:343] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.745596 13791 raft_consensus.cc:2468] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:00.755381 14114 leader_election.cc:290] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.756383 13907 leader_election.cc:304] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:00.756984 14062 tablet_bootstrap.cc:654] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.749545 14063 raft_consensus.cc:359] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.757427 14063 raft_consensus.cc:385] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.757532 14114 raft_consensus.cc:2804] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.759450 14114 raft_consensus.cc:493] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.757853 14063 raft_consensus.cc:740] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.761426 14102 leader_election.cc:290] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.762106 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.746730 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7618e0b5f2c44b529f37ee7481482040" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.764712 14114 raft_consensus.cc:3060] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.765041 14063 consensus_queue.cc:260] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.767783 13867 raft_consensus.cc:2468] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:00.768365 14123 raft_consensus.cc:515] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.771799 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80b52ff804c4785baad8cca54adc6a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:00.772835 13940 raft_consensus.cc:3060] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.774864 14123 leader_election.cc:290] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:00.776446 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80b52ff804c4785baad8cca54adc6a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:00.776793 14114 raft_consensus.cc:515] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.778088 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
W20260709 13:04:00.779016 13832 leader_election.cc:343] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.779400 14015 raft_consensus.cc:2393] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 48967ca777ee43ebaddd57da674bd3e1 in this term.
I20260709 13:04:00.780794 13757 leader_election.cc:304] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:00.781967 14102 raft_consensus.cc:3060] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.759101 14085 raft_consensus.cc:2804] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.790596 14063 ts_tablet_manager.cc:1434] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.047s	user 0.011s	sys 0.001s
I20260709 13:04:00.791815 14063 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:00.788934 14085 raft_consensus.cc:697] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:00.801136 14085 consensus_queue.cc:237] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.802881 14069 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.803200 14063 tablet_bootstrap.cc:654] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.804219 14069 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.806383 14069 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:00.806327 14062 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:00.807420 14062 ts_tablet_manager.cc:1403] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.000s
I20260709 13:04:00.807811 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.807878 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:00.809926 13906 leader_election.cc:343] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.810531 14062 raft_consensus.cc:359] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.811240 14062 raft_consensus.cc:385] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:00.811113 13907 leader_election.cc:343] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.811663 14060 tablet_bootstrap.cc:492] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:00.811770 14062 raft_consensus.cc:740] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.812280 14060 ts_tablet_manager.cc:1403] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.042s
I20260709 13:04:00.812156 13907 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:00.812736 14062 consensus_queue.cc:260] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.813853 14069 raft_consensus.cc:2749] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.815739 14060 raft_consensus.cc:359] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.816430 14060 raft_consensus.cc:385] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.816701 14060 raft_consensus.cc:740] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.817468 14060 consensus_queue.cc:260] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.818523 14102 raft_consensus.cc:2749] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.820286 14060 ts_tablet_manager.cc:1434] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:00.822881 14098 raft_consensus.cc:493] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.823387 14060 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:00.823741 14098 raft_consensus.cc:515] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.826757 14098 leader_election.cc:290] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.822919 14062 ts_tablet_manager.cc:1434] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:00.827292 14061 tablet_bootstrap.cc:492] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:00.828272 14114 leader_election.cc:290] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.828626 14061 ts_tablet_manager.cc:1403] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.129s	user 0.037s	sys 0.007s
I20260709 13:04:00.828289 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33baea2ddc640ee86529fb3d422c920" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.830184 13867 raft_consensus.cc:2468] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:00.830683 14063 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:00.831243 14063 ts_tablet_manager.cc:1403] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.007s
I20260709 13:04:00.832230 14061 raft_consensus.cc:359] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.832703 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7618e0b5f2c44b529f37ee7481482040" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:00.833250 14061 raft_consensus.cc:385] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.833603 13791 raft_consensus.cc:3060] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.834323 14063 raft_consensus.cc:359] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.835136 14063 raft_consensus.cc:385] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.835235 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7618e0b5f2c44b529f37ee7481482040" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:00.835469 14063 raft_consensus.cc:740] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.835907 13867 raft_consensus.cc:3060] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.836282 14063 consensus_queue.cc:260] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.837486 13757 leader_election.cc:304] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:00.838367 14098 raft_consensus.cc:493] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.838708 14063 ts_tablet_manager.cc:1434] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:00.839807 14063 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:00.839569 14098 raft_consensus.cc:515] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.843441 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:00.844245 13941 raft_consensus.cc:2468] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:00.845108 14103 raft_consensus.cc:493] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.833609 14061 raft_consensus.cc:740] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.845692 14103 raft_consensus.cc:515] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.847275 14063 tablet_bootstrap.cc:654] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.848973 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33baea2ddc640ee86529fb3d422c920" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:00.850209 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33baea2ddc640ee86529fb3d422c920" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.847275 14061 consensus_queue.cc:260] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.851233 13866 raft_consensus.cc:2468] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:00.851471 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33baea2ddc640ee86529fb3d422c920" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:00.852397 13792 raft_consensus.cc:2468] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:00.854154 14015 raft_consensus.cc:2468] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:00.854732 13980 leader_election.cc:304] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:00.857815 13756 leader_election.cc:304] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:00.859881 14103 leader_election.cc:290] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.861248 14103 raft_consensus.cc:2804] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.861874 14103 raft_consensus.cc:493] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.862890 14103 raft_consensus.cc:3060] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.860028 14102 raft_consensus.cc:2804] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.867393 14102 raft_consensus.cc:493] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.867946 14102 raft_consensus.cc:3060] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.872572 14098 leader_election.cc:290] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:00.873746 14062 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:00.881732 13689 catalog_manager.cc:5697] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:00.890870 14147 raft_consensus.cc:2804] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:00.893590 14147 raft_consensus.cc:493] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.894146 14147 raft_consensus.cc:3060] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.896140 13867 raft_consensus.cc:2468] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
W20260709 13:04:00.892813 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 55468.3us
I20260709 13:04:00.892382 13940 raft_consensus.cc:2468] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:00.909708 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:00.910496 13866 raft_consensus.cc:2468] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:00.910948 13831 leader_election.cc:304] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:00.913177 14123 raft_consensus.cc:2804] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.913931 14123 raft_consensus.cc:697] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:00.915117 14123 consensus_queue.cc:237] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:00.921746 13690 catalog_manager.cc:5697] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:00.922837 13906 leader_election.cc:304] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:00.924176 14114 raft_consensus.cc:2804] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.924854 14114 raft_consensus.cc:697] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:00.926050 14114 consensus_queue.cc:237] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.929595 14063 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:00.930197 14063 ts_tablet_manager.cc:1403] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.091s	user 0.026s	sys 0.023s
I20260709 13:04:00.899464 14060 tablet_bootstrap.cc:654] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.934007 14063 raft_consensus.cc:359] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.935027 14063 raft_consensus.cc:385] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.935426 14063 raft_consensus.cc:740] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.940497 14061 ts_tablet_manager.cc:1434] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.112s	user 0.025s	sys 0.023s
I20260709 13:04:00.941970 14061 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:00.946790 14147 raft_consensus.cc:515] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.948810 14061 tablet_bootstrap.cc:654] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.948551 14069 consensus_queue.cc:1048] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:00.949028 14147 leader_election.cc:290] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:00.950543 14063 consensus_queue.cc:260] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.862987 13791 raft_consensus.cc:2468] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:00.952857 14063 ts_tablet_manager.cc:1434] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:00.953965 14063 tablet_bootstrap.cc:492] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:00.954030 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:00.954758 13940 raft_consensus.cc:3060] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.902607 14062 tablet_bootstrap.cc:654] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.906730 14103 raft_consensus.cc:515] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.964351 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33baea2ddc640ee86529fb3d422c920" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:00.968924 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:00.970278 13867 raft_consensus.cc:3060] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.973496 14102 raft_consensus.cc:515] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:00.974931 13792 raft_consensus.cc:2393] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:00.978659 13867 raft_consensus.cc:2468] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:00.979671 14061 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:00.980235 14061 ts_tablet_manager.cc:1403] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.039s	user 0.004s	sys 0.008s
I20260709 13:04:00.980525 13757 leader_election.cc:304] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:00.981483 14147 raft_consensus.cc:2804] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.982033 14147 raft_consensus.cc:697] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:00.982889 14147 consensus_queue.cc:237] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.983150 14061 raft_consensus.cc:359] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.983880 14061 raft_consensus.cc:385] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.983929 13940 raft_consensus.cc:2468] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:00.984273 14061 raft_consensus.cc:740] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.986047 14103 leader_election.cc:290] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.986248 14102 leader_election.cc:290] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:00.987462 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33baea2ddc640ee86529fb3d422c920" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:00.987732 14063 tablet_bootstrap.cc:654] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.988041 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33baea2ddc640ee86529fb3d422c920" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:00.988180 14061 consensus_queue.cc:260] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:00.989974 14060 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:00.989877 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33baea2ddc640ee86529fb3d422c920" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:00.990921 14015 raft_consensus.cc:2393] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:00.990955 14060 ts_tablet_manager.cc:1403] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.015s
I20260709 13:04:00.992589 13757 leader_election.cc:304] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:00.990196 13867 raft_consensus.cc:3060] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.993966 14102 raft_consensus.cc:2749] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:00.994190 14060 raft_consensus.cc:359] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.989398 14062 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:00.995048 14060 raft_consensus.cc:385] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.995328 14062 ts_tablet_manager.cc:1403] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.000s
I20260709 13:04:00.995462 14060 raft_consensus.cc:740] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.996466 14060 consensus_queue.cc:260] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:00.998837 14060 ts_tablet_manager.cc:1434] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:01.001911 14060 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:00.999718 14062 raft_consensus.cc:359] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.004055 14062 raft_consensus.cc:385] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.004415 14062 raft_consensus.cc:740] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.000555 14061 ts_tablet_manager.cc:1434] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:04:01.006045 14061 tablet_bootstrap.cc:492] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:01.008705 13867 raft_consensus.cc:2468] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:01.010504 13980 leader_election.cc:304] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:01.011063 14062 consensus_queue.cc:260] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.011821 14103 raft_consensus.cc:2804] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.012365 14103 raft_consensus.cc:697] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:01.013532 14062 ts_tablet_manager.cc:1434] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:04:01.013260 14103 consensus_queue.cc:237] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.014705 14062 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:01.014878 14114 consensus_queue.cc:1048] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:01.022111 14060 tablet_bootstrap.cc:654] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.023275 14061 tablet_bootstrap.cc:654] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.056160 14114 raft_consensus.cc:493] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.058907 14114 raft_consensus.cc:515] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.062834 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089b79bc7e3c4b9c9cd30f08cde86000" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:01.063896 13867 raft_consensus.cc:2393] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 1: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:01.064636 14062 tablet_bootstrap.cc:654] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.070629 14063 tablet_bootstrap.cc:492] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:01.071398 14063 ts_tablet_manager.cc:1403] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.002s
I20260709 13:04:01.070564 14114 leader_election.cc:290] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:01.072258 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089b79bc7e3c4b9c9cd30f08cde86000" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:01.074369 14063 raft_consensus.cc:359] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.075073 14063 raft_consensus.cc:385] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.075338 14063 raft_consensus.cc:740] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.076977 13906 leader_election.cc:304] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:01.078238 14114 raft_consensus.cc:3060] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.078305 13689 catalog_manager.cc:5697] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.079778 14060 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:01.080250 13689 catalog_manager.cc:5697] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.076393 14063 consensus_queue.cc:260] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.080269 14060 ts_tablet_manager.cc:1403] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.018s
I20260709 13:04:01.083788 14063 ts_tablet_manager.cc:1434] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:01.084761 14063 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:01.089965 14103 raft_consensus.cc:493] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.091487 14103 raft_consensus.cc:515] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.096765 14060 raft_consensus.cc:359] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.097584 14060 raft_consensus.cc:385] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.097903 14060 raft_consensus.cc:740] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.098680 14060 consensus_queue.cc:260] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.110051 14094 consensus_queue.cc:1048] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:01.116731 14114 raft_consensus.cc:2749] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:01.127604 14061 tablet_bootstrap.cc:492] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:01.128368 14061 ts_tablet_manager.cc:1403] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.007s
I20260709 13:04:01.123767 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e88dc464675442b8c7152dbf45e7b8b" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:01.132839 13867 raft_consensus.cc:2468] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:01.132382 14061 raft_consensus.cc:359] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.133488 14061 raft_consensus.cc:385] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.118709 14123 consensus_queue.cc:1048] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:01.134459 13980 leader_election.cc:304] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:01.135746 14145 raft_consensus.cc:2804] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.136224 14145 raft_consensus.cc:493] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.136670 14145 raft_consensus.cc:3060] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.133893 14061 raft_consensus.cc:740] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.118851 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e88dc464675442b8c7152dbf45e7b8b" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:01.118799 14103 leader_election.cc:290] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:01.119374 14094 consensus_queue.cc:1048] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:04:01.141256 14061 consensus_queue.cc:260] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.144112 14060 ts_tablet_manager.cc:1434] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.061s	user 0.015s	sys 0.011s
I20260709 13:04:01.145555 14060 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:01.146579 14061 ts_tablet_manager.cc:1434] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.003s
I20260709 13:04:01.140983 13791 raft_consensus.cc:2468] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:01.148294 14061 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:01.159196 13687 catalog_manager.cc:5697] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.159868 13688 catalog_manager.cc:5697] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.163300 13690 catalog_manager.cc:5697] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.164933 14062 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:01.165509 14062 ts_tablet_manager.cc:1403] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.151s	user 0.022s	sys 0.027s
I20260709 13:04:01.167387 14060 tablet_bootstrap.cc:654] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.167630 14062 raft_consensus.cc:359] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.168273 14062 raft_consensus.cc:385] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.168501 14062 raft_consensus.cc:740] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.170113 14062 consensus_queue.cc:260] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.175910 14061 tablet_bootstrap.cc:654] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.176797 14145 raft_consensus.cc:515] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.184178 14147 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.184796 14147 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.185408 14062 ts_tablet_manager.cc:1434] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:04:01.190805 14062 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:01.194299 14147 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:01.196116 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:01.196866 13940 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:01.198351 13756 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:01.199520 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:01.200519 14013 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:01.205278 14063 tablet_bootstrap.cc:654] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.210983 14147 raft_consensus.cc:2804] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.222954 14102 raft_consensus.cc:493] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.223748 14102 raft_consensus.cc:515] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.218744 14147 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.226964 14147 raft_consensus.cc:3060] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.229031 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6464fa5a5f594fbd9f27a2a6f7988481" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:01.229379 14123 consensus_queue.cc:1048] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:01.232012 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6464fa5a5f594fbd9f27a2a6f7988481" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:01.232355 13756 leader_election.cc:343] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.235301 14167 raft_consensus.cc:493] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.235855 14167 raft_consensus.cc:515] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.246768 14167 leader_election.cc:290] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
W20260709 13:04:01.242688 13757 leader_election.cc:343] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.249220 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e08736e8bdd4624ae337513bd3f8903" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:01.249569 13757 leader_election.cc:304] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:01.249996 13867 raft_consensus.cc:2468] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:01.250694 14143 raft_consensus.cc:2749] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:01.240773 14102 leader_election.cc:290] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:01.254691 14102 consensus_queue.cc:1048] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:01.264089 14103 raft_consensus.cc:493] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.264859 14103 raft_consensus.cc:515] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.268141 13906 leader_election.cc:304] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:01.249639 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e08736e8bdd4624ae337513bd3f8903" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:01.270220 14103 leader_election.cc:290] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:01.270033 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e88dc464675442b8c7152dbf45e7b8b" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:01.281394 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80b52ff804c4785baad8cca54adc6a4" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:01.282301 13790 raft_consensus.cc:3060] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.282812 13940 raft_consensus.cc:2393] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 1: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
I20260709 13:04:01.277220 14167 raft_consensus.cc:2804] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.286288 14167 raft_consensus.cc:493] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.286779 14167 raft_consensus.cc:3060] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.290234 14145 leader_election.cc:290] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:01.290634 13792 raft_consensus.cc:2468] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:01.292943 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e88dc464675442b8c7152dbf45e7b8b" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:01.294317 13866 raft_consensus.cc:3060] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.281560 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80b52ff804c4785baad8cca54adc6a4" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:01.307653 14061 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:01.308842 14061 ts_tablet_manager.cc:1403] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.161s	user 0.023s	sys 0.053s
I20260709 13:04:01.313378 13980 leader_election.cc:304] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:01.314456 14103 raft_consensus.cc:3060] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.317579 14165 raft_consensus.cc:493] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.318239 14165 raft_consensus.cc:515] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.320729 14165 leader_election.cc:290] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:01.324227 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:01.325852 14123 consensus_queue.cc:1048] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:01.326479 13907 leader_election.cc:343] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.327548 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:01.330261 14062 tablet_bootstrap.cc:654] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.332557 14069 consensus_queue.cc:1048] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:01.333987 14103 raft_consensus.cc:2749] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:01.329913 13906 leader_election.cc:343] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.335067 13906 leader_election.cc:304] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:01.338317 14069 raft_consensus.cc:2749] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:01.346081 14123 raft_consensus.cc:493] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.346692 14123 raft_consensus.cc:515] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.348956 14123 leader_election.cc:290] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:01.350670 14102 consensus_queue.cc:1048] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:01.351897 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b4b051be04869b067d3f67aa80a4e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:01.356824 14063 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:01.357373 14063 ts_tablet_manager.cc:1403] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.018s
I20260709 13:04:01.359153 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b4b051be04869b067d3f67aa80a4e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
W20260709 13:04:01.361640 13831 leader_election.cc:343] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.362718 14060 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
W20260709 13:04:01.362862 13832 leader_election.cc:343] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.363407 14060 ts_tablet_manager.cc:1403] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.000s
I20260709 13:04:01.375833 14061 raft_consensus.cc:359] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.376917 14061 raft_consensus.cc:385] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.377300 14061 raft_consensus.cc:740] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.379657 14061 consensus_queue.cc:260] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.381872 14063 raft_consensus.cc:359] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.382893 14063 raft_consensus.cc:385] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.341106 14103 consensus_queue.cc:1048] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 13:04:01.383242 14063 raft_consensus.cc:740] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.385679 14063 consensus_queue.cc:260] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.396763 14060 raft_consensus.cc:359] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.398192 14060 raft_consensus.cc:385] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.363459 13832 leader_election.cc:304] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:01.398665 14060 raft_consensus.cc:740] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.401634 14063 ts_tablet_manager.cc:1434] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.002s
I20260709 13:04:01.403806 14061 ts_tablet_manager.cc:1434] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.002s
I20260709 13:04:01.404286 14060 consensus_queue.cc:260] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.405460 14063 tablet_bootstrap.cc:492] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:01.406334 14061 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:01.407503 14060 ts_tablet_manager.cc:1434] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 13:04:01.392748 13790 raft_consensus.cc:2468] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:01.388993 13866 raft_consensus.cc:2468] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:01.400487 14085 consensus_queue.cc:1048] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 13:04:01.413511 13832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 50688us
I20260709 13:04:01.415155 14123 raft_consensus.cc:2749] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:01.423826 14094 consensus_queue.cc:1048] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:01.426441 13981 leader_election.cc:304] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:01.427289 14061 tablet_bootstrap.cc:654] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.429299 14103 raft_consensus.cc:2804] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.433075 14103 raft_consensus.cc:697] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:01.434671 14063 tablet_bootstrap.cc:654] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.435496 14165 consensus_queue.cc:1048] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:01.434332 14103 consensus_queue.cc:237] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.445011 14085 raft_consensus.cc:493] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.445561 14085 raft_consensus.cc:515] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.448360 14167 raft_consensus.cc:515] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.449542 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7f9c6781bb4725847b8d5169cd3c02" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:01.456598 13941 raft_consensus.cc:2468] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:01.458428 13979 leader_election.cc:304] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:01.459550 14145 raft_consensus.cc:2804] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.459959 14145 raft_consensus.cc:493] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.460292 14145 raft_consensus.cc:3060] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.470741 14102 consensus_queue.cc:1048] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:01.474018 14060 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:01.476997 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7f9c6781bb4725847b8d5169cd3c02" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:01.477892 14085 leader_election.cc:290] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:01.482993 14062 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:01.483911 14062 ts_tablet_manager.cc:1403] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.293s	user 0.013s	sys 0.006s
W20260709 13:04:01.493639 13981 leader_election.cc:343] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.478531 14147 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.497824 14147 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:01.497978 14103 consensus_queue.cc:1048] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:01.498412 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:01.499046 13941 raft_consensus.cc:3060] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.499811 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:01.500475 14014 raft_consensus.cc:3060] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.493466 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e08736e8bdd4624ae337513bd3f8903" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:01.506505 13790 raft_consensus.cc:3060] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.514547 14062 raft_consensus.cc:359] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.516551 14062 raft_consensus.cc:385] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.517024 14062 raft_consensus.cc:740] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.522747 14062 consensus_queue.cc:260] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.524605 14167 leader_election.cc:290] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:01.530432 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e08736e8bdd4624ae337513bd3f8903" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:01.531193 13865 raft_consensus.cc:3060] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.535122 13790 raft_consensus.cc:2468] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:01.536664 13907 leader_election.cc:304] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:01.523650 14145 raft_consensus.cc:515] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.538254 14167 raft_consensus.cc:2804] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.538939 14167 raft_consensus.cc:697] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:01.540755 14167 consensus_queue.cc:237] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.550829 13865 raft_consensus.cc:2468] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:01.552220 13941 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:01.552579 14060 tablet_bootstrap.cc:654] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.550779 14014 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:01.553589 13756 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:01.554256 14103 raft_consensus.cc:493] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.554713 14147 raft_consensus.cc:2804] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.554788 14103 raft_consensus.cc:515] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.555361 14147 raft_consensus.cc:697] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:01.556262 14147 consensus_queue.cc:237] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.557134 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7f9c6781bb4725847b8d5169cd3c02" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:01.557979 14062 ts_tablet_manager.cc:1434] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.001s
I20260709 13:04:01.559055 14062 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:01.563547 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:01.565124 13979 leader_election.cc:343] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:01.565342 13981 leader_election.cc:343] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.557667 14103 leader_election.cc:290] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:01.566282 14062 tablet_bootstrap.cc:654] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.566905 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:01.568542 14063 tablet_bootstrap.cc:492] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
W20260709 13:04:01.568681 13980 leader_election.cc:343] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.569116 14063 ts_tablet_manager.cc:1403] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.166s	user 0.031s	sys 0.011s
I20260709 13:04:01.569276 13980 leader_election.cc:304] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:01.553617 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7f9c6781bb4725847b8d5169cd3c02" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:01.571208 14085 raft_consensus.cc:2749] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:01.572026 14189 consensus_queue.cc:1048] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:01.572151 14063 raft_consensus.cc:359] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.572959 14063 raft_consensus.cc:385] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.573242 14063 raft_consensus.cc:740] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.571201 13941 raft_consensus.cc:3060] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.577059 14063 consensus_queue.cc:260] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.601023 14063 ts_tablet_manager.cc:1434] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:04:01.602592 14063 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:01.603389 14085 consensus_queue.cc:1048] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:01.610345 14063 tablet_bootstrap.cc:654] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.544885 14145 leader_election.cc:290] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:01.636613 14061 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:01.637336 14061 ts_tablet_manager.cc:1403] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.007s
W20260709 13:04:01.635955 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:01.639693 14189 raft_consensus.cc:493] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.651924 14189 raft_consensus.cc:515] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.653381 14062 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:01.654155 14062 ts_tablet_manager.cc:1403] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.010s
I20260709 13:04:01.654474 14189 leader_election.cc:290] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:01.656405 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83902dd19424f4d9f3707d53bafb0b5" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:01.656931 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83902dd19424f4d9f3707d53bafb0b5" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:01.658015 13757 leader_election.cc:343] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:01.659088 13757 leader_election.cc:343] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.659659 13757 leader_election.cc:304] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:01.662352 14189 raft_consensus.cc:2749] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:01.666957 14094 raft_consensus.cc:493] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.673686 14094 raft_consensus.cc:515] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.675827 14060 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:01.676750 14060 ts_tablet_manager.cc:1403] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.208s	user 0.009s	sys 0.018s
I20260709 13:04:01.678547 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:01.680717 13833 leader_election.cc:343] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.681097 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:01.681502 14094 leader_election.cc:290] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:01.682037 14013 raft_consensus.cc:2468] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:01.683775 13832 leader_election.cc:304] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:01.685451 14094 raft_consensus.cc:2804] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.686195 14094 raft_consensus.cc:493] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.686980 14094 raft_consensus.cc:3060] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.684722 14061 raft_consensus.cc:359] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.701079 13688 catalog_manager.cc:5697] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.702896 13941 raft_consensus.cc:2468] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:01.704437 14177 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.711930 14177 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.714623 14177 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:01.717546 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:01.718304 13790 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:01.721410 13833 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:01.722862 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:01.723031 14177 raft_consensus.cc:2804] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:01.722994 14094 raft_consensus.cc:515] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.723615 14177 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.723695 14013 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:01.724072 14177 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.725337 14094 leader_election.cc:290] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:01.692934 14060 raft_consensus.cc:359] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.706779 14061 raft_consensus.cc:385] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.726231 14061 raft_consensus.cc:740] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.726290 14062 raft_consensus.cc:359] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.727075 14062 raft_consensus.cc:385] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.727371 14062 raft_consensus.cc:740] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.704468 13689 catalog_manager.cc:5697] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.727380 14060 raft_consensus.cc:385] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.729658 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:01.728199 14060 raft_consensus.cc:740] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
W20260709 13:04:01.731961 13833 leader_election.cc:343] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.733642 13690 catalog_manager.cc:5697] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.736482 14061 consensus_queue.cc:260] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.736766 14062 consensus_queue.cc:260] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.739907 13979 leader_election.cc:304] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:01.736243 14060 consensus_queue.cc:260] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.742848 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:01.743655 14060 ts_tablet_manager.cc:1434] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.001s
I20260709 13:04:01.743535 14013 raft_consensus.cc:3060] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.744338 14145 raft_consensus.cc:2804] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.744858 14145 raft_consensus.cc:697] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:01.745744 14145 consensus_queue.cc:237] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.746840 14085 raft_consensus.cc:493] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.747440 14063 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:01.747361 14085 raft_consensus.cc:515] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.747974 14063 ts_tablet_manager.cc:1403] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.146s	user 0.023s	sys 0.006s
I20260709 13:04:01.749572 14085 leader_election.cc:290] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:01.752535 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:01.754133 13981 leader_election.cc:343] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.755609 14060 tablet_bootstrap.cc:492] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:01.759085 14063 raft_consensus.cc:359] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.759924 14063 raft_consensus.cc:385] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.760246 14063 raft_consensus.cc:740] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.757089 14177 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.757179 14061 ts_tablet_manager.cc:1434] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.002s
I20260709 13:04:01.762895 14061 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:01.763616 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:01.764498 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
W20260709 13:04:01.765097 13979 leader_election.cc:343] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.765215 14014 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.761188 14063 consensus_queue.cc:260] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.765661 13979 leader_election.cc:304] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:01.768532 14061 tablet_bootstrap.cc:654] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.768906 14013 raft_consensus.cc:2468] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:01.769361 14085 raft_consensus.cc:2749] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:01.767910 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:01.770380 13790 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.770313 13832 leader_election.cc:304] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:01.771505 14094 raft_consensus.cc:2804] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.772090 14094 raft_consensus.cc:697] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:01.773044 14094 consensus_queue.cc:237] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.778817 14060 tablet_bootstrap.cc:654] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.768443 14177 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:01.780791 14063 ts_tablet_manager.cc:1434] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.003s
I20260709 13:04:01.783435 14063 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:01.785957 14102 raft_consensus.cc:493] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.786736 14102 raft_consensus.cc:515] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.789094 14102 leader_election.cc:290] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:01.795492 14063 tablet_bootstrap.cc:654] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.795624 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
W20260709 13:04:01.801530 13757 leader_election.cc:343] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.797452 14014 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 2.
I20260709 13:04:01.806130 14167 raft_consensus.cc:493] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.808331 14167 raft_consensus.cc:515] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.798183 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:01.809634 13941 raft_consensus.cc:2468] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:01.809937 14060 tablet_bootstrap.cc:492] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:01.810680 14060 ts_tablet_manager.cc:1403] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.007s
I20260709 13:04:01.811564 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:01.812058 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:01.813140 13907 leader_election.cc:343] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.810748 14167 leader_election.cc:290] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
W20260709 13:04:01.813827 13906 leader_election.cc:343] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.814370 13906 leader_election.cc:304] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:01.816006 14167 raft_consensus.cc:2749] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:01.815660 14060 raft_consensus.cc:359] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.816745 14060 raft_consensus.cc:385] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.817152 14060 raft_consensus.cc:740] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.818362 13756 leader_election.cc:304] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:01.820127 14147 raft_consensus.cc:2804] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.820587 14147 raft_consensus.cc:493] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.821130 14147 raft_consensus.cc:3060] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.830149 14060 consensus_queue.cc:260] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.833459 14060 ts_tablet_manager.cc:1434] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:04:01.839000 14060 tablet_bootstrap.cc:492] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:01.840059 13832 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:01.841468 14177 raft_consensus.cc:2804] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.842002 14177 raft_consensus.cc:697] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:01.829321 13790 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 2.
I20260709 13:04:01.842873 14177 consensus_queue.cc:237] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.854293 14062 ts_tablet_manager.cc:1434] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.200s	user 0.006s	sys 0.002s
I20260709 13:04:01.861037 14062 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:01.870409 14085 consensus_queue.cc:1048] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:01.880595 14060 tablet_bootstrap.cc:654] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.892198 14147 raft_consensus.cc:515] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.895066 14062 tablet_bootstrap.cc:654] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.895355 13688 catalog_manager.cc:5697] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.899835 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:01.897512 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:01.900804 13941 raft_consensus.cc:3060] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.911684 14062 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:01.912045 14061 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:01.912267 14062 ts_tablet_manager.cc:1403] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.004s
I20260709 13:04:01.912575 14061 ts_tablet_manager.cc:1403] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.150s	user 0.036s	sys 0.081s
W20260709 13:04:01.912849 13757 leader_election.cc:343] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.915138 14062 raft_consensus.cc:359] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.915457 14061 raft_consensus.cc:359] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.916221 14061 raft_consensus.cc:385] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.916503 14061 raft_consensus.cc:740] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.917191 14061 consensus_queue.cc:260] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.918313 14060 tablet_bootstrap.cc:492] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:01.918519 14103 consensus_queue.cc:1048] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:01.918823 14060 ts_tablet_manager.cc:1403] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.000s
I20260709 13:04:01.919214 14061 ts_tablet_manager.cc:1434] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:04:01.920179 14061 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:01.923163 14063 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:01.923733 14063 ts_tablet_manager.cc:1403] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.015s
I20260709 13:04:01.923733 14177 raft_consensus.cc:493] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.925668 14060 raft_consensus.cc:359] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.925805 14177 raft_consensus.cc:515] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.926671 14061 tablet_bootstrap.cc:654] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.927961 14177 leader_election.cc:290] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:01.927205 13689 catalog_manager.cc:5697] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.928619 14060 raft_consensus.cc:385] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.929494 14060 raft_consensus.cc:740] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.930804 14060 consensus_queue.cc:260] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.915879 14062 raft_consensus.cc:385] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.932734 14062 raft_consensus.cc:740] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.933990 14060 ts_tablet_manager.cc:1434] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:01.935343 14062 consensus_queue.cc:260] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:01.936211 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea20a419556e46b0b003c05c54815dc6" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:01.930824 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea20a419556e46b0b003c05c54815dc6" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:01.938300 13939 raft_consensus.cc:2468] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
W20260709 13:04:01.938694 13832 leader_election.cc:343] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.938299 14062 ts_tablet_manager.cc:1434] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:04:01.939625 14061 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:01.936479 14060 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:01.940101 14061 ts_tablet_manager.cc:1403] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.001s
I20260709 13:04:01.939957 13831 leader_election.cc:304] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:01.941352 14177 raft_consensus.cc:2804] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.941805 14177 raft_consensus.cc:493] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.942162 14177 raft_consensus.cc:3060] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.946794 14060 tablet_bootstrap.cc:654] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.940035 14062 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:01.899441 14147 leader_election.cc:290] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:01.950117 14177 raft_consensus.cc:515] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:01.950157 13941 raft_consensus.cc:2468] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:01.953915 13756 leader_election.cc:304] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:01.956789 14147 raft_consensus.cc:2804] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.957525 14062 tablet_bootstrap.cc:654] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.958613 14147 raft_consensus.cc:697] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:01.960124 14147 consensus_queue.cc:237] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.958964 14063 raft_consensus.cc:359] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.972514 14063 raft_consensus.cc:385] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.972935 14063 raft_consensus.cc:740] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.973745 14063 consensus_queue.cc:260] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:01.963232 14061 raft_consensus.cc:359] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.966955 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea20a419556e46b0b003c05c54815dc6" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:01.967490 14177 leader_election.cc:290] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
W20260709 13:04:01.977241 13832 leader_election.cc:343] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.977921 14061 raft_consensus.cc:385] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.969002 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea20a419556e46b0b003c05c54815dc6" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:01.969364 14062 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:01.978611 13941 raft_consensus.cc:3060] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.978736 14062 ts_tablet_manager.cc:1403] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.002s
I20260709 13:04:01.979620 14061 raft_consensus.cc:740] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.980511 14061 consensus_queue.cc:260] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.981279 14062 raft_consensus.cc:359] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.982033 14062 raft_consensus.cc:385] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.982291 14062 raft_consensus.cc:740] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.982657 14061 ts_tablet_manager.cc:1434] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:01.983078 14062 consensus_queue.cc:260] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:01.983712 14061 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:01.984711 14062 ts_tablet_manager.cc:1434] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:01.985488 14062 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:01.986888 14063 ts_tablet_manager.cc:1434] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:04:01.987936 14063 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:01.990087 14062 tablet_bootstrap.cc:654] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.990154 14061 tablet_bootstrap.cc:654] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.992483 13689 catalog_manager.cc:5697] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 2, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.997004 14177 raft_consensus.cc:493] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.997567 14177 raft_consensus.cc:515] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.000873 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6464fa5a5f594fbd9f27a2a6f7988481" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:02.001577 13790 raft_consensus.cc:2468] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:02.001708 14177 leader_election.cc:290] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:02.002079 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6464fa5a5f594fbd9f27a2a6f7988481" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:02.003958 13833 leader_election.cc:304] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
W20260709 13:04:02.004897 13831 leader_election.cc:343] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.010003 14094 raft_consensus.cc:2804] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.010492 14094 raft_consensus.cc:493] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.010713 14061 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:02.010846 14062 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:02.010821 14094 raft_consensus.cc:3060] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.011272 14061 ts_tablet_manager.cc:1403] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.003s
I20260709 13:04:02.014271 14061 raft_consensus.cc:359] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.014963 14061 raft_consensus.cc:385] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.015234 14061 raft_consensus.cc:740] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.015923 14061 consensus_queue.cc:260] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.018021 14061 ts_tablet_manager.cc:1434] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:02.019724 14061 tablet_bootstrap.cc:492] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:02.019795 14094 raft_consensus.cc:515] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.020959 14062 ts_tablet_manager.cc:1403] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.015s
I20260709 13:04:02.023957 14062 raft_consensus.cc:359] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.024663 14062 raft_consensus.cc:385] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.024925 14062 raft_consensus.cc:740] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.026445 13941 raft_consensus.cc:2468] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:02.028443 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6464fa5a5f594fbd9f27a2a6f7988481" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:02.029143 13790 raft_consensus.cc:3060] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.030162 13831 leader_election.cc:304] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:02.031358 14061 tablet_bootstrap.cc:654] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.031472 14177 raft_consensus.cc:2804] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.032050 14177 raft_consensus.cc:697] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:02.032907 14177 consensus_queue.cc:237] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.028419 14063 tablet_bootstrap.cc:654] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.041323 13790 raft_consensus.cc:2468] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:02.043033 13833 leader_election.cc:304] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:02.043236 14094 leader_election.cc:290] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:02.043989 14094 raft_consensus.cc:2804] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.044477 14094 raft_consensus.cc:697] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:02.044772 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6464fa5a5f594fbd9f27a2a6f7988481" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:02.045324 14094 consensus_queue.cc:237] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:02.046455 13831 leader_election.cc:343] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.048022 14062 consensus_queue.cc:260] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.049587 14060 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:02.050233 14060 ts_tablet_manager.cc:1403] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.115s	user 0.028s	sys 0.018s
I20260709 13:04:02.050488 14062 ts_tablet_manager.cc:1434] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:04:02.049593 14063 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:02.051169 14063 ts_tablet_manager.cc:1403] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 13:04:02.051481 14062 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:02.052230 14166 consensus_queue.cc:1048] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.053054 14060 raft_consensus.cc:359] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.053730 14060 raft_consensus.cc:385] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.053709 14063 raft_consensus.cc:359] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.054232 14060 raft_consensus.cc:740] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.054482 14063 raft_consensus.cc:385] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.054775 14063 raft_consensus.cc:740] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.055050 14060 consensus_queue.cc:260] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.055436 14063 consensus_queue.cc:260] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.057542 14060 ts_tablet_manager.cc:1434] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:04:02.058045 14061 tablet_bootstrap.cc:492] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:02.058550 14061 ts_tablet_manager.cc:1403] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.007s
I20260709 13:04:02.058842 14060 tablet_bootstrap.cc:492] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:02.059300 14062 tablet_bootstrap.cc:654] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.061247 14061 raft_consensus.cc:359] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.062033 14061 raft_consensus.cc:385] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.062309 14061 raft_consensus.cc:740] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.063040 14061 consensus_queue.cc:260] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.065229 14061 ts_tablet_manager.cc:1434] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:02.065900 14060 tablet_bootstrap.cc:654] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.066197 14061 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:02.070520 13687 catalog_manager.cc:5697] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.076267 14061 tablet_bootstrap.cc:654] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.071914 14063 ts_tablet_manager.cc:1434] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:02.077811 14063 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:02.078296 14147 consensus_queue.cc:1048] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.079281 14060 tablet_bootstrap.cc:492] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:02.079952 14060 ts_tablet_manager.cc:1403] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.001s
I20260709 13:04:02.083900 14060 raft_consensus.cc:359] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.084874 14060 raft_consensus.cc:385] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.085248 14060 raft_consensus.cc:740] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.085950 14201 raft_consensus.cc:493] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.086536 14201 raft_consensus.cc:515] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.089730 14201 leader_election.cc:290] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:02.093335 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:02.097846 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:02.099079 13939 raft_consensus.cc:2393] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:02.100785 13979 leader_election.cc:304] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:02.102305 14103 raft_consensus.cc:3060] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.102600 14201 raft_consensus.cc:493] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.103394 14201 raft_consensus.cc:515] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.107215 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b4b051be04869b067d3f67aa80a4e" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:02.107990 13866 raft_consensus.cc:2468] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:02.108913 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b4b051be04869b067d3f67aa80a4e" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:02.109624 13980 leader_election.cc:304] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:02.109992 13939 raft_consensus.cc:2468] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:02.110723 14085 raft_consensus.cc:2804] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.111162 14085 raft_consensus.cc:493] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.111557 14085 raft_consensus.cc:3060] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.117323 14201 leader_election.cc:290] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:02.118326 14102 raft_consensus.cc:493] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.086469 14060 consensus_queue.cc:260] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.119092 14102 raft_consensus.cc:515] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.122810 14060 ts_tablet_manager.cc:1434] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:04:02.123356 14102 leader_election.cc:290] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:02.125922 14062 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:02.126569 14062 ts_tablet_manager.cc:1403] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.005s
I20260709 13:04:02.127246 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:02.128290 14013 raft_consensus.cc:2468] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:02.129701 14062 raft_consensus.cc:359] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.130581 14062 raft_consensus.cc:385] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.130435 13757 leader_election.cc:304] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:02.130960 14062 raft_consensus.cc:740] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.131517 14189 consensus_queue.cc:1048] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.131848 14062 consensus_queue.cc:260] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.133173 14189 raft_consensus.cc:2804] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.134634 14062 ts_tablet_manager.cc:1434] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:02.135689 14062 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:02.133550 14189 raft_consensus.cc:493] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.138496 14189 raft_consensus.cc:3060] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.141954 14062 tablet_bootstrap.cc:654] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.142096 14166 consensus_queue.cc:1048] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.128361 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:02.149240 13756 leader_election.cc:343] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.149972 14060 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:02.156198 14062 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:02.156776 14062 ts_tablet_manager.cc:1403] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.011s
I20260709 13:04:02.160567 14062 raft_consensus.cc:359] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.161286 14062 raft_consensus.cc:385] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.161574 14062 raft_consensus.cc:740] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.162429 14062 consensus_queue.cc:260] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.164458 14062 ts_tablet_manager.cc:1434] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:02.165473 14062 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:02.164610 14085 raft_consensus.cc:515] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.186571 14060 tablet_bootstrap.cc:654] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.189258 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b4b051be04869b067d3f67aa80a4e" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:02.190193 13866 raft_consensus.cc:3060] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.168164 14103 raft_consensus.cc:2749] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.174769 14061 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:02.164816 14145 consensus_queue.cc:1048] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:04:02.192849 14062 tablet_bootstrap.cc:654] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.198187 14094 raft_consensus.cc:493] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.198967 14061 ts_tablet_manager.cc:1403] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.133s	user 0.038s	sys 0.062s
I20260709 13:04:02.198796 14094 raft_consensus.cc:515] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.205729 14143 raft_consensus.cc:493] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.206344 14143 raft_consensus.cc:515] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.207796 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83902dd19424f4d9f3707d53bafb0b5" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:02.208529 13792 raft_consensus.cc:2468] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:02.209995 13833 leader_election.cc:304] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:02.210220 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83902dd19424f4d9f3707d53bafb0b5" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:02.210968 14123 raft_consensus.cc:2804] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.211391 14123 raft_consensus.cc:493] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.211783 14123 raft_consensus.cc:3060] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.212739 14061 raft_consensus.cc:359] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.214032 14094 leader_election.cc:290] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:02.208638 14143 leader_election.cc:290] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:02.222555 14166 raft_consensus.cc:493] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.223287 14166 raft_consensus.cc:515] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.210284 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:02.227138 14166 leader_election.cc:290] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:02.222095 14061 raft_consensus.cc:385] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.228263 14061 raft_consensus.cc:740] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.228173 14123 raft_consensus.cc:515] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.229308 14061 consensus_queue.cc:260] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:02.230659 13757 leader_election.cc:343] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.231376 14061 ts_tablet_manager.cc:1434] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:04:02.231709 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83902dd19424f4d9f3707d53bafb0b5" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:02.231887 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6464fa5a5f594fbd9f27a2a6f7988481" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:02.232301 13792 raft_consensus.cc:3060] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.232401 14061 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:02.235210 14060 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:02.235735 14060 ts_tablet_manager.cc:1403] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.086s	user 0.028s	sys 0.011s
W20260709 13:04:02.216318 13832 leader_election.cc:343] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.237989 13790 raft_consensus.cc:1275] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:02.238531 14060 raft_consensus.cc:359] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.239259 14060 raft_consensus.cc:385] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.239530 14060 raft_consensus.cc:740] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.239789 14177 consensus_queue.cc:1048] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.240224 14061 tablet_bootstrap.cc:654] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.244582 14060 consensus_queue.cc:260] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.246673 13792 raft_consensus.cc:2468] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:02.246546 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83902dd19424f4d9f3707d53bafb0b5" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:02.247677 14013 raft_consensus.cc:3060] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.248481 14060 ts_tablet_manager.cc:1434] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:02.249488 14060 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:02.199980 13866 raft_consensus.cc:2468] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:02.259454 14182 consensus_queue.cc:1048] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.261087 14182 raft_consensus.cc:493] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.261556 14182 raft_consensus.cc:515] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.262136 14123 leader_election.cc:290] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:02.262115 14060 tablet_bootstrap.cc:654] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.263109 13833 leader_election.cc:304] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:02.265630 14182 leader_election.cc:290] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:02.269629 14182 raft_consensus.cc:2804] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.270293 14182 raft_consensus.cc:697] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:02.272183 13980 leader_election.cc:304] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:02.274652 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80485db7c3b94a4db01541f0e19253f4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:02.275494 14015 raft_consensus.cc:2468] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:02.275738 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:02.276211 14145 raft_consensus.cc:2804] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.276473 13941 raft_consensus.cc:2468] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:02.276811 14145 raft_consensus.cc:697] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:02.277078 13792 raft_consensus.cc:3060] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.278036 14145 consensus_queue.cc:237] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.279075 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6464fa5a5f594fbd9f27a2a6f7988481" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:02.280269 13791 raft_consensus.cc:2393] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 1: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
I20260709 13:04:02.282454 13756 leader_election.cc:304] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:02.283944 14102 raft_consensus.cc:2804] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.284448 14102 raft_consensus.cc:493] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.284106 13907 leader_election.cc:304] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:02.286831 14166 raft_consensus.cc:3060] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.287189 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80485db7c3b94a4db01541f0e19253f4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:02.284902 14102 raft_consensus.cc:3060] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.294428 14182 consensus_queue.cc:237] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.295840 14061 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:02.296450 14061 ts_tablet_manager.cc:1403] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.000s
I20260709 13:04:02.306262 14061 raft_consensus.cc:359] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.306972 14061 raft_consensus.cc:385] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.307279 14061 raft_consensus.cc:740] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.314992 14061 consensus_queue.cc:260] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.316711 14061 ts_tablet_manager.cc:1434] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:04:02.317377 14060 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:02.317828 14061 tablet_bootstrap.cc:492] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:02.318032 14060 ts_tablet_manager.cc:1403] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.069s	user 0.026s	sys 0.003s
I20260709 13:04:02.282297 13832 leader_election.cc:304] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:02.319765 14123 raft_consensus.cc:2804] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.321460 14123 raft_consensus.cc:493] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:02.322024 13833 leader_election.cc:343] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.321170 14060 raft_consensus.cc:359] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.325588 14060 raft_consensus.cc:385] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.324705 14061 tablet_bootstrap.cc:654] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.327046 14060 raft_consensus.cc:740] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.327694 14166 raft_consensus.cc:2749] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.328655 14102 raft_consensus.cc:515] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.328883 14060 consensus_queue.cc:260] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.331017 14102 leader_election.cc:290] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:02.331189 14060 ts_tablet_manager.cc:1434] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:02.324923 14123 raft_consensus.cc:3060] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.332254 13790 raft_consensus.cc:3060] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.332638 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
W20260709 13:04:02.334071 13757 leader_election.cc:343] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.341962 14085 leader_election.cc:290] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:02.332237 14060 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:02.348802 14063 tablet_bootstrap.cc:654] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.371058 14094 consensus_queue.cc:1048] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:02.373507 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:02.374272 13938 raft_consensus.cc:3060] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.374447 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b4b051be04869b067d3f67aa80a4e" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:02.375101 13939 raft_consensus.cc:3060] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.379588 14060 tablet_bootstrap.cc:654] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.382669 14015 raft_consensus.cc:1275] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:02.389801 14242 consensus_queue.cc:1048] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.392814 14102 raft_consensus.cc:493] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.394655 14013 raft_consensus.cc:2468] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:02.395747 14102 raft_consensus.cc:515] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.399104 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894a0cf3d92b439ba443a8b917912a68" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:02.399789 14102 leader_election.cc:290] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:02.399211 13687 catalog_manager.cc:5697] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.344552 14189 raft_consensus.cc:515] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.400938 13687 catalog_manager.cc:5697] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.399140 14123 raft_consensus.cc:515] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:02.415666 13756 leader_election.cc:343] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.417706 14123 leader_election.cc:290] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:02.419562 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894a0cf3d92b439ba443a8b917912a68" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:02.420403 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80485db7c3b94a4db01541f0e19253f4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:02.421054 14015 raft_consensus.cc:3060] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:02.421203 13757 leader_election.cc:343] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.421746 13757 leader_election.cc:304] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:02.423117 14102 raft_consensus.cc:2749] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.427954 14166 raft_consensus.cc:493] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.428673 14166 raft_consensus.cc:515] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.429244 14015 raft_consensus.cc:2468] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:02.431070 14166 leader_election.cc:290] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:02.432102 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:02.434381 13907 leader_election.cc:343] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.400297 14085 raft_consensus.cc:493] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.437633 14085 raft_consensus.cc:515] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.440287 13832 leader_election.cc:304] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:02.441875 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40d85c0caf94564b29d7771bd4691f4" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:02.444767 13979 leader_election.cc:343] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.456034 14094 raft_consensus.cc:2804] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.468304 14094 raft_consensus.cc:697] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:02.468937 14244 consensus_queue.cc:1048] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.469587 14094 consensus_queue.cc:237] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.474015 14102 consensus_queue.cc:1048] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.477155 14167 raft_consensus.cc:493] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.477725 14167 raft_consensus.cc:515] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.479928 14167 leader_election.cc:290] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
W20260709 13:04:02.402380 13833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 50398.8us
I20260709 13:04:02.481154 13939 raft_consensus.cc:2468] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:02.498832 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:02.512336 14062 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:02.512811 14062 ts_tablet_manager.cc:1403] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.348s	user 0.047s	sys 0.106s
I20260709 13:04:02.514045 14147 raft_consensus.cc:493] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.514832 14147 raft_consensus.cc:515] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.518563 14147 leader_election.cc:290] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:02.518841 14143 raft_consensus.cc:493] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.522835 14143 raft_consensus.cc:515] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.524053 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:02.524755 14060 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:02.525116 14061 tablet_bootstrap.cc:492] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:02.525309 14060 ts_tablet_manager.cc:1403] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.193s	user 0.031s	sys 0.021s
I20260709 13:04:02.524180 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:02.525610 14061 ts_tablet_manager.cc:1403] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.208s	user 0.028s	sys 0.017s
I20260709 13:04:02.527149 13757 leader_election.cc:304] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:02.511720 14013 raft_consensus.cc:2468] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:02.529151 13906 leader_election.cc:304] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:02.531075 14166 raft_consensus.cc:2804] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.531455 14166 raft_consensus.cc:493] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.531796 14166 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.529016 14060 raft_consensus.cc:359] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.532752 14060 raft_consensus.cc:385] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.533159 14060 raft_consensus.cc:740] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.536778 14060 consensus_queue.cc:260] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.533243 13689 catalog_manager.cc:5697] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.510572 13938 raft_consensus.cc:2468] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:02.556579 14063 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:02.557384 14063 ts_tablet_manager.cc:1403] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.480s	user 0.031s	sys 0.058s
I20260709 13:04:02.543692 14102 raft_consensus.cc:2749] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:02.568876 14062 raft_consensus.cc:359] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.569913 14062 raft_consensus.cc:385] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.570238 14062 raft_consensus.cc:740] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.570122 14061 raft_consensus.cc:359] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.574992 14061 raft_consensus.cc:385] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.575395 14061 raft_consensus.cc:740] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.582753 14061 consensus_queue.cc:260] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.579176 14189 leader_election.cc:290] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:02.598771 14060 ts_tablet_manager.cc:1434] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.073s	user 0.011s	sys 0.033s
I20260709 13:04:02.600354 14085 leader_election.cc:290] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:02.600996 14060 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:02.603163 14143 leader_election.cc:290] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:02.608955 14063 raft_consensus.cc:359] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.611544 14015 raft_consensus.cc:3060] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.610906 14060 tablet_bootstrap.cc:654] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.613229 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:02.614223 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:02.623353 14063 raft_consensus.cc:385] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.623793 14063 raft_consensus.cc:740] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.624529 14063 consensus_queue.cc:260] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.625319 14242 consensus_queue.cc:1048] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.626693 14061 ts_tablet_manager.cc:1434] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.003s
I20260709 13:04:02.627763 14061 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:02.634316 14166 raft_consensus.cc:515] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:02.611225 14062 consensus_queue.cc:260] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.636581 14166 leader_election.cc:290] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:02.635918 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7f9c6781bb4725847b8d5169cd3c02" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:02.637990 14063 ts_tablet_manager.cc:1434] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:04:02.633260 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:02.638041 14062 ts_tablet_manager.cc:1434] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.003s
I20260709 13:04:02.639362 14013 raft_consensus.cc:3060] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.640210 14062 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
W20260709 13:04:02.645141 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:39185, user_credentials={real_user=slave}} blocked reactor thread for 98973.9us
I20260709 13:04:02.639091 14063 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:02.680502 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:02.670449 14145 raft_consensus.cc:493] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.691710 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:02.692371 14012 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.683133 14085 consensus_queue.cc:1048] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:02.691548 13686 catalog_manager.cc:5697] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.695875 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7f9c6781bb4725847b8d5169cd3c02" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:02.686972 14145 raft_consensus.cc:515] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.698686 14145 leader_election.cc:290] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:02.700183 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:02.701925 13980 leader_election.cc:343] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.686240 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:02.706387 14244 consensus_queue.cc:1048] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.708736 14013 raft_consensus.cc:2468] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:02.710198 13757 leader_election.cc:304] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:02.710752 13756 leader_election.cc:304] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:02.711571 14253 consensus_queue.cc:1048] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
W20260709 13:04:02.688405 13906 leader_election.cc:343] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:02.713848 13906 leader_election.cc:343] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.714287 13906 leader_election.cc:304] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:02.719288 14102 raft_consensus.cc:2804] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.715126 14061 tablet_bootstrap.cc:654] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.716499 13689 catalog_manager.cc:5697] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.719905 14189 raft_consensus.cc:2804] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.722759 14102 raft_consensus.cc:697] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:02.723199 14189 raft_consensus.cc:697] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:02.723728 14102 consensus_queue.cc:237] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.723999 14189 consensus_queue.cc:237] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.729523 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40d85c0caf94564b29d7771bd4691f4" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:02.748009 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80485db7c3b94a4db01541f0e19253f4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:02.749694 14012 raft_consensus.cc:2468] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:02.749959 14257 raft_consensus.cc:2749] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:02.756510 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:02.757897 14062 tablet_bootstrap.cc:654] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.748479 14060 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:02.763829 14060 ts_tablet_manager.cc:1403] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.163s	user 0.023s	sys 0.006s
W20260709 13:04:02.745347 13756 leader_election.cc:343] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.770587 13756 leader_election.cc:304] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:02.775588 14102 raft_consensus.cc:2749] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:02.777815 14063 tablet_bootstrap.cc:654] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:02.761991 13906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 45501us
I20260709 13:04:02.788669 14182 consensus_queue.cc:1048] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:02.796522 13906 leader_election.cc:343] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.798391 13689 catalog_manager.cc:5697] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.811847 14244 raft_consensus.cc:493] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.812708 14244 raft_consensus.cc:515] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.822620 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:02.823638 13940 raft_consensus.cc:2468] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:02.825078 13831 leader_election.cc:304] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:02.826539 14182 raft_consensus.cc:2804] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.827114 14182 raft_consensus.cc:493] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.827551 14182 raft_consensus.cc:3060] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.829385 13689 catalog_manager.cc:5697] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.848739 14103 consensus_queue.cc:1048] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.832455 14244 leader_election.cc:290] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:02.854298 14085 consensus_queue.cc:1048] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.858721 13906 leader_election.cc:304] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:02.862885 14257 raft_consensus.cc:2804] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.864439 14257 raft_consensus.cc:697] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:02.865445 14257 consensus_queue.cc:237] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
W20260709 13:04:02.873227 13981 leader_election.cc:343] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.874003 13981 leader_election.cc:304] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
W20260709 13:04:02.874414 13833 leader_election.cc:343] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.875757 14060 raft_consensus.cc:359] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.875962 14244 consensus_queue.cc:1048] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.876303 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:02.876686 14060 raft_consensus.cc:385] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.877040 14060 raft_consensus.cc:740] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.877086 13789 raft_consensus.cc:2468] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:02.878331 14085 raft_consensus.cc:2749] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.880820 14060 consensus_queue.cc:260] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:02.895051 14060 ts_tablet_manager.cc:1434] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.003s
I20260709 13:04:02.896384 14060 tablet_bootstrap.cc:492] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:02.925081 14062 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:02.925664 14062 ts_tablet_manager.cc:1403] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.286s	user 0.042s	sys 0.039s
I20260709 13:04:02.934904 14062 raft_consensus.cc:359] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.935817 14062 raft_consensus.cc:385] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.936093 14062 raft_consensus.cc:740] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.936844 14062 consensus_queue.cc:260] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:02.940708 14060 tablet_bootstrap.cc:654] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.954824 14061 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:02.955355 14061 ts_tablet_manager.cc:1403] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.328s	user 0.012s	sys 0.036s
I20260709 13:04:02.956182 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:02.958329 14063 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:02.958890 14063 ts_tablet_manager.cc:1403] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.320s	user 0.035s	sys 0.039s
I20260709 13:04:02.962991 14166 raft_consensus.cc:493] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.963797 14166 raft_consensus.cc:515] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:02.965958 13981 leader_election.cc:343] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.966487 13981 leader_election.cc:304] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:02.943230 14244 consensus_queue.cc:1048] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:04:02.968886 14145 raft_consensus.cc:2749] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.969069 14244 consensus_queue.cc:1048] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.961592 14063 raft_consensus.cc:359] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.975729 14063 raft_consensus.cc:385] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.976004 14063 raft_consensus.cc:740] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.976677 14063 consensus_queue.cc:260] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:02.979310 14063 ts_tablet_manager.cc:1434] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:02.980099 14063 tablet_bootstrap.cc:492] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:02.981168 14062 ts_tablet_manager.cc:1434] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:04:02.982084 14062 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:02.984757 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40d85c0caf94564b29d7771bd4691f4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:02.985733 14012 raft_consensus.cc:2468] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:02.987404 13906 leader_election.cc:304] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:03.002235 14166 leader_election.cc:290] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:03.006386 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40d85c0caf94564b29d7771bd4691f4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:03.003979 14257 raft_consensus.cc:2804] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.021044 14257 raft_consensus.cc:493] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:03.031809 13907 leader_election.cc:343] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.039980 13689 catalog_manager.cc:5697] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.045357 14182 raft_consensus.cc:515] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.048497 14182 leader_election.cc:290] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:03.049141 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:03.049850 13941 raft_consensus.cc:3060] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.052368 14166 raft_consensus.cc:493] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.052696 14063 tablet_bootstrap.cc:654] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.032318 14257 raft_consensus.cc:3060] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.054991 14166 raft_consensus.cc:515] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.058873 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:03.059535 13792 raft_consensus.cc:3060] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.060513 14166 leader_election.cc:290] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:03.063500 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:03.066210 13941 raft_consensus.cc:2468] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:03.070730 14061 raft_consensus.cc:359] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.084977 14061 raft_consensus.cc:385] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.073905 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:03.085366 14061 raft_consensus.cc:740] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.085886 14013 raft_consensus.cc:2393] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:03.086285 14061 consensus_queue.cc:260] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.086859 13831 leader_election.cc:304] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:03.088723 14061 ts_tablet_manager.cc:1434] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.133s	user 0.007s	sys 0.000s
I20260709 13:04:03.088912 13906 leader_election.cc:304] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:03.089762 14276 raft_consensus.cc:2804] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.081959 13792 raft_consensus.cc:2468] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:03.083467 14177 raft_consensus.cc:493] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.091334 14177 raft_consensus.cc:515] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.093304 14166 raft_consensus.cc:3060] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.089947 14061 tablet_bootstrap.cc:492] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:03.093775 14177 leader_election.cc:290] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:03.094631 14060 tablet_bootstrap.cc:492] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:03.094935 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:03.095659 14060 ts_tablet_manager.cc:1403] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.200s	user 0.012s	sys 0.001s
I20260709 13:04:03.096093 13941 raft_consensus.cc:2393] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97c52f3e93434bedbdc9755e64f33d4f in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:03.098632 14060 raft_consensus.cc:359] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.099378 14060 raft_consensus.cc:385] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.099649 14060 raft_consensus.cc:740] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.100325 14257 raft_consensus.cc:515] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.100431 14060 consensus_queue.cc:260] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.102649 14257 leader_election.cc:290] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:03.104593 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40d85c0caf94564b29d7771bd4691f4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:03.105396 14013 raft_consensus.cc:3060] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.108497 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:03.110175 13791 raft_consensus.cc:3060] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.112282 13833 leader_election.cc:304] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:03.107635 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40d85c0caf94564b29d7771bd4691f4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
W20260709 13:04:03.113870 13907 leader_election.cc:343] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.114745 14274 raft_consensus.cc:3060] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.115952 14063 tablet_bootstrap.cc:492] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:03.116534 14063 ts_tablet_manager.cc:1403] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.137s	user 0.008s	sys 0.002s
I20260709 13:04:03.118014 14013 raft_consensus.cc:2468] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:03.119297 13906 leader_election.cc:304] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:03.119764 14276 raft_consensus.cc:697] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:03.119596 14244 consensus_queue.cc:1048] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.121755 14276 consensus_queue.cc:237] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.122265 14165 raft_consensus.cc:2804] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.122898 14165 raft_consensus.cc:697] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:03.123795 14165 consensus_queue.cc:237] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.115850 14060 ts_tablet_manager.cc:1434] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:03.119342 14063 raft_consensus.cc:359] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.082134 14062 tablet_bootstrap.cc:654] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.127121 14063 raft_consensus.cc:385] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.128176 14060 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:03.128316 14063 raft_consensus.cc:740] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.131685 14063 consensus_queue.cc:260] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.144150 14063 ts_tablet_manager.cc:1434] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:04:03.144282 14061 tablet_bootstrap.cc:654] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.146205 14063 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:03.140944 14274 raft_consensus.cc:2749] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.173772 14060 tablet_bootstrap.cc:654] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.175710 14189 consensus_queue.cc:1048] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.179102 14062 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:03.179852 14062 ts_tablet_manager.cc:1403] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.004s
I20260709 13:04:03.182497 14257 raft_consensus.cc:493] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.183106 14257 raft_consensus.cc:515] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.184779 14063 tablet_bootstrap.cc:654] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.187481 14166 raft_consensus.cc:2749] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.187830 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a5b7830c74a849bdaee0374a8cabf" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:03.188767 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a5b7830c74a849bdaee0374a8cabf" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:03.194867 13906 leader_election.cc:343] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:03.195837 13906 leader_election.cc:343] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.196091 14060 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:03.195994 14254 consensus_queue.cc:1048] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.196755 14060 ts_tablet_manager.cc:1403] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.004s
I20260709 13:04:03.196460 13906 leader_election.cc:304] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:03.200014 14060 raft_consensus.cc:359] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.200664 14062 raft_consensus.cc:359] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.206130 14062 raft_consensus.cc:385] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.206741 14062 raft_consensus.cc:740] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.202025 14166 raft_consensus.cc:2749] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.208307 14062 consensus_queue.cc:260] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.185598 14257 leader_election.cc:290] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:03.212044 14062 ts_tablet_manager.cc:1434] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.004s
I20260709 13:04:03.200752 14060 raft_consensus.cc:385] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.221050 14060 raft_consensus.cc:740] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.221640 14062 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:03.229686 14062 tablet_bootstrap.cc:654] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.235363 14060 consensus_queue.cc:260] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.259079 14060 ts_tablet_manager.cc:1434] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:04:03.260115 14060 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:03.280905 14063 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:03.281605 14063 ts_tablet_manager.cc:1403] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.136s	user 0.019s	sys 0.029s
I20260709 13:04:03.286103 13866 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.287454 14063 raft_consensus.cc:359] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.288600 14063 raft_consensus.cc:385] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.289012 14063 raft_consensus.cc:740] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.290074 14063 consensus_queue.cc:260] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.293725 14063 ts_tablet_manager.cc:1434] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:03.295288 14063 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:03.302337 14102 consensus_queue.cc:1048] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.303946 14102 consensus_queue.cc:1048] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.296325 13686 catalog_manager.cc:5697] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.328315 14063 tablet_bootstrap.cc:654] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.339646 14061 tablet_bootstrap.cc:492] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:03.340272 14061 ts_tablet_manager.cc:1403] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.251s	user 0.047s	sys 0.044s
I20260709 13:04:03.343611 14061 raft_consensus.cc:359] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.344358 14061 raft_consensus.cc:385] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.344736 14061 raft_consensus.cc:740] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.346117 14061 consensus_queue.cc:260] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.357821 14094 raft_consensus.cc:493] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.358428 14094 raft_consensus.cc:515] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.361605 14166 consensus_queue.cc:1048] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.365384 14094 leader_election.cc:290] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:03.360029 14060 tablet_bootstrap.cc:654] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.367046 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:03.369212 14061 ts_tablet_manager.cc:1434] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 13:04:03.370663 14061 tablet_bootstrap.cc:492] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:03.368527 14013 raft_consensus.cc:2468] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:03.374455 13832 leader_election.cc:304] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:03.374516 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:03.393344 14094 raft_consensus.cc:2804] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:03.395311 14094 raft_consensus.cc:493] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48967ca777ee43ebaddd57da674bd3e1)
I20260709 13:04:03.395812 14094 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.399375 14061 tablet_bootstrap.cc:654] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.403389 13688 catalog_manager.cc:5697] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.409209 14062 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:03.409828 14062 ts_tablet_manager.cc:1403] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.004s
I20260709 13:04:03.413129 14250 consensus_queue.cc:1048] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.415884 14094 raft_consensus.cc:515] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.413255 14062 raft_consensus.cc:359] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.418656 14060 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:03.419188 14060 ts_tablet_manager.cc:1403] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.159s	user 0.021s	sys 0.009s
I20260709 13:04:03.418244 14062 raft_consensus.cc:385] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.420513 14063 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:03.420691 14062 raft_consensus.cc:740] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.421020 14063 ts_tablet_manager.cc:1403] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.008s
I20260709 13:04:03.421856 14062 consensus_queue.cc:260] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.424330 14063 raft_consensus.cc:359] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.425016 14062 ts_tablet_manager.cc:1434] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:03.425081 14063 raft_consensus.cc:385] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.426287 13867 raft_consensus.cc:1240] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Rejecting Update request from peer 48967ca777ee43ebaddd57da674bd3e1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:03.426542 14062 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:03.430225 14061 tablet_bootstrap.cc:492] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:03.435657 14061 ts_tablet_manager.cc:1403] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.006s
I20260709 13:04:03.426314 14063 raft_consensus.cc:740] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.434409 14250 consensus_queue.cc:1059] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.436424 14250 raft_consensus.cc:3055] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.436794 14250 raft_consensus.cc:740] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:03.437631 14250 consensus_queue.cc:260] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.438553 14061 raft_consensus.cc:359] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.432257 14060 raft_consensus.cc:359] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.438844 14250 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.439108 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:03.439322 14060 raft_consensus.cc:385] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.439689 14060 raft_consensus.cc:740] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.440088 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:03.440382 14060 consensus_queue.cc:260] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.442154 14063 consensus_queue.cc:260] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.442999 14060 ts_tablet_manager.cc:1434] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:04:03.443907 14060 tablet_bootstrap.cc:492] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:03.444408 14063 ts_tablet_manager.cc:1434] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:04:03.445438 14063 tablet_bootstrap.cc:492] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:03.445750 14145 raft_consensus.cc:493] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.446305 14145 raft_consensus.cc:515] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.434932 14094 leader_election.cc:290] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:03.449931 14060 tablet_bootstrap.cc:654] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.451866 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894a0cf3d92b439ba443a8b917912a68" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:03.452744 14061 raft_consensus.cc:385] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.453069 14061 raft_consensus.cc:740] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.453851 14061 consensus_queue.cc:260] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.454526 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894a0cf3d92b439ba443a8b917912a68" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:03.455170 13940 raft_consensus.cc:2468] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:03.433624 14062 tablet_bootstrap.cc:654] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.458308 14061 ts_tablet_manager.cc:1434] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:03.459278 14061 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:03.462304 14063 tablet_bootstrap.cc:654] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.466020 14061 tablet_bootstrap.cc:654] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.466637 14253 raft_consensus.cc:493] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.467070 13979 leader_election.cc:304] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:03.467152 14253 raft_consensus.cc:515] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.468318 14232 raft_consensus.cc:2804] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.468695 14232 raft_consensus.cc:493] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.469060 14232 raft_consensus.cc:3060] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.470306 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40d85c0caf94564b29d7771bd4691f4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:03.472177 14063 tablet_bootstrap.cc:492] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:03.472700 14063 ts_tablet_manager.cc:1403] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:04:03.473910 14253 leader_election.cc:290] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:03.474356 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40d85c0caf94564b29d7771bd4691f4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:03.475250 14015 raft_consensus.cc:2393] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 48967ca777ee43ebaddd57da674bd3e1 in this term.
I20260709 13:04:03.452602 13789 raft_consensus.cc:2468] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:03.478111 14063 raft_consensus.cc:359] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.478873 14063 raft_consensus.cc:385] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.479144 14063 raft_consensus.cc:740] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.479837 14063 consensus_queue.cc:260] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.480470 13757 leader_election.cc:304] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:03.481567 14253 raft_consensus.cc:3060] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.483248 14063 ts_tablet_manager.cc:1434] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:03.484289 14063 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:03.465657 13941 raft_consensus.cc:2468] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 2.
I20260709 13:04:03.490818 14063 tablet_bootstrap.cc:654] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.494171 14145 leader_election.cc:290] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:03.495476 14253 raft_consensus.cc:2749] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.500216 14061 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:03.503139 14063 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:03.500828 14061 ts_tablet_manager.cc:1403] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.003s
I20260709 13:04:03.503682 14063 ts_tablet_manager.cc:1403] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:04:03.506552 14063 raft_consensus.cc:359] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.507253 14063 raft_consensus.cc:385] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.507532 14063 raft_consensus.cc:740] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.508121 14061 raft_consensus.cc:359] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.508883 14061 raft_consensus.cc:385] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.508577 14063 consensus_queue.cc:260] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.509052 13831 leader_election.cc:304] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:03.510310 14094 raft_consensus.cc:2804] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.511008 14094 raft_consensus.cc:697] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:03.505867 14232 raft_consensus.cc:515] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.509195 14061 raft_consensus.cc:740] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.519150 14061 consensus_queue.cc:260] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.521400 14061 ts_tablet_manager.cc:1434] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:04:03.521682 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894a0cf3d92b439ba443a8b917912a68" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:03.522361 13789 raft_consensus.cc:3060] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.522461 14061 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:03.511883 14094 consensus_queue.cc:237] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.513772 14063 ts_tablet_manager.cc:1434] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:03.529198 14063 tablet_bootstrap.cc:492] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:03.527762 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894a0cf3d92b439ba443a8b917912a68" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:03.529836 13941 raft_consensus.cc:3060] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.535084 14063 tablet_bootstrap.cc:654] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.543155 13686 catalog_manager.cc:5697] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 1 to 2, leader changed from 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195) to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.543419 14061 tablet_bootstrap.cc:654] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.552126 14145 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.552886 14145 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.556677 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:03.560667 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:03.563244 13981 leader_election.cc:343] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.564917 14145 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
W20260709 13:04:03.566160 13979 leader_election.cc:343] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.573326 13979 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:03.574594 14103 raft_consensus.cc:2749] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.576445 14232 leader_election.cc:290] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:03.580052 13789 raft_consensus.cc:2468] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:03.582006 13981 leader_election.cc:304] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:03.583341 14232 raft_consensus.cc:2804] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.584290 14232 raft_consensus.cc:697] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:03.585485 14232 consensus_queue.cc:237] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.596851 13941 raft_consensus.cc:2468] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:03.608132 14250 consensus_queue.cc:1048] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.610443 14253 raft_consensus.cc:493] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.611222 14253 raft_consensus.cc:515] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.614869 14253 leader_election.cc:290] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:03.617697 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:03.618728 13867 raft_consensus.cc:2468] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:03.620823 13757 leader_election.cc:304] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:03.623232 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:03.624187 14015 raft_consensus.cc:2468] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:03.643836 14102 raft_consensus.cc:2804] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.644279 14102 raft_consensus.cc:493] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.644624 14102 raft_consensus.cc:3060] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.650393 14166 consensus_queue.cc:1048] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.651345 14094 consensus_queue.cc:1048] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.652899 14102 raft_consensus.cc:515] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.656725 14102 leader_election.cc:290] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:03.660611 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:03.662218 13867 raft_consensus.cc:3060] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.670776 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:03.688951 14276 consensus_queue.cc:1048] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.693779 14244 raft_consensus.cc:493] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.697731 14244 raft_consensus.cc:515] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.702260 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84199221e2c348f0a790594df18c571e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:03.703198 14012 raft_consensus.cc:2468] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:03.705148 13832 leader_election.cc:304] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:03.706646 14307 raft_consensus.cc:2804] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.707243 14307 raft_consensus.cc:493] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.707676 14307 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.698159 14013 raft_consensus.cc:3060] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.706709 14244 leader_election.cc:290] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:03.726977 14274 raft_consensus.cc:493] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.727810 14274 raft_consensus.cc:515] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.732551 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:03.733662 14274 leader_election.cc:290] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
W20260709 13:04:03.734161 13833 leader_election.cc:343] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.736174 14063 tablet_bootstrap.cc:492] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:03.736182 14062 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:03.736972 14062 ts_tablet_manager.cc:1403] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.311s	user 0.054s	sys 0.055s
I20260709 13:04:03.736972 14063 ts_tablet_manager.cc:1403] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.208s	user 0.051s	sys 0.038s
I20260709 13:04:03.740198 14060 tablet_bootstrap.cc:492] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:03.740137 14063 raft_consensus.cc:359] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.740806 14060 ts_tablet_manager.cc:1403] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.297s	user 0.045s	sys 0.057s
I20260709 13:04:03.740988 14063 raft_consensus.cc:385] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.743912 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84199221e2c348f0a790594df18c571e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:03.744308 14063 raft_consensus.cc:740] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.743396 14062 raft_consensus.cc:359] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.744781 14062 raft_consensus.cc:385] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.745057 14062 raft_consensus.cc:740] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.717610 14307 raft_consensus.cc:515] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.745057 14063 consensus_queue.cc:260] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.746019 14062 consensus_queue.cc:260] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.747501 14307 leader_election.cc:290] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:03.748764 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:03.750514 14061 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
W20260709 13:04:03.750438 13832 leader_election.cc:343] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.750988 13832 leader_election.cc:304] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:03.752281 14061 ts_tablet_manager.cc:1403] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.230s	user 0.010s	sys 0.070s
I20260709 13:04:03.754259 14063 ts_tablet_manager.cc:1434] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:04:03.745085 14060 raft_consensus.cc:359] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.755929 14060 raft_consensus.cc:385] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.756227 14060 raft_consensus.cc:740] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.756279 14244 raft_consensus.cc:2749] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.756718 14062 ts_tablet_manager.cc:1434] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:04:03.755622 14063 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:03.757692 14062 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:03.764719 14063 tablet_bootstrap.cc:654] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.768793 14062 tablet_bootstrap.cc:654] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.779115 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84199221e2c348f0a790594df18c571e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:03.779314 14060 consensus_queue.cc:260] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.781553 14060 ts_tablet_manager.cc:1434] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.002s
I20260709 13:04:03.782606 14060 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:03.782894 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84199221e2c348f0a790594df18c571e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:03.783638 14015 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.784566 14061 raft_consensus.cc:359] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.785323 14061 raft_consensus.cc:385] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.785611 14061 raft_consensus.cc:740] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.786741 14063 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:03.787377 14063 ts_tablet_manager.cc:1403] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.014s
I20260709 13:04:03.788914 13941 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.786348 14061 consensus_queue.cc:260] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.792493 14061 ts_tablet_manager.cc:1434] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:04:03.793610 14061 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
W20260709 13:04:03.794689 13831 leader_election.cc:343] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.797210 14062 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:03.799881 14060 tablet_bootstrap.cc:654] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.800230 14062 ts_tablet_manager.cc:1403] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.002s
I20260709 13:04:03.803481 14062 raft_consensus.cc:359] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.804387 14062 raft_consensus.cc:385] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.804674 14062 raft_consensus.cc:740] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.805861 14061 tablet_bootstrap.cc:654] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.805420 14062 consensus_queue.cc:260] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.807063 14145 raft_consensus.cc:493] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.807821 14062 ts_tablet_manager.cc:1434] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:03.807605 14145 raft_consensus.cc:515] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.798874 14063 raft_consensus.cc:359] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.808640 14063 raft_consensus.cc:385] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.808827 14062 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:03.808935 14063 raft_consensus.cc:740] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.809752 14063 consensus_queue.cc:260] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.810616 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:03.811287 13866 raft_consensus.cc:2468] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:03.811866 14063 ts_tablet_manager.cc:1434] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:04:03.812737 13980 leader_election.cc:304] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:03.813686 14063 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:03.816255 14145 leader_election.cc:290] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
W20260709 13:04:03.818562 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:03.819514 14103 raft_consensus.cc:2804] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.820451 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:03.820436 14063 tablet_bootstrap.cc:654] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:03.826320 13979 leader_election.cc:343] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.827278 14103 raft_consensus.cc:493] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.827795 14103 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.834278 14060 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:03.834915 14060 ts_tablet_manager.cc:1403] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.013s
I20260709 13:04:03.837877 14060 raft_consensus.cc:359] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.838604 14060 raft_consensus.cc:385] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.841120 14063 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:03.841730 14063 ts_tablet_manager.cc:1403] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:04:03.848100 14063 raft_consensus.cc:359] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.848850 14063 raft_consensus.cc:385] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.849165 14063 raft_consensus.cc:740] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.848852 14062 tablet_bootstrap.cc:654] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.852034 14061 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:03.853893 14061 ts_tablet_manager.cc:1403] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.010s
I20260709 13:04:03.855410 14306 raft_consensus.cc:493] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:03.856124 13980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 43503.4us
I20260709 13:04:03.856541 14166 raft_consensus.cc:493] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.838896 14060 raft_consensus.cc:740] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.856968 14061 raft_consensus.cc:359] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.857106 14166 raft_consensus.cc:515] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:03.857761 14061 raft_consensus.cc:385] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.858108 14061 raft_consensus.cc:740] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.858749 14061 consensus_queue.cc:260] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.859398 14166 leader_election.cc:290] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:03.861017 14061 ts_tablet_manager.cc:1434] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:04:03.861554 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:03.849936 14063 consensus_queue.cc:260] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.861758 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:03.857775 14060 consensus_queue.cc:260] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:03.864151 13907 leader_election.cc:343] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:03.865360 13906 leader_election.cc:343] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.865150 14103 raft_consensus.cc:515] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.865896 13906 leader_election.cc:304] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:03.855988 14306 raft_consensus.cc:515] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.868549 14306 leader_election.cc:290] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:03.868647 14103 leader_election.cc:290] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:03.870158 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:03.870823 13789 raft_consensus.cc:2468] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:03.868561 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:03.872545 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:03.873198 13866 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.875458 14060 ts_tablet_manager.cc:1434] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:04:03.878774 14250 raft_consensus.cc:2749] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:03.879870 13979 leader_election.cc:343] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.880990 13833 leader_election.cc:304] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:03.881856 14013 raft_consensus.cc:2468] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:03.883353 13757 leader_election.cc:304] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:03.883905 13867 raft_consensus.cc:2468] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:03.884920 14189 raft_consensus.cc:2804] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.885516 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:03.886339 13940 raft_consensus.cc:2468] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:03.885537 14189 raft_consensus.cc:697] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:03.887986 14189 consensus_queue.cc:237] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.889045 14063 ts_tablet_manager.cc:1434] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:04:03.890254 14063 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:03.893071 14274 raft_consensus.cc:2804] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.893910 14060 tablet_bootstrap.cc:492] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:03.897487 13687 catalog_manager.cc:5697] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.901907 14061 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:03.899682 13941 raft_consensus.cc:2468] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:03.893625 14274 raft_consensus.cc:493] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.902562 14274 raft_consensus.cc:3060] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.900772 14306 raft_consensus.cc:493] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.905035 14306 raft_consensus.cc:515] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.908290 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:03.910178 13833 leader_election.cc:343] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.912664 14061 tablet_bootstrap.cc:654] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.914903 14063 tablet_bootstrap.cc:654] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.901325 14060 tablet_bootstrap.cc:654] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.904313 13866 raft_consensus.cc:2468] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:03.917023 13980 leader_election.cc:304] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:03.918720 14232 raft_consensus.cc:2804] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.919497 14232 raft_consensus.cc:697] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:03.927793 14306 leader_election.cc:290] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:03.937141 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:03.940054 13831 leader_election.cc:343] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.940774 13831 leader_election.cc:304] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:03.942590 14307 raft_consensus.cc:2749] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.948956 14103 raft_consensus.cc:493] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.949677 14103 raft_consensus.cc:515] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:03.921154 14232 consensus_queue.cc:237] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.954857 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:03.901268 14015 raft_consensus.cc:2468] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
W20260709 13:04:03.964401 13981 leader_election.cc:343] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.966142 13831 leader_election.cc:304] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:03.967841 14307 raft_consensus.cc:2804] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.968479 14307 raft_consensus.cc:697] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:03.969673 14307 consensus_queue.cc:237] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:03.980155 14061 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:03.980700 14061 ts_tablet_manager.cc:1403] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.119s	user 0.009s	sys 0.009s
I20260709 13:04:03.989259 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:03.990793 13980 leader_election.cc:343] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.987128 14103 leader_election.cc:290] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:03.991349 13980 leader_election.cc:304] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:03.992218 14103 raft_consensus.cc:2749] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.990566 14274 raft_consensus.cc:515] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:03.987514 13687 catalog_manager.cc:5697] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.997925 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:03.998607 13941 raft_consensus.cc:3060] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.999569 14274 leader_election.cc:290] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:03.999856 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:04.000746 13789 raft_consensus.cc:3060] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.002558 13939 raft_consensus.cc:1275] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.004793 14244 consensus_queue.cc:1048] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:04.007395 13941 raft_consensus.cc:2468] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:04.008275 14063 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:04.009320 14063 ts_tablet_manager.cc:1403] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.009s
I20260709 13:04:03.997079 14061 raft_consensus.cc:359] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.010106 14061 raft_consensus.cc:385] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.010427 14061 raft_consensus.cc:740] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.010679 14062 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:04.011113 14061 consensus_queue.cc:260] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.011374 14062 ts_tablet_manager.cc:1403] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.203s	user 0.008s	sys 0.012s
I20260709 13:04:04.013337 14060 tablet_bootstrap.cc:492] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:04.013835 14060 ts_tablet_manager.cc:1403] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.138s	user 0.023s	sys 0.043s
I20260709 13:04:04.015847 14061 ts_tablet_manager.cc:1434] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:04:04.018394 14060 raft_consensus.cc:359] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:04.019171 14060 raft_consensus.cc:385] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.018936 14063 raft_consensus.cc:359] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.019436 14060 raft_consensus.cc:740] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.019627 14063 raft_consensus.cc:385] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.019933 14063 raft_consensus.cc:740] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.020200 14060 consensus_queue.cc:260] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:04.020605 14063 consensus_queue.cc:260] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.021976 13831 leader_election.cc:304] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:04.023531 14276 raft_consensus.cc:2804] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.023844 14063 ts_tablet_manager.cc:1434] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:04.024006 14276 raft_consensus.cc:697] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:04.024870 14063 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:04.013113 14015 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.027514 14060 ts_tablet_manager.cc:1434] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:04.028573 14060 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:04.024936 14276 consensus_queue.cc:237] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.021224 13688 catalog_manager.cc:5697] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.034884 14061 tablet_bootstrap.cc:492] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:04.036273 14060 tablet_bootstrap.cc:654] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.008658 14274 raft_consensus.cc:493] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.040228 14062 raft_consensus.cc:359] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.047835 14062 raft_consensus.cc:385] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.048185 14062 raft_consensus.cc:740] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.048818 14062 consensus_queue.cc:260] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.042531 14063 tablet_bootstrap.cc:654] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.043942 14015 raft_consensus.cc:1275] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.037352 14274 raft_consensus.cc:515] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.056262 14062 ts_tablet_manager.cc:1434] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.002s
I20260709 13:04:04.053064 13687 catalog_manager.cc:5697] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.065502 14307 consensus_queue.cc:1048] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.072784 14062 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:04.078938 14274 leader_election.cc:290] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:04.083359 14061 tablet_bootstrap.cc:654] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.089104 14062 tablet_bootstrap.cc:654] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.073936 13789 raft_consensus.cc:2468] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:04.093670 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbed8f0ccba4b5fabb54cdb9abcead1" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:04.095078 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbed8f0ccba4b5fabb54cdb9abcead1" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:04.107910 13833 leader_election.cc:343] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:04.113380 13831 leader_election.cc:343] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.114110 13831 leader_election.cc:304] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.115223 14307 raft_consensus.cc:2749] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.124409 14232 consensus_queue.cc:1048] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.132656 14102 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.133296 14102 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.139470 13687 catalog_manager.cc:5697] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.140461 14102 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:04.142244 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:04.143911 13756 leader_election.cc:343] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.145967 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:04.147143 14015 raft_consensus.cc:2468] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:04.148970 13757 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:04.152139 14102 raft_consensus.cc:2804] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.155450 14102 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.155958 14102 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.191213 14063 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:04.191977 14063 ts_tablet_manager.cc:1403] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.167s	user 0.010s	sys 0.012s
I20260709 13:04:04.198515 14060 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:04.199219 14060 ts_tablet_manager.cc:1403] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.171s	user 0.025s	sys 0.016s
I20260709 13:04:04.211776 14166 raft_consensus.cc:493] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.212390 14166 raft_consensus.cc:515] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.214058 14063 raft_consensus.cc:359] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.215895 14063 raft_consensus.cc:385] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.216879 14060 raft_consensus.cc:359] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.217461 14060 raft_consensus.cc:385] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.218643 14062 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:04.219122 14062 ts_tablet_manager.cc:1403] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.147s	user 0.037s	sys 0.023s
I20260709 13:04:04.185631 14102 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.217659 14060 raft_consensus.cc:740] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.216104 14063 raft_consensus.cc:740] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.224045 14063 consensus_queue.cc:260] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.225924 14232 raft_consensus.cc:493] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.229080 14232 raft_consensus.cc:515] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.233251 14232 leader_election.cc:290] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:04.228066 14060 consensus_queue.cc:260] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.236153 14063 ts_tablet_manager.cc:1434] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.003s
I20260709 13:04:04.237097 14063 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:04.248293 14166 leader_election.cc:290] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:04.254313 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:04.254509 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
W20260709 13:04:04.255821 13756 leader_election.cc:343] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.256323 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d165767a6eb84e0ab6e475cb48c542ae" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:04.248929 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d165767a6eb84e0ab6e475cb48c542ae" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:04.258188 13906 leader_election.cc:343] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.258337 13866 raft_consensus.cc:2468] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:04.249390 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:04.259673 13980 leader_election.cc:304] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:04.261240 14102 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:04.261603 14232 raft_consensus.cc:2804] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.261935 14060 ts_tablet_manager.cc:1434] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.004s
I20260709 13:04:04.262113 14232 raft_consensus.cc:493] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.262533 14232 raft_consensus.cc:3060] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:04.263937 13981 leader_election.cc:343] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.265177 14062 raft_consensus.cc:359] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.268430 14061 tablet_bootstrap.cc:492] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:04.269284 14061 ts_tablet_manager.cc:1403] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.235s	user 0.034s	sys 0.000s
I20260709 13:04:04.269708 14060 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:04.272217 14061 raft_consensus.cc:359] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:04.272938 14061 raft_consensus.cc:385] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.273203 14061 raft_consensus.cc:740] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.268347 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:04.274413 14062 raft_consensus.cc:385] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.275122 14062 raft_consensus.cc:740] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.276357 14062 consensus_queue.cc:260] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.274526 14015 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.278980 14062 ts_tablet_manager.cc:1434] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.060s	user 0.000s	sys 0.007s
W20260709 13:04:04.279778 13907 leader_election.cc:343] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.280486 13907 leader_election.cc:304] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.281004 14062 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:04.281761 14250 raft_consensus.cc:2749] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.286473 14145 consensus_queue.cc:1048] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.273775 14061 consensus_queue.cc:260] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:04.291553 14061 ts_tablet_manager.cc:1434] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:04.302626 14061 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:04.303758 14232 raft_consensus.cc:515] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.306684 14060 tablet_bootstrap.cc:654] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.307329 14063 tablet_bootstrap.cc:654] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.299631 14015 raft_consensus.cc:2468] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:04.311847 13757 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:04.313200 14102 raft_consensus.cc:2804] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.313779 14102 raft_consensus.cc:697] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:04.314669 14102 consensus_queue.cc:237] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.316737 14061 tablet_bootstrap.cc:654] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.322870 14274 raft_consensus.cc:493] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.323523 14274 raft_consensus.cc:515] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.331229 14062 tablet_bootstrap.cc:654] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.334862 14274 leader_election.cc:290] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:04.337466 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6ce7c8d44a4c72a07abbf0467105e6" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:04.339902 13831 leader_election.cc:343] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.341331 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6ce7c8d44a4c72a07abbf0467105e6" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:04.343948 13833 leader_election.cc:343] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.344660 13833 leader_election.cc:304] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.345920 14274 raft_consensus.cc:2749] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.355970 14063 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:04.356824 14063 ts_tablet_manager.cc:1403] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.000s
I20260709 13:04:04.358760 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d165767a6eb84e0ab6e475cb48c542ae" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:04.359707 13791 raft_consensus.cc:3060] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.365337 14061 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:04.366276 14061 ts_tablet_manager.cc:1403] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.000s
I20260709 13:04:04.361303 14063 raft_consensus.cc:359] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.366822 14063 raft_consensus.cc:385] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.367177 14063 raft_consensus.cc:740] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.368008 14063 consensus_queue.cc:260] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.371299 14060 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:04.371138 14145 consensus_queue.cc:1048] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.371877 14060 ts_tablet_manager.cc:1403] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.026s
I20260709 13:04:04.374891 14060 raft_consensus.cc:359] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.375640 14060 raft_consensus.cc:385] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.376168 14060 raft_consensus.cc:740] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.376927 14060 consensus_queue.cc:260] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.369344 14061 raft_consensus.cc:359] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.378315 14061 raft_consensus.cc:385] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.378811 14061 raft_consensus.cc:740] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.379256 14274 consensus_queue.cc:1048] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.379709 14061 consensus_queue.cc:260] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.381811 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d165767a6eb84e0ab6e475cb48c542ae" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:04.382143 14061 ts_tablet_manager.cc:1434] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:04:04.382373 14063 ts_tablet_manager.cc:1434] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:04:04.382509 13867 raft_consensus.cc:3060] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.383414 14063 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:04.388062 14060 ts_tablet_manager.cc:1434] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:04.391111 14060 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:04.391495 14063 tablet_bootstrap.cc:654] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.397603 14061 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:04.405297 14060 tablet_bootstrap.cc:654] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.406265 14253 consensus_queue.cc:1048] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.419963 14061 tablet_bootstrap.cc:654] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.424875 14063 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:04.425451 14063 ts_tablet_manager.cc:1403] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.002s
I20260709 13:04:04.428959 14232 leader_election.cc:290] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:04.429243 14063 raft_consensus.cc:359] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.472225 14063 raft_consensus.cc:385] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.472637 14063 raft_consensus.cc:740] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.473614 14063 consensus_queue.cc:260] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.475841 14063 ts_tablet_manager.cc:1434] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:04:04.476554 14344 raft_consensus.cc:493] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.476959 14063 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:04.430212 14329 raft_consensus.cc:493] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.477299 14344 raft_consensus.cc:515] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.478106 14329 raft_consensus.cc:515] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:04.480444 14329 leader_election.cc:290] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
W20260709 13:04:04.430233 14331 log.cc:927] Time spent T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:04:04.439518 14060 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:04.439949 14061 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:04.440042 14189 consensus_queue.cc:1048] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.445240 14274 raft_consensus.cc:493] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.446393 14276 consensus_queue.cc:1048] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.486850 14274 raft_consensus.cc:515] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.455773 14145 raft_consensus.cc:493] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.489245 14274 leader_election.cc:290] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:04.488970 14145 raft_consensus.cc:515] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.491482 14145 leader_election.cc:290] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:04.491321 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:04.469827 14244 consensus_queue.cc:1048] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.482098 14060 ts_tablet_manager.cc:1403] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.001s
I20260709 13:04:04.482287 14061 ts_tablet_manager.cc:1403] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.085s	user 0.005s	sys 0.007s
I20260709 13:04:04.482861 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:04.500368 13864 raft_consensus.cc:2468] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:04.501981 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:04.502712 13864 raft_consensus.cc:2468] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:04.502964 14060 raft_consensus.cc:359] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.504213 13980 leader_election.cc:304] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:04.504983 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:04.506482 14061 raft_consensus.cc:359] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.510491 14061 raft_consensus.cc:385] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.510900 14061 raft_consensus.cc:740] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.508005 14060 raft_consensus.cc:385] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.495923 13867 raft_consensus.cc:2468] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:04.513024 14061 consensus_queue.cc:260] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.517051 14061 ts_tablet_manager.cc:1434] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 13:04:04.520315 13906 leader_election.cc:304] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:04.521633 14329 raft_consensus.cc:2749] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.513963 14232 raft_consensus.cc:2804] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.522938 14313 raft_consensus.cc:493] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.523420 14232 raft_consensus.cc:493] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.523572 14313 raft_consensus.cc:515] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.511942 14060 raft_consensus.cc:740] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.525296 14060 consensus_queue.cc:260] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.526551 14061 tablet_bootstrap.cc:492] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:04.526186 13757 leader_election.cc:304] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:04.527299 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:04.527666 14189 raft_consensus.cc:2804] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.528112 14189 raft_consensus.cc:493] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.528447 14189 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:04.528986 13831 leader_election.cc:343] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.530573 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160582a28a9446428b13a46b942d62dc" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:04.523972 14232 raft_consensus.cc:3060] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:04.499907 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:39185, user_credentials={real_user=slave}} blocked reactor thread for 46578.5us
W20260709 13:04:04.532075 13979 leader_election.cc:343] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.559445 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160582a28a9446428b13a46b942d62dc" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:04.532616 13940 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.560837 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:04.540622 14060 ts_tablet_manager.cc:1434] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:04:04.544245 14244 raft_consensus.cc:493] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.562496 14244 raft_consensus.cc:515] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.562986 13791 raft_consensus.cc:2468] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:04.545660 13980 leader_election.cc:304] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:04.547909 14062 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:04.565954 14062 ts_tablet_manager.cc:1403] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.285s	user 0.062s	sys 0.057s
I20260709 13:04:04.567694 14244 leader_election.cc:290] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:04.570533 14062 raft_consensus.cc:359] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.571224 14330 raft_consensus.cc:493] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.571339 14062 raft_consensus.cc:385] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.571789 14062 raft_consensus.cc:740] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.571813 14330 raft_consensus.cc:515] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.572562 14062 consensus_queue.cc:260] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.531744 14063 tablet_bootstrap.cc:654] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.563024 14060 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:04.545372 14313 leader_election.cc:290] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:04.559154 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:04.583189 14339 log.cc:927] Time spent T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:04:04.583971 13981 leader_election.cc:343] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.584492 13981 leader_election.cc:304] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.586493 14313 raft_consensus.cc:2749] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.555078 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:04.588095 13938 raft_consensus.cc:2468] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:04.549304 14344 leader_election.cc:290] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:04.591861 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:04.592581 14330 leader_election.cc:290] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
W20260709 13:04:04.593559 13832 leader_election.cc:343] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.582190 14145 raft_consensus.cc:2804] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.594408 14145 raft_consensus.cc:697] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:04.594480 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:04.595806 14145 consensus_queue.cc:237] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.597457 14274 consensus_queue.cc:1048] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:04:04.608379 13833 leader_election.cc:343] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.608989 13833 leader_election.cc:304] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.610905 14061 tablet_bootstrap.cc:654] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.615969 14274 raft_consensus.cc:2749] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.618208 14062 ts_tablet_manager.cc:1434] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
W20260709 13:04:04.627082 13981 leader_election.cc:343] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.630528 14062 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:04.558234 14232 raft_consensus.cc:515] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.549000 14189 raft_consensus.cc:515] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.636276 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:04.639652 13907 leader_election.cc:343] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.635809 13689 catalog_manager.cc:5697] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.640985 14062 tablet_bootstrap.cc:654] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.644987 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:04.650389 14060 tablet_bootstrap.cc:654] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.655400 14329 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.672255 14232 leader_election.cc:290] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:04.675052 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:04.675794 14062 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:04.675882 13866 raft_consensus.cc:3060] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.676568 14062 ts_tablet_manager.cc:1403] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 13:04:04.669832 14329 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.678858 14329 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:04.680231 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:04.681156 14012 raft_consensus.cc:2393] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:04.681074 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:04.683766 13907 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.686444 14103 raft_consensus.cc:493] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.687146 14329 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.687071 14103 raft_consensus.cc:515] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.691285 14062 raft_consensus.cc:359] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.694723 14062 raft_consensus.cc:385] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.696368 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:04.695864 14062 raft_consensus.cc:740] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
W20260709 13:04:04.698419 13980 leader_election.cc:343] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.700467 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:04.701917 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:04.700599 14103 leader_election.cc:290] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:04.705992 14103 consensus_queue.cc:1048] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.699100 14062 consensus_queue.cc:260] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:04.725893 13906 leader_election.cc:343] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.726651 13906 leader_election.cc:304] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.727681 14330 raft_consensus.cc:2749] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.730342 14062 ts_tablet_manager.cc:1434] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
W20260709 13:04:04.736465 13981 leader_election.cc:343] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.737263 13981 leader_election.cc:304] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.738968 14313 raft_consensus.cc:2749] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.742698 14063 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:04.743417 14063 ts_tablet_manager.cc:1403] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.267s	user 0.010s	sys 0.008s
I20260709 13:04:04.747169 14063 raft_consensus.cc:359] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.748129 14063 raft_consensus.cc:385] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.748472 14063 raft_consensus.cc:740] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
W20260709 13:04:04.750689 13833 leader_election.cc:343] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.749946 14063 consensus_queue.cc:260] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.751540 13833 leader_election.cc:304] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.753435 14274 raft_consensus.cc:2749] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.756632 14189 leader_election.cc:290] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:04.756906 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:04.761890 14062 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:04.779505 14063 ts_tablet_manager.cc:1434] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.002s
I20260709 13:04:04.780426 14063 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
W20260709 13:04:04.757892 13981 leader_election.cc:343] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.758426 13864 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.762072 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:04.790793 13939 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.798353 13866 raft_consensus.cc:2468] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
W20260709 13:04:04.786653 13981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 45482.3us
I20260709 13:04:04.825522 13980 leader_election.cc:304] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:04.827003 14145 raft_consensus.cc:2804] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.828361 14145 raft_consensus.cc:697] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:04.829965 14145 consensus_queue.cc:237] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.832252 14232 raft_consensus.cc:493] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.832969 14232 raft_consensus.cc:515] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:04.841681 14061 tablet_bootstrap.cc:492] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:04.842304 14061 ts_tablet_manager.cc:1403] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.316s	user 0.018s	sys 0.026s
I20260709 13:04:04.847610 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b73e3362554ac58453d81770b9ad6f" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:04.848295 14329 raft_consensus.cc:2749] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:04.849435 13979 leader_election.cc:343] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.849907 14276 raft_consensus.cc:493] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.850451 14276 raft_consensus.cc:515] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.851779 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b73e3362554ac58453d81770b9ad6f" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:04.852576 14276 leader_election.cc:290] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:04.853506 14232 leader_election.cc:290] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:04.856065 13937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:04.856851 13937 raft_consensus.cc:2468] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:04.858294 13831 leader_election.cc:304] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:04.859411 14349 raft_consensus.cc:2804] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.859812 14349 raft_consensus.cc:493] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.860116 14102 consensus_queue.cc:1048] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.865427 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:04.860149 14349 raft_consensus.cc:3060] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:04.870246 13833 leader_election.cc:343] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:04.870846 13980 leader_election.cc:343] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.871423 13980 leader_election.cc:304] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:04.872320 14103 raft_consensus.cc:2749] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.879951 14060 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:04.880751 14060 ts_tablet_manager.cc:1403] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.318s	user 0.026s	sys 0.018s
I20260709 13:04:04.884135 13864 raft_consensus.cc:2468] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:04.885542 14060 raft_consensus.cc:359] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.845227 14061 raft_consensus.cc:359] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:04.886826 14060 raft_consensus.cc:385] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.887578 14061 raft_consensus.cc:385] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.888090 14061 raft_consensus.cc:740] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.887933 14060 raft_consensus.cc:740] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.890188 14060 consensus_queue.cc:260] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.890488 14061 consensus_queue.cc:260] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:04.896106 14060 ts_tablet_manager.cc:1434] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:04:04.897444 14060 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:04.898578 14061 ts_tablet_manager.cc:1434] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 13:04:04.901000 14061 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:04.901250 14344 raft_consensus.cc:493] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.896907 13757 leader_election.cc:304] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:04.909353 14253 raft_consensus.cc:2804] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.909996 14253 raft_consensus.cc:697] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:04.910852 14253 consensus_queue.cc:237] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:04.911923 14344 raft_consensus.cc:515] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:04.914268 14344 leader_election.cc:290] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:04.917279 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:04.918095 13864 raft_consensus.cc:2468] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:04.927059 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:04.928977 14062 tablet_bootstrap.cc:654] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.934723 14189 consensus_queue.cc:1048] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.936623 14189 raft_consensus.cc:493] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.937163 14189 raft_consensus.cc:515] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.939144 14061 tablet_bootstrap.cc:654] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:04.943511 13757 leader_election.cc:343] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.956506 14063 tablet_bootstrap.cc:654] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.965682 13688 catalog_manager.cc:5697] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.966337 14250 raft_consensus.cc:493] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.974299 14349 raft_consensus.cc:515] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.003832 14349 leader_election.cc:290] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:05.012260 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:05.017443 14060 tablet_bootstrap.cc:654] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.993273 14250 raft_consensus.cc:515] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:04.969321 13757 leader_election.cc:304] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:05.037223 14061 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:05.037809 14061 ts_tablet_manager.cc:1403] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.138s	user 0.009s	sys 0.005s
I20260709 13:04:05.039985 14189 leader_election.cc:290] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:05.040969 14061 raft_consensus.cc:359] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.041852 14061 raft_consensus.cc:385] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.042137 14061 raft_consensus.cc:740] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
W20260709 13:04:05.027092 13907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 84007.7us
I20260709 13:04:05.042912 14061 consensus_queue.cc:260] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.047356 14061 ts_tablet_manager.cc:1434] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:05.047616 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:05.048311 13941 raft_consensus.cc:3060] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.048882 14061 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:05.056782 14250 leader_election.cc:290] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
W20260709 13:04:05.061650 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:05.067412 14061 tablet_bootstrap.cc:654] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.068853 13939 raft_consensus.cc:2468] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:05.086226 13941 raft_consensus.cc:2468] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:05.095129 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb16a8c2034fd2bbc250bf493ee9ca" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:05.088768 13833 leader_election.cc:343] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.101464 13831 leader_election.cc:304] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
W20260709 13:04:05.093065 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 131409us
I20260709 13:04:05.103920 14244 raft_consensus.cc:2804] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.104650 14244 raft_consensus.cc:697] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:05.087728 14102 raft_consensus.cc:2804] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.114574 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:05.115332 13941 raft_consensus.cc:2468] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:05.122138 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:05.112280 14102 raft_consensus.cc:493] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.127646 14102 raft_consensus.cc:3060] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.107712 14145 raft_consensus.cc:493] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.130209 13907 leader_election.cc:343] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.130144 14145 raft_consensus.cc:515] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.130853 13756 leader_election.cc:304] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:05.132545 14145 leader_election.cc:290] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:05.135661 14062 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:05.136507 14062 ts_tablet_manager.cc:1403] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.375s	user 0.018s	sys 0.002s
I20260709 13:04:05.138756 14250 raft_consensus.cc:493] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.139387 14250 raft_consensus.cc:515] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.142167 14345 raft_consensus.cc:2804] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.142736 14345 raft_consensus.cc:493] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.143119 14345 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.146522 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb16a8c2034fd2bbc250bf493ee9ca" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:05.151654 14250 leader_election.cc:290] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:05.152336 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a5b7830c74a849bdaee0374a8cabf" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:05.154181 13906 leader_election.cc:343] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.154686 13906 leader_election.cc:304] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:05.155478 14250 raft_consensus.cc:2749] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.155124 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a5b7830c74a849bdaee0374a8cabf" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
W20260709 13:04:05.157827 13906 leader_election.cc:343] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.164311 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:05.167824 13687 catalog_manager.cc:5697] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.169463 14063 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:05.174382 14063 ts_tablet_manager.cc:1403] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.394s	user 0.005s	sys 0.014s
W20260709 13:04:05.171077 13757 leader_election.cc:343] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.188202 14063 raft_consensus.cc:359] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.188906 14063 raft_consensus.cc:385] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.189144 14063 raft_consensus.cc:740] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.189706 14063 consensus_queue.cc:260] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.194729 14063 ts_tablet_manager.cc:1434] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:04:05.195595 14063 tablet_bootstrap.cc:492] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
W20260709 13:04:05.196903 13980 leader_election.cc:343] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.198298 14060 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:05.198783 14060 ts_tablet_manager.cc:1403] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.302s	user 0.020s	sys 0.036s
I20260709 13:04:05.107524 14244 consensus_queue.cc:237] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:05.201449 13906 leader_election.cc:343] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.221123 13906 leader_election.cc:304] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:05.231189 14364 raft_consensus.cc:2749] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.264683 14062 raft_consensus.cc:359] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.265484 14062 raft_consensus.cc:385] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.265754 14062 raft_consensus.cc:740] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.266435 14062 consensus_queue.cc:260] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.267437 13688 catalog_manager.cc:5697] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.268774 14313 consensus_queue.cc:1048] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.270545 14102 raft_consensus.cc:515] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:05.271979 13832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 44731.1us
I20260709 13:04:05.272712 14102 leader_election.cc:290] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:05.281348 14060 raft_consensus.cc:359] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.282229 14060 raft_consensus.cc:385] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.282546 14060 raft_consensus.cc:740] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.283578 14061 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:05.284123 14061 ts_tablet_manager.cc:1403] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.236s	user 0.026s	sys 0.013s
I20260709 13:04:05.284778 14062 ts_tablet_manager.cc:1434] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.148s	user 0.013s	sys 0.000s
I20260709 13:04:05.285849 14062 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:05.290524 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:05.301808 14373 consensus_queue.cc:1048] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.302587 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:05.303530 14012 raft_consensus.cc:3060] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.302623 14345 raft_consensus.cc:515] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:05.304373 13979 leader_election.cc:343] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.312575 13979 leader_election.cc:304] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:05.314913 14313 raft_consensus.cc:2749] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.316954 14012 raft_consensus.cc:2468] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:05.319728 14061 raft_consensus.cc:359] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.321846 14061 raft_consensus.cc:385] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.322170 14061 raft_consensus.cc:740] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.322897 14061 consensus_queue.cc:260] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.323206 13757 leader_election.cc:304] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:05.325147 14061 ts_tablet_manager.cc:1434] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.000s
I20260709 13:04:05.326210 14061 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:05.295989 14060 consensus_queue.cc:260] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.326349 14145 consensus_queue.cc:1048] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.328199 14060 ts_tablet_manager.cc:1434] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.002s
I20260709 13:04:05.308456 14345 leader_election.cc:290] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:05.311102 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:05.328884 13864 raft_consensus.cc:3060] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:05.331677 13981 consensus_peers.cc:597] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:05.336400 14062 tablet_bootstrap.cc:654] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.338917 13864 raft_consensus.cc:2468] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:05.351477 14061 tablet_bootstrap.cc:654] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.353615 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:05.355338 14060 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:05.356901 14063 tablet_bootstrap.cc:654] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.354512 13938 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.342712 14189 raft_consensus.cc:2804] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.376932 14189 raft_consensus.cc:697] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:05.384028 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:05.384473 14189 consensus_queue.cc:237] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.396096 14062 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:05.396822 14062 ts_tablet_manager.cc:1403] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.002s
I20260709 13:04:05.408993 13686 catalog_manager.cc:5697] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.413338 14062 raft_consensus.cc:359] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.414199 14062 raft_consensus.cc:385] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.414605 14062 raft_consensus.cc:740] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.415591 14062 consensus_queue.cc:260] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.419106 14062 ts_tablet_manager.cc:1434] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:04:05.420521 14062 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:05.434062 14350 raft_consensus.cc:493] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.434708 14350 raft_consensus.cc:515] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.437232 14062 tablet_bootstrap.cc:654] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.467875 14060 tablet_bootstrap.cc:654] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.455801 14232 raft_consensus.cc:493] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.474035 14232 raft_consensus.cc:515] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.474746 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:05.475554 14015 raft_consensus.cc:2468] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:05.476186 14350 leader_election.cc:290] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:05.485860 13938 raft_consensus.cc:2468] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:05.488284 13832 leader_election.cc:304] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:05.490072 14061 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:05.490846 14061 ts_tablet_manager.cc:1403] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.165s	user 0.026s	sys 0.034s
I20260709 13:04:05.493554 14244 raft_consensus.cc:2804] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.496332 14244 raft_consensus.cc:493] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.496714 14244 raft_consensus.cc:3060] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.497141 13756 leader_election.cc:304] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
W20260709 13:04:05.499056 13757 leader_election.cc:343] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.501834 14344 raft_consensus.cc:2804] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.502406 14344 raft_consensus.cc:697] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:05.503334 14344 consensus_queue.cc:237] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.504948 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:05.508095 13833 leader_election.cc:343] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.508587 14232 leader_election.cc:290] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:05.515699 14253 consensus_queue.cc:1048] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.518738 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb16a8c2034fd2bbc250bf493ee9ca" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:05.518337 14102 consensus_queue.cc:1048] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:05.522339 13981 leader_election.cc:343] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.523311 14063 tablet_bootstrap.cc:492] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:05.523874 14063 ts_tablet_manager.cc:1403] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.010s
I20260709 13:04:05.528811 14061 raft_consensus.cc:359] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.529459 14061 raft_consensus.cc:385] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.529714 14061 raft_consensus.cc:740] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.530463 14061 consensus_queue.cc:260] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.533545 14061 ts_tablet_manager.cc:1434] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:04:05.530895 14244 raft_consensus.cc:515] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.539714 14061 tablet_bootstrap.cc:492] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:05.539311 14063 raft_consensus.cc:359] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.540132 14063 raft_consensus.cc:385] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.541422 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb16a8c2034fd2bbc250bf493ee9ca" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:05.546262 13940 raft_consensus.cc:2468] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:05.548461 13979 leader_election.cc:304] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:05.548774 14244 leader_election.cc:290] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:05.549758 14313 raft_consensus.cc:2804] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.550172 14313 raft_consensus.cc:493] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.550519 14313 raft_consensus.cc:3060] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.550755 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
W20260709 13:04:05.552186 13833 leader_election.cc:343] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.540419 14063 raft_consensus.cc:740] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.561336 14060 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:05.562052 14060 ts_tablet_manager.cc:1403] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.207s	user 0.019s	sys 0.010s
I20260709 13:04:05.563733 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:05.564379 14015 raft_consensus.cc:3060] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.597679 14015 raft_consensus.cc:2468] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:05.599658 13832 leader_election.cc:304] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:05.601222 14061 tablet_bootstrap.cc:654] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.602392 14350 raft_consensus.cc:2804] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.603129 14350 raft_consensus.cc:697] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:05.604084 14350 consensus_queue.cc:237] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.610958 14063 consensus_queue.cc:260] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.611537 14313 raft_consensus.cc:515] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.616505 14060 raft_consensus.cc:359] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.617307 14060 raft_consensus.cc:385] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.618219 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb16a8c2034fd2bbc250bf493ee9ca" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:05.618896 13940 raft_consensus.cc:3060] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.620231 14063 ts_tablet_manager.cc:1434] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.004s
I20260709 13:04:05.621616 14063 tablet_bootstrap.cc:492] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:05.641561 14062 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:05.642179 14062 ts_tablet_manager.cc:1403] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.222s	user 0.029s	sys 0.010s
I20260709 13:04:05.645073 14062 raft_consensus.cc:359] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.657648 14063 tablet_bootstrap.cc:654] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.657814 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb16a8c2034fd2bbc250bf493ee9ca" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
W20260709 13:04:05.659574 13981 leader_election.cc:343] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.660535 14313 leader_election.cc:290] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:05.661396 14250 raft_consensus.cc:493] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.617574 14060 raft_consensus.cc:740] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.662102 14250 raft_consensus.cc:515] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.661463 13940 raft_consensus.cc:2468] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:05.664507 13979 leader_election.cc:304] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:05.665688 14250 leader_election.cc:290] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:05.667737 13687 catalog_manager.cc:5697] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.668524 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160582a28a9446428b13a46b942d62dc" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:05.669440 13786 raft_consensus.cc:2468] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:05.670117 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160582a28a9446428b13a46b942d62dc" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:05.670802 14015 raft_consensus.cc:2468] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:05.671536 13907 leader_election.cc:304] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:05.649668 14062 raft_consensus.cc:385] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.672444 14062 raft_consensus.cc:740] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.672494 14330 raft_consensus.cc:2804] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.672963 14330 raft_consensus.cc:493] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.673390 14330 raft_consensus.cc:3060] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.673368 14062 consensus_queue.cc:260] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.676654 14062 ts_tablet_manager.cc:1434] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:04:05.678691 14062 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:05.683717 14313 raft_consensus.cc:2804] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.684857 14062 tablet_bootstrap.cc:654] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.684928 14330 raft_consensus.cc:515] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.685976 14313 raft_consensus.cc:697] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:05.687228 14313 consensus_queue.cc:237] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.662562 14060 consensus_queue.cc:260] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.688881 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160582a28a9446428b13a46b942d62dc" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:05.689759 14015 raft_consensus.cc:3060] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.690279 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160582a28a9446428b13a46b942d62dc" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:05.690886 13787 raft_consensus.cc:3060] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.691429 14060 ts_tablet_manager.cc:1434] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.000s
I20260709 13:04:05.693008 14060 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:05.699265 13787 raft_consensus.cc:2468] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:05.700518 13907 leader_election.cc:304] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:05.701422 14250 raft_consensus.cc:2804] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.701996 14250 raft_consensus.cc:697] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:05.702176 14330 leader_election.cc:290] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:05.702967 14250 consensus_queue.cc:237] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.707197 14232 raft_consensus.cc:493] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.708017 14232 raft_consensus.cc:515] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.711941 14232 leader_election.cc:290] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:05.717694 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d96cc6c31040cead99c79b8a080c49" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:05.719846 13981 leader_election.cc:343] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.644958 13688 catalog_manager.cc:5697] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.721608 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d96cc6c31040cead99c79b8a080c49" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:05.722832 13940 raft_consensus.cc:2468] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:05.724563 13979 leader_election.cc:304] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:05.725696 14232 raft_consensus.cc:2804] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.726147 14232 raft_consensus.cc:493] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.726728 14232 raft_consensus.cc:3060] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.730252 14063 tablet_bootstrap.cc:492] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:05.730839 14063 ts_tablet_manager.cc:1403] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.109s	user 0.009s	sys 0.004s
I20260709 13:04:05.732636 14062 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:05.732856 14060 tablet_bootstrap.cc:654] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.733160 14062 ts_tablet_manager.cc:1403] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.005s
I20260709 13:04:05.733561 14063 raft_consensus.cc:359] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.734421 14063 raft_consensus.cc:385] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.734777 14063 raft_consensus.cc:740] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.735646 14063 consensus_queue.cc:260] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.735918 14062 raft_consensus.cc:359] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.736759 14062 raft_consensus.cc:385] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.726142 14015 raft_consensus.cc:2468] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:05.737068 14062 raft_consensus.cc:740] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.739738 14062 consensus_queue.cc:260] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.722509 13688 catalog_manager.cc:5697] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.741021 14063 ts_tablet_manager.cc:1434] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:05.742637 14063 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:05.746666 14232 raft_consensus.cc:515] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.748658 14063 tablet_bootstrap.cc:654] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.749452 13686 catalog_manager.cc:5697] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.751888 13687 catalog_manager.cc:5697] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.756773 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d96cc6c31040cead99c79b8a080c49" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:05.757521 13940 raft_consensus.cc:3060] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.759243 14060 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:05.759815 14060 ts_tablet_manager.cc:1403] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.000s
I20260709 13:04:05.761405 14061 tablet_bootstrap.cc:492] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:05.761969 14061 ts_tablet_manager.cc:1403] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.029s
I20260709 13:04:05.762069 14244 raft_consensus.cc:493] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.762602 14244 raft_consensus.cc:515] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.764887 14244 leader_election.cc:290] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:05.765019 14061 raft_consensus.cc:359] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.765758 14061 raft_consensus.cc:385] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.766090 14061 raft_consensus.cc:740] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.766628 13940 raft_consensus.cc:2468] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:05.766783 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbed8f0ccba4b5fabb54cdb9abcead1" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:05.768623 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbed8f0ccba4b5fabb54cdb9abcead1" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:05.777552 13979 leader_election.cc:304] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:05.769537 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d96cc6c31040cead99c79b8a080c49" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
W20260709 13:04:05.778999 13831 leader_election.cc:343] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.779552 14313 raft_consensus.cc:2804] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.780160 14313 raft_consensus.cc:697] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:05.781023 14313 consensus_queue.cc:237] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.783407 14063 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:05.784042 14063 ts_tablet_manager.cc:1403] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.004s
W20260709 13:04:05.784655 13833 leader_election.cc:343] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.785192 13833 leader_election.cc:304] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:05.785979 14244 raft_consensus.cc:2749] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.788938 14244 raft_consensus.cc:493] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.789250 13833 consensus_peers.cc:597] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:05.770378 14060 raft_consensus.cc:359] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.789944 14060 raft_consensus.cc:385] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.771478 14061 consensus_queue.cc:260] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
W20260709 13:04:05.790274 13981 leader_election.cc:343] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.791379 14061 ts_tablet_manager.cc:1434] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.004s
I20260709 13:04:05.792378 14061 tablet_bootstrap.cc:492] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:05.771394 14062 ts_tablet_manager.cc:1434] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:04:05.794792 14062 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:05.789462 14244 raft_consensus.cc:515] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.799638 14244 leader_election.cc:290] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:05.801327 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a5b7830c74a849bdaee0374a8cabf" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:05.800890 13687 catalog_manager.cc:5697] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.776223 14232 leader_election.cc:290] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:05.802012 14063 raft_consensus.cc:359] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.802178 14015 raft_consensus.cc:2468] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:05.806188 13832 leader_election.cc:304] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:05.807288 14244 raft_consensus.cc:2804] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.807674 14244 raft_consensus.cc:493] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.808029 14244 raft_consensus.cc:3060] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.805284 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a5b7830c74a849bdaee0374a8cabf" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:05.808637 13940 raft_consensus.cc:2468] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:05.801687 14061 tablet_bootstrap.cc:654] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.817340 14244 raft_consensus.cc:515] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.819623 14244 leader_election.cc:290] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:05.803390 14062 tablet_bootstrap.cc:654] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.820408 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a5b7830c74a849bdaee0374a8cabf" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:05.820709 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a5b7830c74a849bdaee0374a8cabf" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:05.821122 13941 raft_consensus.cc:3060] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.821323 14015 raft_consensus.cc:3060] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.790287 14060 raft_consensus.cc:740] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.822963 14063 raft_consensus.cc:385] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.823258 14063 raft_consensus.cc:740] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.823920 14063 consensus_queue.cc:260] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.824867 14060 consensus_queue.cc:260] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:05.826079 14063 ts_tablet_manager.cc:1434] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.005s
I20260709 13:04:05.827061 14063 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:05.827136 14060 ts_tablet_manager.cc:1434] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:04:05.828121 14060 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:05.833817 14063 tablet_bootstrap.cc:654] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.839001 13941 raft_consensus.cc:2468] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:05.838945 14060 tablet_bootstrap.cc:654] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.840267 13831 leader_election.cc:304] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:05.841718 14350 raft_consensus.cc:2804] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.842449 14350 raft_consensus.cc:697] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:05.843741 14350 consensus_queue.cc:237] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.846550 14062 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:05.847158 14062 ts_tablet_manager.cc:1403] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.008s
I20260709 13:04:05.850232 14062 raft_consensus.cc:359] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.851439 14062 raft_consensus.cc:385] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.851732 14062 raft_consensus.cc:740] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.853237 14062 consensus_queue.cc:260] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.856410 14062 ts_tablet_manager.cc:1434] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:05.857002 14244 consensus_queue.cc:1048] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.862118 14344 raft_consensus.cc:493] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.863265 14063 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:05.862983 14344 raft_consensus.cc:515] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.863862 14063 ts_tablet_manager.cc:1403] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.011s
I20260709 13:04:05.868768 14062 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:05.877723 14063 raft_consensus.cc:359] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.878510 14063 raft_consensus.cc:385] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.878813 14063 raft_consensus.cc:740] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.878870 14102 raft_consensus.cc:493] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.879612 14102 raft_consensus.cc:515] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:05.879655 14063 consensus_queue.cc:260] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.883931 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:05.881728 14102 leader_election.cc:290] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:05.887707 14062 tablet_bootstrap.cc:654] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.894644 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:05.895141 14344 leader_election.cc:290] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:05.895440 13864 raft_consensus.cc:2468] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:05.897589 14345 raft_consensus.cc:493] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.898159 14345 raft_consensus.cc:515] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.900488 14345 leader_election.cc:290] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:05.902798 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:05.903883 13938 raft_consensus.cc:2468] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:05.904733 14063 ts_tablet_manager.cc:1434] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:04:05.906136 13756 leader_election.cc:304] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:05.908754 14063 tablet_bootstrap.cc:492] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:05.910382 14345 raft_consensus.cc:2804] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.911417 14345 raft_consensus.cc:493] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.911851 14345 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.918867 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:05.921052 13756 leader_election.cc:343] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.923846 14062 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:05.924432 14062 ts_tablet_manager.cc:1403] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.001s
I20260709 13:04:05.927448 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:05.928274 13866 raft_consensus.cc:2468] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:05.930336 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:05.932721 14062 raft_consensus.cc:359] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.933503 14062 raft_consensus.cc:385] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.933827 14062 raft_consensus.cc:740] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.921253 14063 tablet_bootstrap.cc:654] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.938390 13757 leader_election.cc:304] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:05.940533 14062 consensus_queue.cc:260] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:05.946141 14063 tablet_bootstrap.cc:492] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:05.946753 14063 ts_tablet_manager.cc:1403] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 13:04:05.949501 14063 raft_consensus.cc:359] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.950233 14063 raft_consensus.cc:385] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.950511 14063 raft_consensus.cc:740] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.951020 13787 raft_consensus.cc:3060] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.951160 14063 consensus_queue.cc:260] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:05.953536 14063 ts_tablet_manager.cc:1434] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:05.963846 14063 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:05.972918 14063 tablet_bootstrap.cc:654] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.981827 14102 raft_consensus.cc:2804] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.982478 14102 raft_consensus.cc:493] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.982923 14102 raft_consensus.cc:3060] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.984216 14015 raft_consensus.cc:2468] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:05.986011 14344 consensus_queue.cc:1048] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:05.986697 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 46395.4us
I20260709 13:04:05.986985 14062 ts_tablet_manager.cc:1434] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:04:05.987823 14253 raft_consensus.cc:493] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.011530 14253 raft_consensus.cc:515] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.012180 14062 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:06.013751 14253 leader_election.cc:290] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:06.026170 14062 tablet_bootstrap.cc:654] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.036998 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:06.032370 14344 consensus_queue.cc:1048] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.039570 13757 leader_election.cc:304] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:06.040552 14350 consensus_queue.cc:1048] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.059432 14350 raft_consensus.cc:493] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.051563 14250 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.066641 14250 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:06.063618 14102 raft_consensus.cc:515] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.069496 14102 leader_election.cc:290] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
W20260709 13:04:06.063522 13833 consensus_peers.cc:597] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:06.136673 13833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 73345.2us
I20260709 13:04:06.070271 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:06.074265 14250 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
W20260709 13:04:06.056598 14403 log.cc:927] Time spent T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:04:06.142019 13906 leader_election.cc:343] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.093318 14350 raft_consensus.cc:515] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.144901 14350 leader_election.cc:290] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:06.043144 14345 raft_consensus.cc:515] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.147970 14345 leader_election.cc:290] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:06.099918 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:06.149116 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:06.151568 13939 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.154753 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:06.155542 13865 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.156627 14349 raft_consensus.cc:493] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.157426 14349 raft_consensus.cc:515] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.105638 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:06.115746 14063 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:06.162395 14063 ts_tablet_manager.cc:1403] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.199s	user 0.017s	sys 0.004s
I20260709 13:04:06.163632 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6ce7c8d44a4c72a07abbf0467105e6" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:06.164253 13907 leader_election.cc:343] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.164798 13907 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:06.165439 14063 raft_consensus.cc:359] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.127580 14364 consensus_queue.cc:1048] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:06.166774 13833 leader_election.cc:343] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.130417 14408 consensus_queue.cc:1048] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.167932 14063 raft_consensus.cc:385] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.168320 14063 raft_consensus.cc:740] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.104557 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:06.150831 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:06.170848 14063 consensus_queue.cc:260] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.166019 14250 raft_consensus.cc:2749] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.129696 14344 raft_consensus.cc:2749] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.134363 14274 raft_consensus.cc:493] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.174240 14274 raft_consensus.cc:515] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.176355 14274 leader_election.cc:290] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:06.176035 13689 catalog_manager.cc:5697] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.176920 14060 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
W20260709 13:04:06.170939 13831 leader_election.cc:343] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.177462 14060 ts_tablet_manager.cc:1403] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.350s	user 0.134s	sys 0.165s
I20260709 13:04:06.161499 14349 leader_election.cc:290] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:06.180157 13756 leader_election.cc:304] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:06.181098 14344 raft_consensus.cc:2749] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.181517 14250 consensus_queue.cc:1048] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.181942 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:06.166049 13938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6ce7c8d44a4c72a07abbf0467105e6" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:06.182757 14011 raft_consensus.cc:2468] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:06.181552 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b73e3362554ac58453d81770b9ad6f" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:06.181954 13756 leader_election.cc:343] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.185446 14060 raft_consensus.cc:359] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.186292 14060 raft_consensus.cc:385] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.186587 14060 raft_consensus.cc:740] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.187287 14060 consensus_queue.cc:260] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.189594 14060 ts_tablet_manager.cc:1434] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:04:06.190593 14060 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:06.194653 14313 consensus_queue.cc:1048] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:06.195261 13831 leader_election.cc:343] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.196601 14060 tablet_bootstrap.cc:654] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.199430 13831 leader_election.cc:343] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.200095 13831 leader_election.cc:304] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
W20260709 13:04:06.200794 13757 consensus_peers.cc:597] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b -> Peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Couldn't send request to peer 26396ddd557646e98bdbd64eba197c05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:06.201496 14350 raft_consensus.cc:2749] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:06.206209 13981 consensus_peers.cc:597] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:06.211796 14313 consensus_queue.cc:1048] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.212548 13939 raft_consensus.cc:2468] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:06.213224 14060 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:06.218915 14060 ts_tablet_manager.cc:1403] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.013s
I20260709 13:04:06.179226 14063 ts_tablet_manager.cc:1434] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:06.222628 14063 tablet_bootstrap.cc:492] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:06.225405 14060 raft_consensus.cc:359] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.226233 14060 raft_consensus.cc:385] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.226536 14060 raft_consensus.cc:740] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
W20260709 13:04:06.227088 13981 consensus_peers.cc:597] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:06.227262 14060 consensus_queue.cc:260] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.125957 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:06.235612 14060 ts_tablet_manager.cc:1434] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:06.239675 13832 leader_election.cc:304] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:06.251717 14060 tablet_bootstrap.cc:492] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:06.258249 13865 raft_consensus.cc:2468] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:06.237538 13864 raft_consensus.cc:3060] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.261845 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b73e3362554ac58453d81770b9ad6f" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:06.263154 14015 raft_consensus.cc:2468] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:06.254913 14349 raft_consensus.cc:2804] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:06.269533 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:06.271148 13832 leader_election.cc:304] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:06.281708 14062 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:06.282636 14062 ts_tablet_manager.cc:1403] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.271s	user 0.019s	sys 0.002s
I20260709 13:04:06.273509 14349 raft_consensus.cc:493] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.263566 13756 leader_election.cc:304] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:06.299558 14349 raft_consensus.cc:3060] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.311967 14102 raft_consensus.cc:2804] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.315809 14102 raft_consensus.cc:697] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:06.329444 14424 raft_consensus.cc:493] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.330199 14424 raft_consensus.cc:515] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.317119 14102 consensus_queue.cc:237] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:06.335340 14061 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.023s	sys 0.002s
W20260709 13:04:06.335747 14061 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.023s	sys 0.002s
I20260709 13:04:06.336503 14062 raft_consensus.cc:359] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.337424 14062 raft_consensus.cc:385] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.309840 14274 raft_consensus.cc:2804] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:06.338014 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 77992.6us
I20260709 13:04:06.338057 14274 raft_consensus.cc:493] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.349218 14189 raft_consensus.cc:493] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.349843 14189 raft_consensus.cc:515] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.351723 14424 leader_election.cc:290] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:06.352442 14189 leader_election.cc:290] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
W20260709 13:04:06.314765 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:39185, user_credentials={real_user=slave}} blocked reactor thread for 58297.2us
I20260709 13:04:06.354110 14061 tablet_bootstrap.cc:492] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:06.354619 14061 ts_tablet_manager.cc:1403] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.562s	user 0.032s	sys 0.002s
I20260709 13:04:06.356698 14060 tablet_bootstrap.cc:654] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.349298 14274 raft_consensus.cc:3060] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.337743 14062 raft_consensus.cc:740] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.370352 14063 tablet_bootstrap.cc:654] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.360142 14062 consensus_queue.cc:260] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.385097 14062 ts_tablet_manager.cc:1434] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.000s
I20260709 13:04:06.391026 14421 consensus_queue.cc:1048] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.395097 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:06.419145 14061 raft_consensus.cc:359] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.420289 14061 raft_consensus.cc:385] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.420791 14061 raft_consensus.cc:740] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.423827 14061 consensus_queue.cc:260] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
W20260709 13:04:06.440531 13980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 56931.2us
I20260709 13:04:06.402637 14349 raft_consensus.cc:515] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.409912 14013 raft_consensus.cc:2468] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:06.443698 14274 raft_consensus.cc:515] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.445339 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:06.446206 14015 raft_consensus.cc:2468] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:06.456930 13757 leader_election.cc:304] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:06.458176 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:06.438354 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:06.462513 13866 raft_consensus.cc:2468] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:06.463753 13832 leader_election.cc:304] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:06.465406 14350 raft_consensus.cc:2804] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.465845 14350 raft_consensus.cc:493] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.465937 14428 consensus_queue.cc:1048] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.444649 13864 raft_consensus.cc:2468] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:06.466260 14350 raft_consensus.cc:3060] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.443786 14349 leader_election.cc:290] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:06.438943 14364 raft_consensus.cc:493] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.468834 14061 ts_tablet_manager.cc:1434] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.114s	user 0.005s	sys 0.003s
I20260709 13:04:06.469025 14364 raft_consensus.cc:515] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.469695 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:06.469971 14061 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:06.470325 14015 raft_consensus.cc:3060] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:06.495414 13831 leader_election.cc:343] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:06.497288 13907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 79163.6us
I20260709 13:04:06.501003 14062 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:06.503047 14015 raft_consensus.cc:2468] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:06.506613 14102 raft_consensus.cc:2804] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.507125 14102 raft_consensus.cc:493] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.507767 14102 raft_consensus.cc:3060] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.516225 14060 tablet_bootstrap.cc:492] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:06.516815 14060 ts_tablet_manager.cc:1403] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.280s	user 0.020s	sys 0.029s
W20260709 13:04:06.501497 13980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 59881.2us
I20260709 13:04:06.522948 14274 leader_election.cc:290] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:06.523303 14364 leader_election.cc:290] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:06.527894 14061 tablet_bootstrap.cc:654] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.506747 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 44926.3us
I20260709 13:04:06.509271 14350 raft_consensus.cc:515] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.546921 13832 leader_election.cc:304] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:06.546012 14102 raft_consensus.cc:515] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.553020 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b73e3362554ac58453d81770b9ad6f" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:06.554380 13789 raft_consensus.cc:3060] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.554272 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:06.555284 13787 raft_consensus.cc:2393] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97c52f3e93434bedbdc9755e64f33d4f in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:06.555886 14063 tablet_bootstrap.cc:492] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:06.556419 14063 ts_tablet_manager.cc:1403] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.334s	user 0.022s	sys 0.023s
I20260709 13:04:06.558089 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6ce7c8d44a4c72a07abbf0467105e6" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:06.559127 14350 leader_election.cc:290] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:06.567361 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b73e3362554ac58453d81770b9ad6f" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:06.568059 14015 raft_consensus.cc:3060] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.569664 14427 raft_consensus.cc:2804] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.570279 14427 raft_consensus.cc:697] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:06.571099 14427 consensus_queue.cc:237] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
W20260709 13:04:06.576197 13831 leader_election.cc:343] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.579113 14062 tablet_bootstrap.cc:654] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.579631 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6ce7c8d44a4c72a07abbf0467105e6" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:06.580387 13864 raft_consensus.cc:2468] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:06.580356 14274 raft_consensus.cc:493] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.581532 14274 raft_consensus.cc:515] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.583989 14274 leader_election.cc:290] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:06.584077 13906 leader_election.cc:304] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:06.585093 14060 raft_consensus.cc:359] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.585883 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:06.586555 14010 raft_consensus.cc:3060] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.588083 13786 raft_consensus.cc:3060] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.585865 14060 raft_consensus.cc:385] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.590171 14060 raft_consensus.cc:740] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.590862 14060 consensus_queue.cc:260] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.565560 13757 leader_election.cc:304] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:06.593914 14015 raft_consensus.cc:2468] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:06.600417 14063 raft_consensus.cc:359] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.601222 14063 raft_consensus.cc:385] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:06.602097 13907 leader_election.cc:343] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:06.603300 13979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:39185, user_credentials={real_user=slave}} blocked reactor thread for 53181.6us
I20260709 13:04:06.601505 14063 raft_consensus.cc:740] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.608461 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:06.609407 13791 raft_consensus.cc:2393] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 97c52f3e93434bedbdc9755e64f33d4f in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:06.604755 14063 consensus_queue.cc:260] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.611900 14102 leader_election.cc:290] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:06.617663 14063 ts_tablet_manager.cc:1434] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.002s
I20260709 13:04:06.628927 14063 tablet_bootstrap.cc:492] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:06.631227 13688 catalog_manager.cc:5697] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.654047 14060 ts_tablet_manager.cc:1434] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.000s
I20260709 13:04:06.647985 14345 raft_consensus.cc:2804] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.654881 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef26422e31c46fe8f63d4388ae021a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:06.678063 14345 raft_consensus.cc:697] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:06.673029 14432 raft_consensus.cc:493] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.688138 14345 consensus_queue.cc:237] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.688428 14432 raft_consensus.cc:515] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
W20260709 13:04:06.655220 13906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 71251.5us
I20260709 13:04:06.693163 14060 tablet_bootstrap.cc:492] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
W20260709 13:04:06.655102 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 89676.1us
I20260709 13:04:06.697893 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8184075bc04f4f209f3b9d4f56d1522a" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:06.698392 14432 leader_election.cc:290] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
W20260709 13:04:06.700022 13980 leader_election.cc:343] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.701280 14010 raft_consensus.cc:2468] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:06.669102 14437 raft_consensus.cc:2804] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.705284 14437 raft_consensus.cc:493] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.705663 14437 raft_consensus.cc:3060] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.714085 14062 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:06.714699 14062 ts_tablet_manager.cc:1403] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.007s
I20260709 13:04:06.728605 14433 raft_consensus.cc:493] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.739418 14062 raft_consensus.cc:359] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.740514 14062 raft_consensus.cc:385] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.740881 14062 raft_consensus.cc:740] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.741751 14062 consensus_queue.cc:260] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:06.742146 13833 leader_election.cc:343] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.729218 14433 raft_consensus.cc:515] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.759990 14062 ts_tablet_manager.cc:1434] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.005s
I20260709 13:04:06.761544 14063 tablet_bootstrap.cc:654] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.762796 14062 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:06.771178 14061 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:06.771857 14061 ts_tablet_manager.cc:1403] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.302s	user 0.016s	sys 0.000s
I20260709 13:04:06.771903 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:06.772825 14015 raft_consensus.cc:2393] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
I20260709 13:04:06.787832 14061 raft_consensus.cc:359] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:06.789003 14061 raft_consensus.cc:385] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.789378 14061 raft_consensus.cc:740] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.790391 14061 consensus_queue.cc:260] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:06.798697 14433 leader_election.cc:290] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:06.800981 14060 tablet_bootstrap.cc:654] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.801538 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc6c842bcd947ef97971e5b80b2fce4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:06.803830 13867 raft_consensus.cc:2393] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
I20260709 13:04:06.807005 14250 raft_consensus.cc:493] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.810938 14250 raft_consensus.cc:515] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.811335 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:06.813328 14250 leader_election.cc:290] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:06.803625 14437 raft_consensus.cc:515] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.819483 14437 leader_election.cc:290] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:06.823812 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:06.824097 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8184075bc04f4f209f3b9d4f56d1522a" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:06.824785 13867 raft_consensus.cc:2393] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:06.825470 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6ce7c8d44a4c72a07abbf0467105e6" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
W20260709 13:04:06.826032 13906 leader_election.cc:343] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.824136 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8184075bc04f4f209f3b9d4f56d1522a" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:06.826423 13864 raft_consensus.cc:3060] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.827000 13941 raft_consensus.cc:2468] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:06.827024 13906 leader_election.cc:304] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:06.830611 14061 ts_tablet_manager.cc:1434] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 13:04:06.830624 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6ce7c8d44a4c72a07abbf0467105e6" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:06.831532 13788 raft_consensus.cc:3060] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.831586 14250 raft_consensus.cc:3060] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.831912 14061 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:06.840750 14062 tablet_bootstrap.cc:654] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.843272 14013 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.847295 14250 raft_consensus.cc:2749] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.850075 13979 leader_election.cc:304] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:06.851678 14446 raft_consensus.cc:2804] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.852098 14446 raft_consensus.cc:493] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.852782 14446 raft_consensus.cc:3060] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.870347 13788 raft_consensus.cc:2468] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:06.882788 14063 tablet_bootstrap.cc:492] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:06.883425 14063 ts_tablet_manager.cc:1403] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.255s	user 0.008s	sys 0.009s
I20260709 13:04:06.883543 13907 leader_election.cc:304] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:06.884508 14437 raft_consensus.cc:2804] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:06.876281 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 77280.3us
I20260709 13:04:06.885056 14437 raft_consensus.cc:697] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:06.886085 14437 consensus_queue.cc:237] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:06.886688 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef26422e31c46fe8f63d4388ae021a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:06.883618 13864 raft_consensus.cc:2468] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:06.884716 14446 raft_consensus.cc:515] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.893441 14446 leader_election.cc:290] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:06.894239 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8184075bc04f4f209f3b9d4f56d1522a" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:06.894444 13937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8184075bc04f4f209f3b9d4f56d1522a" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:06.895148 13937 raft_consensus.cc:3060] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.895275 14063 raft_consensus.cc:359] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.896041 14063 raft_consensus.cc:385] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.896318 14063 raft_consensus.cc:740] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.897042 14063 consensus_queue.cc:260] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.903515 13864 raft_consensus.cc:3060] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.906739 13757 leader_election.cc:304] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:06.909927 14063 ts_tablet_manager.cc:1434] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:04:06.911175 14063 tablet_bootstrap.cc:492] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:06.916163 14061 tablet_bootstrap.cc:654] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.918768 14345 raft_consensus.cc:2749] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.915133 13688 catalog_manager.cc:5697] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.920784 13937 raft_consensus.cc:2468] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:06.922691 13979 leader_election.cc:304] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:06.923657 14446 raft_consensus.cc:2804] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.924228 14446 raft_consensus.cc:697] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:06.925372 14446 consensus_queue.cc:237] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.925706 14345 consensus_queue.cc:1048] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.928910 14060 tablet_bootstrap.cc:492] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:06.929698 14060 ts_tablet_manager.cc:1403] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.237s	user 0.011s	sys 0.005s
I20260709 13:04:06.932818 13832 leader_election.cc:304] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:06.934226 14429 raft_consensus.cc:2804] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.934736 14429 raft_consensus.cc:697] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:06.935557 14429 consensus_queue.cc:237] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.939085 13832 leader_election.cc:304] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
W20260709 13:04:06.940765 13832 leader_election.cc:343] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.941718 14422 raft_consensus.cc:2804] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.942335 14422 raft_consensus.cc:697] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:06.943210 14422 consensus_queue.cc:237] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:06.941188 13832 leader_election.cc:304] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:06.950841 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8184075bc04f4f209f3b9d4f56d1522a" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:06.956730 14424 raft_consensus.cc:2749] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.972345 13906 leader_election.cc:304] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:06.991974 14250 raft_consensus.cc:2749] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.993921 14421 raft_consensus.cc:493] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.994561 14421 raft_consensus.cc:515] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.999135 13687 catalog_manager.cc:5697] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.017447 14060 raft_consensus.cc:359] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:06.996730 14421 leader_election.cc:290] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:07.018936 14060 raft_consensus.cc:385] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.021570 14060 raft_consensus.cc:740] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.023387 14060 consensus_queue.cc:260] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.033000 14060 ts_tablet_manager.cc:1434] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
I20260709 13:04:07.034089 14060 tablet_bootstrap.cc:492] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:07.042865 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:07.048293 13688 catalog_manager.cc:5697] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:07.056939 13831 leader_election.cc:343] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.058732 14447 consensus_queue.cc:1048] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.060871 13689 catalog_manager.cc:5697] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.073024 14063 tablet_bootstrap.cc:654] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.075598 13864 raft_consensus.cc:2468] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:07.103083 14061 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:07.103614 14061 ts_tablet_manager.cc:1403] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.272s	user 0.033s	sys 0.011s
W20260709 13:04:07.104460 13832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 134219us
I20260709 13:04:07.108385 14062 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:07.109102 14062 ts_tablet_manager.cc:1403] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.348s	user 0.021s	sys 0.021s
I20260709 13:04:07.111178 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:07.118000 14062 raft_consensus.cc:359] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.118840 14062 raft_consensus.cc:385] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.119138 14062 raft_consensus.cc:740] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.120406 14062 consensus_queue.cc:260] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.127997 14062 ts_tablet_manager.cc:1434] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:04:07.130653 14062 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
W20260709 13:04:07.135676 13832 leader_election.cc:343] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.136219 13832 leader_election.cc:304] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:07.138715 14427 raft_consensus.cc:2749] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.142154 14061 raft_consensus.cc:359] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:07.142766 13939 raft_consensus.cc:3060] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.143056 14061 raft_consensus.cc:385] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.143489 14061 raft_consensus.cc:740] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.144199 14061 consensus_queue.cc:260] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:07.146286 14061 ts_tablet_manager.cc:1434] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:04:07.155550 14427 consensus_queue.cc:1048] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.159984 14427 consensus_queue.cc:1048] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.162185 14060 tablet_bootstrap.cc:654] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.167850 14061 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:07.182152 13687 catalog_manager.cc:5697] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.185556 14063 tablet_bootstrap.cc:492] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:07.185241 13687 catalog_manager.cc:5697] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.186430 14063 ts_tablet_manager.cc:1403] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.275s	user 0.021s	sys 0.014s
I20260709 13:04:07.208130 14062 tablet_bootstrap.cc:654] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.210856 14447 raft_consensus.cc:493] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.211529 14447 raft_consensus.cc:515] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.214581 14447 leader_election.cc:290] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:07.224306 14063 raft_consensus.cc:359] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.227315 14063 raft_consensus.cc:385] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.229384 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb16a8c2034fd2bbc250bf493ee9ca" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:07.232486 13788 raft_consensus.cc:3060] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.233111 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fb16a8c2034fd2bbc250bf493ee9ca" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:07.236862 14061 tablet_bootstrap.cc:654] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.244094 13756 leader_election.cc:304] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:07.227715 14063 raft_consensus.cc:740] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.255563 14063 consensus_queue.cc:260] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.255930 14345 consensus_queue.cc:1048] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:04:07.277199 14060 tablet_bootstrap.cc:492] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:07.278198 14060 ts_tablet_manager.cc:1403] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.244s	user 0.027s	sys 0.002s
I20260709 13:04:07.300233 14062 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:07.301020 14062 ts_tablet_manager.cc:1403] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.015s
I20260709 13:04:07.302050 14063 ts_tablet_manager.cc:1434] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.001s
I20260709 13:04:07.307786 14063 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:07.295127 14232 raft_consensus.cc:493] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.319267 14062 raft_consensus.cc:359] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.322175 14060 raft_consensus.cc:359] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.323014 14060 raft_consensus.cc:385] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.323290 14060 raft_consensus.cc:740] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.326891 14349 consensus_queue.cc:1048] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.329967 14062 raft_consensus.cc:385] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.334447 14062 raft_consensus.cc:740] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.335350 14062 consensus_queue.cc:260] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.337986 14062 ts_tablet_manager.cc:1434] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:04:07.339349 14062 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:07.299304 14421 raft_consensus.cc:493] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.341032 14421 raft_consensus.cc:515] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.343243 14421 leader_election.cc:290] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:07.327853 14060 consensus_queue.cc:260] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.345320 14232 raft_consensus.cc:515] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:07.347697 14232 leader_election.cc:290] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:07.348356 14447 raft_consensus.cc:2749] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.349947 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
W20260709 13:04:07.351651 13981 leader_election.cc:343] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.354877 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a350bf7b4479428fa79f9b4aa9036423" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:07.357308 14060 ts_tablet_manager.cc:1434] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260709 13:04:07.358412 14060 tablet_bootstrap.cc:492] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
W20260709 13:04:07.359788 13831 leader_election.cc:343] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.359722 14062 tablet_bootstrap.cc:654] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.362900 14102 consensus_queue.cc:1048] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.368396 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a350bf7b4479428fa79f9b4aa9036423" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:07.372375 14063 tablet_bootstrap.cc:654] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.382823 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:07.393347 14250 consensus_queue.cc:1048] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:07.406800 14060 tablet_bootstrap.cc:654] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.409409 14424 consensus_queue.cc:1048] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:07.418414 13832 leader_election.cc:343] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.422037 13832 leader_election.cc:304] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
W20260709 13:04:07.426967 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:07.425892 14427 raft_consensus.cc:2749] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.424688 14250 consensus_queue.cc:1048] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:04:07.456477 14373 consensus_queue.cc:1048] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:04:07.488271 14061 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:07.488924 14061 ts_tablet_manager.cc:1403] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.321s	user 0.016s	sys 0.015s
I20260709 13:04:07.507440 14061 raft_consensus.cc:359] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.513257 14061 raft_consensus.cc:385] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.513706 14061 raft_consensus.cc:740] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.514703 14061 consensus_queue.cc:260] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.516645 14061 ts_tablet_manager.cc:1434] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:04:07.518083 14061 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:07.536128 14061 tablet_bootstrap.cc:654] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.533684 14437 raft_consensus.cc:493] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.542425 14373 consensus_queue.cc:1048] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:04:07.545445 14437 raft_consensus.cc:515] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.571957 13941 raft_consensus.cc:3060] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.557588 14060 tablet_bootstrap.cc:492] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:07.573465 14060 ts_tablet_manager.cc:1403] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.215s	user 0.023s	sys 0.009s
I20260709 13:04:07.580718 14062 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:07.581341 14062 ts_tablet_manager.cc:1403] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.242s	user 0.017s	sys 0.016s
W20260709 13:04:07.553676 13980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 79345.4us
I20260709 13:04:07.603823 14060 raft_consensus.cc:359] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.604944 14060 raft_consensus.cc:385] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.605291 14060 raft_consensus.cc:740] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
W20260709 13:04:07.607407 13980 leader_election.cc:343] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.611123 14063 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:07.611959 14063 ts_tablet_manager.cc:1403] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.307s	user 0.018s	sys 0.015s
I20260709 13:04:07.610977 14060 consensus_queue.cc:260] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.613656 13980 leader_election.cc:304] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:07.615924 14373 raft_consensus.cc:2749] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.616207 14060 ts_tablet_manager.cc:1434] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 13:04:07.617997 14437 leader_election.cc:290] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:07.627616 14063 raft_consensus.cc:359] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:07.628130 14060 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:07.628449 14063 raft_consensus.cc:385] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.628794 14063 raft_consensus.cc:740] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.629367 14063 consensus_queue.cc:260] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:07.716395 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b73e3362554ac58453d81770b9ad6f" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:07.728293 14102 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.752023 14102 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.718436 14364 raft_consensus.cc:493] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:07.761107 13906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 48192.5us
I20260709 13:04:07.761663 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b73e3362554ac58453d81770b9ad6f" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:07.767308 14010 raft_consensus.cc:2393] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 1: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
I20260709 13:04:07.772032 14061 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:07.791080 14102 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:07.773732 14061 ts_tablet_manager.cc:1403] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.256s	user 0.016s	sys 0.005s
W20260709 13:04:07.805047 13907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 55922us
I20260709 13:04:07.810688 14364 raft_consensus.cc:515] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:07.815358 14060 tablet_bootstrap.cc:654] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.816365 14062 raft_consensus.cc:359] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:07.817020 14364 leader_election.cc:290] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:07.817504 14062 raft_consensus.cc:385] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.817926 14062 raft_consensus.cc:740] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.818974 14062 consensus_queue.cc:260] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:07.828217 14373 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.828727 14062 ts_tablet_manager.cc:1434] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.247s	user 0.009s	sys 0.004s
I20260709 13:04:07.783955 14458 consensus_queue.cc:1048] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:04:07.829057 14373 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.834290 14062 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:07.836213 14061 raft_consensus.cc:359] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:07.847226 14061 raft_consensus.cc:385] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.847707 14061 raft_consensus.cc:740] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.848680 14061 consensus_queue.cc:260] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:07.859058 13906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 47503.8us
I20260709 13:04:07.861694 14063 ts_tablet_manager.cc:1434] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.187s	user 0.008s	sys 0.002s
I20260709 13:04:07.862144 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a350bf7b4479428fa79f9b4aa9036423" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:07.869817 13865 raft_consensus.cc:2468] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:07.872597 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:07.873649 13941 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:07.883478 14063 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:07.892926 13756 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:07.899017 14102 raft_consensus.cc:2804] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.899479 14102 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.905371 14061 ts_tablet_manager.cc:1434] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.099s	user 0.002s	sys 0.008s
I20260709 13:04:07.907558 14061 tablet_bootstrap.cc:492] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:07.899931 14102 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.919202 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:07.920472 14061 tablet_bootstrap.cc:654] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.920325 14010 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 0.
I20260709 13:04:07.937829 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:07.938768 13936 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:07.944371 14063 tablet_bootstrap.cc:654] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.954916 13979 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:07.956691 14432 raft_consensus.cc:2804] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.957129 14432 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.957537 14432 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.981954 14460 raft_consensus.cc:493] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.983230 14013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a350bf7b4479428fa79f9b4aa9036423" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:07.986964 13906 leader_election.cc:304] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
W20260709 13:04:07.988430 13906 leader_election.cc:343] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.993448 14102 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:07.996001 14460 raft_consensus.cc:515] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.006407 14373 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:07.999529 14460 leader_election.cc:290] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:08.011991 14062 tablet_bootstrap.cc:654] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.019423 14437 raft_consensus.cc:2749] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.024351 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:08.025251 13941 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.025951 14244 consensus_queue.cc:1048] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.035684 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c945695696fc4b6a9ad5becbe6a236a7" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:08.035600 14432 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:08.036712 14010 raft_consensus.cc:2468] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:08.039173 14102 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:08.040740 13906 leader_election.cc:304] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:08.042855 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c945695696fc4b6a9ad5becbe6a236a7" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:08.043715 14485 raft_consensus.cc:2804] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.044332 14485 raft_consensus.cc:493] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.044808 14485 raft_consensus.cc:3060] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.061327 13937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:08.064889 14432 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:08.076239 14060 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:08.078347 14060 ts_tablet_manager.cc:1403] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.450s	user 0.024s	sys 0.015s
I20260709 13:04:08.082614 14060 raft_consensus.cc:359] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:08.083608 14060 raft_consensus.cc:385] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.083905 14060 raft_consensus.cc:740] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.087431 14063 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:08.088088 14063 ts_tablet_manager.cc:1403] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.205s	user 0.019s	sys 0.024s
W20260709 13:04:08.088835 13981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 50611.3us
I20260709 13:04:08.091475 14063 raft_consensus.cc:359] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.092331 14063 raft_consensus.cc:385] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.092628 14063 raft_consensus.cc:740] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.100003 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:08.101195 13792 raft_consensus.cc:2393] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:08.102213 14060 consensus_queue.cc:260] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:08.103821 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:08.104851 13786 raft_consensus.cc:2393] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 1: Already voted for candidate ce171b1b0d7341f59e3ba532f7b51d1b in this term.
I20260709 13:04:08.108327 14060 ts_tablet_manager.cc:1434] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:04:08.109777 14060 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:08.093361 14063 consensus_queue.cc:260] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.117657 13832 leader_election.cc:304] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:08.118260 14061 tablet_bootstrap.cc:492] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
W20260709 13:04:08.118484 13833 leader_election.cc:343] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.118808 14061 ts_tablet_manager.cc:1403] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.212s	user 0.019s	sys 0.010s
I20260709 13:04:08.122603 14061 raft_consensus.cc:359] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.124028 14061 raft_consensus.cc:385] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.124421 14061 raft_consensus.cc:740] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.125187 14061 consensus_queue.cc:260] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.128352 14485 raft_consensus.cc:515] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
W20260709 13:04:08.134645 13833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 83970.5us
I20260709 13:04:08.140205 13941 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 1.
I20260709 13:04:08.141892 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:08.142952 14010 raft_consensus.cc:2393] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:08.142802 13756 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:08.143966 14484 raft_consensus.cc:2804] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.144326 13981 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:08.144562 14484 raft_consensus.cc:697] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:08.145426 14232 raft_consensus.cc:2749] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.143982 14061 ts_tablet_manager.cc:1434] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
W20260709 13:04:08.147359 13832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 107857us
I20260709 13:04:08.145862 14484 consensus_queue.cc:237] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:08.159178 14244 raft_consensus.cc:2804] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.164790 14244 raft_consensus.cc:493] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.165318 14244 raft_consensus.cc:3060] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.165724 14485 leader_election.cc:290] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:08.180968 14060 tablet_bootstrap.cc:654] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.189288 14063 ts_tablet_manager.cc:1434] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.001s
I20260709 13:04:08.211382 14063 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f: Bootstrap starting.
I20260709 13:04:08.196822 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a350bf7b4479428fa79f9b4aa9036423" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:08.214391 14014 raft_consensus.cc:3060] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.200409 14061 tablet_bootstrap.cc:492] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:08.219980 14062 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:08.220562 14062 ts_tablet_manager.cc:1403] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.387s	user 0.012s	sys 0.008s
I20260709 13:04:08.224087 14062 raft_consensus.cc:359] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.224787 14062 raft_consensus.cc:385] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.225095 14062 raft_consensus.cc:740] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.238047 14458 raft_consensus.cc:493] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.238731 14458 raft_consensus.cc:515] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.240826 14063 tablet_bootstrap.cc:654] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.241277 14458 leader_election.cc:290] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:08.242702 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:08.231302 14062 consensus_queue.cc:260] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.279721 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a350bf7b4479428fa79f9b4aa9036423" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:08.283466 13864 raft_consensus.cc:3060] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.284747 14062 ts_tablet_manager.cc:1434] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.003s
I20260709 13:04:08.286136 14062 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
W20260709 13:04:08.288587 13831 leader_election.cc:343] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:08.291049 13831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:39185, user_credentials={real_user=slave}} blocked reactor thread for 46214.2us
I20260709 13:04:08.294896 14060 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:08.295567 14060 ts_tablet_manager.cc:1403] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.186s	user 0.019s	sys 0.012s
I20260709 13:04:08.297737 14014 raft_consensus.cc:2468] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:08.305995 13906 leader_election.cc:304] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:08.307217 14485 raft_consensus.cc:2804] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.308034 14485 raft_consensus.cc:697] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:08.309005 14485 consensus_queue.cc:237] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.298851 14060 raft_consensus.cc:359] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.310886 14060 raft_consensus.cc:385] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.301076 14061 tablet_bootstrap.cc:654] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.311208 14060 raft_consensus.cc:740] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.278204 14244 raft_consensus.cc:515] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.326658 13864 raft_consensus.cc:2468] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
W20260709 13:04:08.362985 13832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 111705us
I20260709 13:04:08.363679 14060 consensus_queue.cc:260] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:08.365099 13833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 110241us
I20260709 13:04:08.365420 14063 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f: No bootstrap required, opened a new log
I20260709 13:04:08.365541 13687 catalog_manager.cc:5697] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 1 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.369750 14063 ts_tablet_manager.cc:1403] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.004s
I20260709 13:04:08.370765 14061 tablet_bootstrap.cc:492] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:08.371312 14061 ts_tablet_manager.cc:1403] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.210s	user 0.012s	sys 0.004s
I20260709 13:04:08.371977 13686 catalog_manager.cc:5697] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.372869 14063 raft_consensus.cc:359] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.373145 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:08.374387 14063 raft_consensus.cc:385] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.374723 14063 raft_consensus.cc:740] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.375470 14063 consensus_queue.cc:260] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.375097 14061 raft_consensus.cc:359] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.379014 14061 raft_consensus.cc:385] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.379348 14061 raft_consensus.cc:740] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.382577 14429 raft_consensus.cc:493] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.383304 14429 raft_consensus.cc:515] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.384755 14061 consensus_queue.cc:260] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.386123 14429 leader_election.cc:290] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:08.387523 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbed8f0ccba4b5fabb54cdb9abcead1" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:08.388309 13935 raft_consensus.cc:2468] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:08.389680 13831 leader_election.cc:304] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:08.391098 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbed8f0ccba4b5fabb54cdb9abcead1" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:08.391920 13786 raft_consensus.cc:2468] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:08.392058 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c945695696fc4b6a9ad5becbe6a236a7" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:08.394657 14015 raft_consensus.cc:3060] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.396581 14063 ts_tablet_manager.cc:1434] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.004s
W20260709 13:04:08.397279 14502 log.cc:927] Time spent T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:04:08.402335 14244 leader_election.cc:290] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:08.365429 14060 ts_tablet_manager.cc:1434] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.000s
I20260709 13:04:08.404764 14060 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:08.406744 14421 raft_consensus.cc:2804] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.407378 14421 raft_consensus.cc:493] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.407840 14421 raft_consensus.cc:3060] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:08.399142 13833 leader_election.cc:343] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.427547 14015 raft_consensus.cc:2468] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:08.431841 14061 ts_tablet_manager.cc:1434] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.003s
I20260709 13:04:08.433276 14061 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:08.439543 13833 leader_election.cc:304] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:08.446198 14422 raft_consensus.cc:2749] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.448751 14060 tablet_bootstrap.cc:654] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.453224 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c945695696fc4b6a9ad5becbe6a236a7" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:08.454957 13832 leader_election.cc:304] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:08.455410 14062 tablet_bootstrap.cc:654] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:08.455706 13833 leader_election.cc:343] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.456522 14505 raft_consensus.cc:2804] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.457100 14505 raft_consensus.cc:697] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:08.458118 14505 consensus_queue.cc:237] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.475526 14061 tablet_bootstrap.cc:654] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.479646 14060 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:08.480546 14060 ts_tablet_manager.cc:1403] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.001s
I20260709 13:04:08.486668 14421 raft_consensus.cc:515] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.490852 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbed8f0ccba4b5fabb54cdb9abcead1" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:08.491492 14421 leader_election.cc:290] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:08.491602 13786 raft_consensus.cc:3060] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.495699 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbed8f0ccba4b5fabb54cdb9abcead1" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:08.496529 13941 raft_consensus.cc:3060] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.499233 14060 raft_consensus.cc:359] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.500624 14060 raft_consensus.cc:385] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.501271 14060 raft_consensus.cc:740] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.501921 14422 raft_consensus.cc:493] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.502709 14422 raft_consensus.cc:515] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.505101 14422 leader_election.cc:290] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:08.505774 14060 consensus_queue.cc:260] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.509646 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:08.510758 13789 raft_consensus.cc:2468] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:08.512087 13833 leader_election.cc:304] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:08.513219 13941 raft_consensus.cc:2468] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:08.514171 14060 ts_tablet_manager.cc:1434] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:04:08.514930 13831 leader_election.cc:304] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:08.514246 14422 raft_consensus.cc:2804] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.513387 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:08.515974 14422 raft_consensus.cc:493] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.516551 14505 raft_consensus.cc:2804] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.516458 14422 raft_consensus.cc:3060] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.517553 14505 raft_consensus.cc:697] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:08.516453 14010 raft_consensus.cc:2468] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:08.517812 13786 raft_consensus.cc:2468] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:08.516393 14060 tablet_bootstrap.cc:492] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1: Bootstrap starting.
I20260709 13:04:08.525691 14060 tablet_bootstrap.cc:654] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.524271 14505 consensus_queue.cc:237] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.527658 14062 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:08.528264 14062 ts_tablet_manager.cc:1403] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.242s	user 0.012s	sys 0.016s
I20260709 13:04:08.531513 14062 raft_consensus.cc:359] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.532223 14062 raft_consensus.cc:385] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.532529 14062 raft_consensus.cc:740] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.533383 14062 consensus_queue.cc:260] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.536007 14062 ts_tablet_manager.cc:1434] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:08.537199 14062 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:08.538172 14422 raft_consensus.cc:515] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.542258 14485 raft_consensus.cc:493] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.542892 14485 raft_consensus.cc:515] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:08.546315 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:08.547112 14010 raft_consensus.cc:3060] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.555217 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8e2fbb0a1541e7b82f6112cabed288" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
W20260709 13:04:08.559399 13906 leader_election.cc:343] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.586478 14436 raft_consensus.cc:493] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.587209 14436 raft_consensus.cc:515] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.590353 14436 leader_election.cc:290] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:08.590593 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:08.591377 13864 raft_consensus.cc:2468] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 0.
I20260709 13:04:08.595546 14422 leader_election.cc:290] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:08.600075 14010 raft_consensus.cc:2468] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:08.602037 13832 leader_election.cc:304] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:08.602788 14061 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:08.603050 14422 raft_consensus.cc:2804] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.603569 14061 ts_tablet_manager.cc:1403] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.171s	user 0.010s	sys 0.006s
I20260709 13:04:08.604017 14422 raft_consensus.cc:697] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:08.605365 14504 raft_consensus.cc:493] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.608590 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:08.609404 13786 raft_consensus.cc:3060] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.609171 14504 raft_consensus.cc:515] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.611785 14504 leader_election.cc:290] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:08.615703 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef26422e31c46fe8f63d4388ae021a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:08.615960 13906 leader_election.cc:304] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:08.616487 13789 raft_consensus.cc:2468] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:08.584653 14485 leader_election.cc:290] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:08.618320 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8e2fbb0a1541e7b82f6112cabed288" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:08.618307 14485 raft_consensus.cc:2804] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.621111 14485 raft_consensus.cc:493] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.621502 14485 raft_consensus.cc:3060] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.622242 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:08.629509 13833 leader_election.cc:304] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:08.630401 14429 raft_consensus.cc:2804] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.630836 14429 raft_consensus.cc:493] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.632177 14060 tablet_bootstrap.cc:492] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1: No bootstrap required, opened a new log
I20260709 13:04:08.632901 14060 ts_tablet_manager.cc:1403] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.007s
I20260709 13:04:08.632932 14429 raft_consensus.cc:3060] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.638163 14062 tablet_bootstrap.cc:654] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.669539 14061 raft_consensus.cc:359] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.670976 14061 raft_consensus.cc:385] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.671401 14061 raft_consensus.cc:740] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.680173 14061 consensus_queue.cc:260] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.680526 14485 raft_consensus.cc:515] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:08.683777 14485 leader_election.cc:290] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
W20260709 13:04:08.658329 13907 leader_election.cc:343] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.671604 14060 raft_consensus.cc:359] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.784945 14060 raft_consensus.cc:385] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.785451 14060 raft_consensus.cc:740] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.734144 14061 ts_tablet_manager.cc:1434] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.130s	user 0.012s	sys 0.000s
I20260709 13:04:08.605027 14422 consensus_queue.cc:237] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.748989 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:08.789871 13865 raft_consensus.cc:3060] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.798936 14429 raft_consensus.cc:515] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.800259 14061 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05: Bootstrap starting.
I20260709 13:04:08.804188 14060 consensus_queue.cc:260] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.786329 13907 leader_election.cc:304] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:08.806900 14060 ts_tablet_manager.cc:1434] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1: Time spent starting tablet: real 0.173s	user 0.014s	sys 0.004s
W20260709 13:04:08.807464 13907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 158766us
I20260709 13:04:08.808483 14485 raft_consensus.cc:2749] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.808658 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef26422e31c46fe8f63d4388ae021a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:08.809414 14014 raft_consensus.cc:3060] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:08.809831 13907 leader_election.cc:343] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.810509 13865 raft_consensus.cc:2468] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:08.818842 14521 raft_consensus.cc:493] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.819473 14521 raft_consensus.cc:515] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.826095 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:08.826642 14061 tablet_bootstrap.cc:654] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.830768 14521 leader_election.cc:290] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:08.834354 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef26422e31c46fe8f63d4388ae021a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:08.842002 13940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:08.843057 13940 raft_consensus.cc:2468] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:08.852051 13906 leader_election.cc:304] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:08.854768 14062 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:08.855634 14062 ts_tablet_manager.cc:1403] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.319s	user 0.016s	sys 0.027s
I20260709 13:04:08.785122 13786 raft_consensus.cc:2468] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
W20260709 13:04:08.866961 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:39185, user_credentials={real_user=slave}} blocked reactor thread for 51370.3us
I20260709 13:04:08.854128 14485 raft_consensus.cc:2804] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.903119 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:08.880157 14504 raft_consensus.cc:493] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.911329 14504 raft_consensus.cc:515] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:08.912799 13863 raft_consensus.cc:2468] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:08.880813 14522 consensus_queue.cc:1048] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
W20260709 13:04:08.923903 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 52339us
I20260709 13:04:08.897926 13979 leader_election.cc:304] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:08.948022 14446 raft_consensus.cc:2804] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.948514 14446 raft_consensus.cc:493] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.951483 14446 raft_consensus.cc:3060] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.953063 14014 raft_consensus.cc:2468] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:08.945272 14504 leader_election.cc:290] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:08.963660 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
W20260709 13:04:08.945930 13979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.195:39185, user_credentials={real_user=slave}} blocked reactor thread for 61361.9us
I20260709 13:04:08.966156 14429 leader_election.cc:290] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:08.966603 14062 raft_consensus.cc:359] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:08.968362 14062 raft_consensus.cc:385] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.968736 14062 raft_consensus.cc:740] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.972433 13832 leader_election.cc:304] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:08.979079 13688 catalog_manager.cc:5697] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.984226 13688 catalog_manager.cc:5697] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.988456 13688 catalog_manager.cc:5697] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.990633 14061 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05: No bootstrap required, opened a new log
I20260709 13:04:08.995738 14061 ts_tablet_manager.cc:1403] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05: Time spent bootstrapping tablet: real 0.196s	user 0.041s	sys 0.044s
I20260709 13:04:08.997282 14484 consensus_queue.cc:1048] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.001616 14061 raft_consensus.cc:359] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.002729 14061 raft_consensus.cc:385] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.003144 14061 raft_consensus.cc:740] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.006274 14061 consensus_queue.cc:260] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:09.021132 13832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 48824.4us
I20260709 13:04:09.021370 14424 raft_consensus.cc:2804] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.022410 14424 raft_consensus.cc:697] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:09.023456 14424 consensus_queue.cc:237] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:09.042081 14062 consensus_queue.cc:260] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:09.044170 13738 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:04:09.066876 13981 consensus_peers.cc:597] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:09.073055 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef26422e31c46fe8f63d4388ae021a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:09.073910 13792 raft_consensus.cc:3060] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:09.084671 13907 leader_election.cc:343] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.110708 14062 ts_tablet_manager.cc:1434] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.255s	user 0.008s	sys 0.001s
I20260709 13:04:09.119522 14061 ts_tablet_manager.cc:1434] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.001s
I20260709 13:04:09.095963 14485 raft_consensus.cc:697] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:09.124289 13785 raft_consensus.cc:3060] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.125147 14062 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:09.130272 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:09.131067 13939 raft_consensus.cc:2468] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 0.
I20260709 13:04:09.131567 14485 consensus_queue.cc:237] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:09.119359 14429 consensus_queue.cc:1048] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:04:09.142689 13792 raft_consensus.cc:2468] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:09.144860 13688 catalog_manager.cc:5697] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.179093 14529 consensus_queue.cc:1048] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:09.184054 14527 consensus_queue.cc:1048] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.185760 14446 raft_consensus.cc:515] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:09.206597 14484 raft_consensus.cc:493] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.207293 14484 raft_consensus.cc:515] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:09.209733 13831 leader_election.cc:304] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:09.210659 14424 raft_consensus.cc:2804] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.210965 14484 leader_election.cc:290] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:09.213019 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c945695696fc4b6a9ad5becbe6a236a7" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:09.214105 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c945695696fc4b6a9ad5becbe6a236a7" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:09.211095 14424 raft_consensus.cc:493] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.219508 14424 raft_consensus.cc:3060] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.222293 14458 consensus_queue.cc:1048] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.234635 13757 leader_election.cc:304] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:09.242308 14012 raft_consensus.cc:2393] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97c52f3e93434bedbdc9755e64f33d4f in current term 1: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:09.248311 14062 tablet_bootstrap.cc:654] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.249423 14483 raft_consensus.cc:2749] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:09.250159 14504 consensus_queue.cc:1048] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.258225 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:09.266309 14446 leader_election.cc:290] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:09.271000 13937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:09.261745 14422 consensus_queue.cc:1048] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
W20260709 13:04:09.319934 13833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 60835.9us
I20260709 13:04:09.316190 13937 raft_consensus.cc:3060] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.352885 14458 consensus_queue.cc:1048] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:09.380249 14534 log.cc:927] Time spent T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:04:09.413535 14446 raft_consensus.cc:493] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.391237 14424 raft_consensus.cc:515] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:09.428594 13690 catalog_manager.cc:5697] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.430585 14446 raft_consensus.cc:515] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.440918 14446 leader_election.cc:290] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:09.458716 14424 leader_election.cc:290] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:09.460475 13867 raft_consensus.cc:2393] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 1: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
I20260709 13:04:09.461020 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8e2fbb0a1541e7b82f6112cabed288" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:09.461715 13941 raft_consensus.cc:2468] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 0.
I20260709 13:04:09.453316 14505 consensus_queue.cc:1048] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:09.467875 14062 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:09.473595 14062 ts_tablet_manager.cc:1403] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.349s	user 0.018s	sys 0.023s
I20260709 13:04:09.478242 14062 raft_consensus.cc:359] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:09.479598 13979 leader_election.cc:304] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:09.479580 14062 raft_consensus.cc:385] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.481407 14062 raft_consensus.cc:740] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.482666 14062 consensus_queue.cc:260] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:09.470814 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:09.489573 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8797238dd5cd494e936f80a38430878c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:09.490597 14010 raft_consensus.cc:2393] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 97c52f3e93434bedbdc9755e64f33d4f in current term 1: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:09.480820 14446 raft_consensus.cc:2804] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.494529 14446 raft_consensus.cc:493] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.494815 13792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8e2fbb0a1541e7b82f6112cabed288" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:09.495082 14446 raft_consensus.cc:3060] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:09.497471 13981 leader_election.cc:343] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.500931 13937 raft_consensus.cc:2468] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:09.502483 13979 leader_election.cc:304] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:09.503836 14494 raft_consensus.cc:2804] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.504385 14494 raft_consensus.cc:697] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:09.505273 14494 consensus_queue.cc:237] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:09.494397 14062 ts_tablet_manager.cc:1434] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:04:09.514529 14062 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:09.517009 14446 raft_consensus.cc:515] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.518324 14504 consensus_queue.cc:1048] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.520972 13832 leader_election.cc:304] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:09.531414 14504 raft_consensus.cc:2749] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.535475 14446 leader_election.cc:290] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:09.537110 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8e2fbb0a1541e7b82f6112cabed288" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:09.537979 13936 raft_consensus.cc:3060] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.548069 14062 tablet_bootstrap.cc:654] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.556967 13936 raft_consensus.cc:2468] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:09.559342 13979 leader_election.cc:304] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:09.562067 14494 raft_consensus.cc:2804] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.562991 14494 raft_consensus.cc:697] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:09.562741 14421 consensus_queue.cc:1048] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:09.564445 14494 consensus_queue.cc:237] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.586313 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8e2fbb0a1541e7b82f6112cabed288" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
W20260709 13:04:09.588290 13981 leader_election.cc:343] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.629034 14522 raft_consensus.cc:493] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.629591 14522 raft_consensus.cc:515] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:09.631904 14522 leader_election.cc:290] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:09.633531 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:09.635028 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:09.635859 13867 raft_consensus.cc:2393] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 48967ca777ee43ebaddd57da674bd3e1 in this term.
I20260709 13:04:09.638500 13756 leader_election.cc:304] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:09.639292 14483 raft_consensus.cc:3060] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.654492 14483 raft_consensus.cc:2749] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.691092 14062 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:09.693462 14062 ts_tablet_manager.cc:1403] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.179s	user 0.035s	sys 0.034s
I20260709 13:04:09.696983 14062 raft_consensus.cc:359] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.699537 13687 catalog_manager.cc:5697] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.701116 14062 raft_consensus.cc:385] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.701499 14062 raft_consensus.cc:740] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.702109 13687 catalog_manager.cc:5697] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 1 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.703333 14062 consensus_queue.cc:260] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.706430 14437 consensus_queue.cc:1048] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.707903 14062 ts_tablet_manager.cc:1434] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:09.710150 14062 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:09.732153 14062 tablet_bootstrap.cc:654] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.756894 14062 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: No bootstrap required, opened a new log
I20260709 13:04:09.757390 14062 ts_tablet_manager.cc:1403] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.008s
I20260709 13:04:09.757906 14485 consensus_queue.cc:1048] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.760207 14062 raft_consensus.cc:359] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.760977 14062 raft_consensus.cc:385] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.761245 14062 raft_consensus.cc:740] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.761952 14062 consensus_queue.cc:260] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.764446 14062 ts_tablet_manager.cc:1434] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:09.890233 14483 raft_consensus.cc:493] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.890792 14483 raft_consensus.cc:515] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:09.893211 14483 leader_election.cc:290] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:09.893674 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8e2fbb0a1541e7b82f6112cabed288" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:09.893745 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8e2fbb0a1541e7b82f6112cabed288" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:09.894759 13936 raft_consensus.cc:2393] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 1: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:09.895747 13756 leader_election.cc:304] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:09.896333 14483 raft_consensus.cc:3060] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.901561 14483 raft_consensus.cc:2749] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.985618 14494 consensus_queue.cc:1048] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.002653 14561 consensus_queue.cc:1048] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.030139 13785 raft_consensus.cc:3060] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.056268 14561 consensus_queue.cc:1048] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.069940 14446 consensus_queue.cc:1048] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:10.907496  7283 tablet_server.cc:179] TabletServer@127.7.28.193:0 shutting down...
W20260709 13:04:10.921689 13907 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 122 similar messages]
W20260709 13:04:10.925665 13907 consensus_peers.cc:597] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:10.936863 13981 consensus_peers.cc:597] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:10.958755 13981 consensus_peers.cc:597] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.968924  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:10.972239  7283 tablet_replica.cc:333] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
W20260709 13:04:10.973001 13907 consensus_peers.cc:597] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.973269  7283 raft_consensus.cc:2243] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.974193  7283 raft_consensus.cc:2272] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:10.974366 13833 consensus_peers.cc:597] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:10.975111 13833 consensus_peers.cc:597] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:10.975693 13833 consensus_peers.cc:597] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.977083  7283 tablet_replica.cc:333] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
W20260709 13:04:10.977756 13981 consensus_peers.cc:597] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.978228  7283 raft_consensus.cc:2243] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.978742  7283 raft_consensus.cc:2272] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.981110  7283 tablet_replica.cc:333] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:10.982057  7283 raft_consensus.cc:2243] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:10.982921  7283 raft_consensus.cc:2272] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.985884  7283 tablet_replica.cc:333] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:10.986802  7283 raft_consensus.cc:2243] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.987322  7283 raft_consensus.cc:2272] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.989820  7283 tablet_replica.cc:333] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
W20260709 13:04:10.989670 13907 consensus_peers.cc:597] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.990742  7283 raft_consensus.cc:2243] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.991259  7283 raft_consensus.cc:2272] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.993533  7283 tablet_replica.cc:333] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:10.994515  7283 raft_consensus.cc:2243] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.995124  7283 raft_consensus.cc:2272] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:10.995764 13833 consensus_peers.cc:597] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.997648  7283 tablet_replica.cc:333] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:10.998502  7283 raft_consensus.cc:2243] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.999059  7283 raft_consensus.cc:2272] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.001056  7283 tablet_replica.cc:333] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.001582  7283 raft_consensus.cc:2243] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.002523  7283 raft_consensus.cc:2272] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.004855  7283 tablet_replica.cc:333] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.005610  7283 raft_consensus.cc:2243] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.006474  7283 raft_consensus.cc:2272] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.008615  7283 tablet_replica.cc:333] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.009161  7283 raft_consensus.cc:2243] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.009552  7283 raft_consensus.cc:2272] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.012017  7283 tablet_replica.cc:333] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.012843  7283 raft_consensus.cc:2243] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.013336  7283 raft_consensus.cc:2272] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.015597  7283 tablet_replica.cc:333] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.016357  7283 raft_consensus.cc:2243] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.016949  7283 raft_consensus.cc:2272] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.019078  7283 tablet_replica.cc:333] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.019706  7283 raft_consensus.cc:2243] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.020147  7283 raft_consensus.cc:2272] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.022473  7283 tablet_replica.cc:333] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.023257  7283 raft_consensus.cc:2243] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.024092  7283 raft_consensus.cc:2272] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.026304  7283 tablet_replica.cc:333] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.026908  7283 raft_consensus.cc:2243] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.027719  7283 raft_consensus.cc:2272] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.030104  7283 tablet_replica.cc:333] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.030783  7283 raft_consensus.cc:2243] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.031317  7283 raft_consensus.cc:2272] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.034341  7283 tablet_replica.cc:333] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.035090  7283 raft_consensus.cc:2243] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.035619  7283 raft_consensus.cc:2272] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:11.037642 13833 consensus_peers.cc:597] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.038295  7283 tablet_replica.cc:333] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.038988  7283 raft_consensus.cc:2243] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.039899  7283 raft_consensus.cc:2272] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.042311  7283 tablet_replica.cc:333] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.042917  7283 raft_consensus.cc:2243] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.043375  7283 raft_consensus.cc:2272] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.046057  7283 tablet_replica.cc:333] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.046733  7283 raft_consensus.cc:2243] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.047205  7283 raft_consensus.cc:2272] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.050428  7283 tablet_replica.cc:333] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.051447  7283 raft_consensus.cc:2243] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.052033  7283 raft_consensus.cc:2272] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:11.052043 13833 consensus_peers.cc:597] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.054383  7283 tablet_replica.cc:333] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.055020  7283 raft_consensus.cc:2243] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.055927  7283 raft_consensus.cc:2272] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.058923  7283 tablet_replica.cc:333] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.059762  7283 raft_consensus.cc:2243] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:11.060505 13833 consensus_peers.cc:597] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.060812  7283 raft_consensus.cc:2272] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.063957  7283 tablet_replica.cc:333] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.064749  7283 raft_consensus.cc:2243] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.065287  7283 raft_consensus.cc:2272] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.068251  7283 tablet_replica.cc:333] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.069075  7283 raft_consensus.cc:2243] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.069628  7283 raft_consensus.cc:2272] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.072239  7283 tablet_replica.cc:333] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.072979  7283 raft_consensus.cc:2243] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:11.073820 13833 consensus_peers.cc:597] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.074061  7283 raft_consensus.cc:2272] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.077085  7283 tablet_replica.cc:333] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.077965  7283 raft_consensus.cc:2243] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.078476  7283 raft_consensus.cc:2272] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.080953  7283 tablet_replica.cc:333] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.081631  7283 raft_consensus.cc:2243] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.082141  7283 raft_consensus.cc:2272] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.084263  7283 tablet_replica.cc:333] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.084867  7283 raft_consensus.cc:2243] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.085295  7283 raft_consensus.cc:2272] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.087786  7283 tablet_replica.cc:333] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.088523  7283 raft_consensus.cc:2243] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.089512  7283 raft_consensus.cc:2272] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:11.090075 13833 consensus_peers.cc:597] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.091885  7283 tablet_replica.cc:333] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.092741  7283 raft_consensus.cc:2243] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.093325  7283 raft_consensus.cc:2272] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:11.095331 13981 consensus_peers.cc:597] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.096112  7283 tablet_replica.cc:333] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.097080  7283 raft_consensus.cc:2243] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.097586  7283 raft_consensus.cc:2272] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.100239  7283 tablet_replica.cc:333] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.100893  7283 raft_consensus.cc:2243] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.101713  7283 raft_consensus.cc:2272] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.104637  7283 tablet_replica.cc:333] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.105398  7283 raft_consensus.cc:2243] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.105934  7283 raft_consensus.cc:2272] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.108918  7283 tablet_replica.cc:333] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.109701  7283 raft_consensus.cc:2243] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.110260  7283 raft_consensus.cc:2272] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.112711  7283 tablet_replica.cc:333] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
W20260709 13:04:11.113307 13907 consensus_peers.cc:597] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.113511  7283 raft_consensus.cc:2243] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.114708  7283 raft_consensus.cc:2272] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.116884  7283 tablet_replica.cc:333] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.117466  7283 raft_consensus.cc:2243] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.118305  7283 raft_consensus.cc:2272] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.120208  7283 tablet_replica.cc:333] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.120770  7283 raft_consensus.cc:2243] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.121696  7283 raft_consensus.cc:2272] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.124034  7283 tablet_replica.cc:333] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.124713  7283 raft_consensus.cc:2243] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.125206  7283 raft_consensus.cc:2272] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.127810  7283 tablet_replica.cc:333] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.128302  7283 raft_consensus.cc:2243] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.128664  7283 raft_consensus.cc:2272] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.130450  7283 tablet_replica.cc:333] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.130944  7283 raft_consensus.cc:2243] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.131311  7283 raft_consensus.cc:2272] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.133365  7283 tablet_replica.cc:333] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.134075  7283 raft_consensus.cc:2243] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.134557  7283 raft_consensus.cc:2272] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.136649  7283 tablet_replica.cc:333] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.137101  7283 raft_consensus.cc:2243] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:11.137441 13833 consensus_peers.cc:597] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.137533  7283 raft_consensus.cc:2272] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.140295  7283 tablet_replica.cc:333] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.141026  7283 raft_consensus.cc:2243] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.141564  7283 raft_consensus.cc:2272] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.144430  7283 tablet_replica.cc:333] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: stopping tablet replica
I20260709 13:04:11.145063  7283 raft_consensus.cc:2243] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:11.145614  7283 raft_consensus.cc:2272] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:11.156699 13833 consensus_peers.cc:597] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.208068 13907 consensus_peers.cc:597] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.222441 13833 consensus_peers.cc:597] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.225343 13981 consensus_peers.cc:597] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.226171 13981 consensus_peers.cc:597] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.229267 13758 connection.cc:466] server connection from 127.0.0.1:55128 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55128 (request call id 165) could send its response
W20260709 13:04:11.231040 13758 connection.cc:466] server connection from 127.0.0.1:55112 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55112 (request call id 258) could send its response
W20260709 13:04:11.231772 13758 connection.cc:466] server connection from 127.0.0.1:55112 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55112 (request call id 259) could send its response
W20260709 13:04:11.232667 13833 consensus_peers.cc:597] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: recv got EOF from 127.7.28.193:40245 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.233500 13833 consensus_peers.cc:597] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: recv got EOF from 127.7.28.193:40245 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.233536  7283 connection.cc:466] server connection from 127.0.0.1:55128 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55128 (request call id 164) could send its response
W20260709 13:04:11.233632 13981 consensus_peers.cc:597] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: recv got EOF from 127.7.28.193:40245 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.234405 13981 consensus_peers.cc:597] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: recv got EOF from 127.7.28.193:40245 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.243182 13981 consensus_peers.cc:597] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.250201  7283 tablet_server.cc:196] TabletServer@127.7.28.193:0 shutdown complete.
W20260709 13:04:11.300336 13907 consensus_peers.cc:597] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.322649  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:11.330176 14574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:11.330269 14575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:11.333853 14577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:11.335166  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:11.337131  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:11.337427  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:11.337647  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602251337632 us; error 0 us; skew 500 ppm
I20260709 13:04:11.338285  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:11.343937  7283 webserver.cc:533] Webserver started at http://127.7.28.193:40967/ using document root <none> and password file <none>
I20260709 13:04:11.344635  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:11.344899  7283 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:11.350090  7283 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
W20260709 13:04:11.350441 13833 consensus_peers.cc:597] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.358623 14583 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:11.359544  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:04:11.359925  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
format_stamp: "Formatted at 2026-07-09 13:03:57 on dist-test-slave-ll1f"
I20260709 13:04:11.360383  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:11.380415  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:11.381687  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:11.383539  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:11.388595 14590 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:04:11.568158 13907 consensus_peers.cc:597] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.750952  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:04:11.751334  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.364s	user 0.009s	sys 0.000s
I20260709 13:04:11.751658  7283 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:04:11.757233 14590 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.773175 14590 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.774247 14590 tablet_bootstrap.cc:492] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.774889 14590 ts_tablet_manager.cc:1403] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:04:11.777588 14590 raft_consensus.cc:359] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:11.778311 14590 raft_consensus.cc:740] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.779179 14590 consensus_queue.cc:260] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:11.785249 14590 ts_tablet_manager.cc:1434] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:04:11.786162 14590 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.798010 14590 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.798803 14590 tablet_bootstrap.cc:492] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.799419 14590 ts_tablet_manager.cc:1403] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:04:11.801385 14590 raft_consensus.cc:359] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:11.801976 14590 raft_consensus.cc:740] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.802554 14590 consensus_queue.cc:260] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:11.804014 14590 ts_tablet_manager.cc:1434] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:04:11.804668 14590 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.824705 14590 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.825723 14590 tablet_bootstrap.cc:492] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.826437 14590 ts_tablet_manager.cc:1403] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:04:11.828295 14590 raft_consensus.cc:359] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:11.829084 14590 raft_consensus.cc:740] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.829713 14590 consensus_queue.cc:260] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:11.831962 14590 ts_tablet_manager.cc:1434] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:11.832823 14590 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.850310 14590 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.851303 14590 tablet_bootstrap.cc:492] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.851997 14590 ts_tablet_manager.cc:1403] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:04:11.854795 14590 raft_consensus.cc:359] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:11.855489 14590 raft_consensus.cc:740] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.856195 14590 consensus_queue.cc:260] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:11.862457 14590 ts_tablet_manager.cc:1434] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:11.863325 14590 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.880592 14590 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.881649 14590 tablet_bootstrap.cc:492] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.882349 14590 ts_tablet_manager.cc:1403] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:04:11.884912 14590 raft_consensus.cc:359] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:11.885632 14590 raft_consensus.cc:740] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.886415 14590 consensus_queue.cc:260] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:11.888509 14590 ts_tablet_manager.cc:1434] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:11.889364 14590 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.904985 14590 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.905839 14590 tablet_bootstrap.cc:492] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.906526 14590 ts_tablet_manager.cc:1403] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:04:11.909073 14590 raft_consensus.cc:359] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:11.909677 14590 raft_consensus.cc:740] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.910514 14590 consensus_queue.cc:260] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:11.912220 14590 ts_tablet_manager.cc:1434] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:11.912995 14590 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.928320 14590 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.929272 14590 tablet_bootstrap.cc:492] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.929960 14590 ts_tablet_manager.cc:1403] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:04:11.931833 14590 raft_consensus.cc:359] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:11.932324 14590 raft_consensus.cc:740] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.933014 14590 consensus_queue.cc:260] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:11.934722 14590 ts_tablet_manager.cc:1434] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:11.935356 14590 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.948958 14590 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.949918 14590 tablet_bootstrap.cc:492] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.950560 14590 ts_tablet_manager.cc:1403] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:04:11.952706 14590 raft_consensus.cc:359] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:11.953315 14590 raft_consensus.cc:740] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.954057 14590 consensus_queue.cc:260] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:11.956161 14590 ts_tablet_manager.cc:1434] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:11.958225 14590 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:11.966212 14571 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:11.968204 14571 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:11.970329 14596 raft_consensus.cc:493] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:11.971050 14571 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:11.970949 14596 raft_consensus.cc:515] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:11.973225 14596 leader_election.cc:290] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:11.974898 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:11.977855 13907 leader_election.cc:336] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:11.978741 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:11.980268 13981 leader_election.cc:336] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:11.980775 13981 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:11.982497 14571 raft_consensus.cc:2749] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:11.982903 13906 leader_election.cc:304] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:11.983753 14596 raft_consensus.cc:2749] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:11.984612 14590 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.985687 14590 tablet_bootstrap.cc:492] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:11.986408 14590 ts_tablet_manager.cc:1403] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 13:04:11.989022 14590 raft_consensus.cc:359] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:11.989991 14590 raft_consensus.cc:740] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.990703 14590 consensus_queue.cc:260] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:11.992964 14590 ts_tablet_manager.cc:1434] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:11.993827 14590 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:12.009739 14590 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:12.010721 14590 tablet_bootstrap.cc:492] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:12.011360 14590 ts_tablet_manager.cc:1403] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:04:12.013741 14590 raft_consensus.cc:359] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.014480 14590 raft_consensus.cc:740] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.015146 14590 consensus_queue.cc:260] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.017132 14590 ts_tablet_manager.cc:1434] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:12.017910 14590 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:12.032392 14590 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:12.033339 14590 tablet_bootstrap.cc:492] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:12.034076 14590 ts_tablet_manager.cc:1403] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.016s	user 0.016s	sys 0.000s
I20260709 13:04:12.036455 14590 raft_consensus.cc:359] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.037266 14590 raft_consensus.cc:740] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.038244 14458 raft_consensus.cc:493] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.038082 14590 consensus_queue.cc:260] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.038889 14458 raft_consensus.cc:515] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.040259 14590 ts_tablet_manager.cc:1434] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:12.040792 14458 leader_election.cc:290] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:12.041124 14590 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:12.045291 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.046010 13941 raft_consensus.cc:2468] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:12.047338 13831 leader_election.cc:304] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:12.048121 14458 raft_consensus.cc:2804] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.048509 14458 raft_consensus.cc:493] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.048846 14458 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.051661  7283 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:04:12.052014  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.300s	user 0.263s	sys 0.016s
W20260709 13:04:12.059023 13833 leader_election.cc:336] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.069257 14446 raft_consensus.cc:493] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.069866 14446 raft_consensus.cc:515] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.071780 14446 leader_election.cc:290] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.073163 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.087460 14590 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:12.088820 14590 tablet_bootstrap.cc:492] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:12.089715 14590 ts_tablet_manager.cc:1403] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.027s
W20260709 13:04:12.090739 13981 leader_election.cc:336] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.091200 13981 leader_election.cc:304] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.091774 14446 raft_consensus.cc:2749] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.066383 14458 raft_consensus.cc:515] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.093464 14592 raft_consensus.cc:493] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.093164 14590 raft_consensus.cc:359] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.094123 14592 raft_consensus.cc:515] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:12.100540 13833 leader_election.cc:336] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.100363 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:12.101881 13907 leader_election.cc:336] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.107013 13906 leader_election.cc:304] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.107849 14596 raft_consensus.cc:2749] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.096339 14592 leader_election.cc:290] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:12.094300 14590 raft_consensus.cc:740] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.112284 14458 leader_election.cc:290] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:12.112071 14590 consensus_queue.cc:260] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.113476 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:12.114713 13941 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.116154 14590 ts_tablet_manager.cc:1434] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:04:12.117105 14590 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:12.121218 14458 raft_consensus.cc:493] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.121876 14458 raft_consensus.cc:515] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:12.147902 13833 leader_election.cc:336] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.149432 14592 raft_consensus.cc:493] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.149967 14458 leader_election.cc:290] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:12.150063 14592 raft_consensus.cc:515] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.151140 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.151823 13936 raft_consensus.cc:2468] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:12.153118 13831 leader_election.cc:304] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.154399 14458 raft_consensus.cc:2804] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.154695 13941 raft_consensus.cc:2468] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 2.
I20260709 13:04:12.156533 13831 leader_election.cc:304] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
W20260709 13:04:12.157344 13907 leader_election.cc:336] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.159597 14593 raft_consensus.cc:2804] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.160141 14593 raft_consensus.cc:697] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:12.160954 14593 consensus_queue.cc:237] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.164865 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:12.165114 14590 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:12.166657 14590 tablet_bootstrap.cc:492] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:12.167742 14590 ts_tablet_manager.cc:1403] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.007s
I20260709 13:04:12.168438 14592 leader_election.cc:290] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:12.154789 14458 raft_consensus.cc:493] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.169750 14458 raft_consensus.cc:3060] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.171948 14590 raft_consensus.cc:359] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.179114 14590 raft_consensus.cc:740] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.180193 14590 consensus_queue.cc:260] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.183884 14590 ts_tablet_manager.cc:1434] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:04:12.186404 14590 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:12.186893 14594 raft_consensus.cc:493] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.187458 14594 raft_consensus.cc:515] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.189606 14594 leader_election.cc:290] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:12.191725 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.192732 13687 catalog_manager.cc:5697] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.186314 14571 raft_consensus.cc:493] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.196839 14571 raft_consensus.cc:515] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.196424 14458 raft_consensus.cc:515] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:12.199613 13833 leader_election.cc:336] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.200151 13833 leader_election.cc:304] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.200903 14594 raft_consensus.cc:2749] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.202628 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335fd22e76d14ce5822297f3f534fb0c" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:12.203272 13941 raft_consensus.cc:3060] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.201431 14458 leader_election.cc:290] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:12.205961 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:12.205706 14571 leader_election.cc:290] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
W20260709 13:04:12.205989 13981 leader_election.cc:336] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.209473 13980 leader_election.cc:304] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.210311 14446 raft_consensus.cc:2749] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.206317 13864 raft_consensus.cc:2393] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 2: Already voted for candidate 97c52f3e93434bedbdc9755e64f33d4f in this term.
I20260709 13:04:12.212780 13941 raft_consensus.cc:2468] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 2.
I20260709 13:04:12.214175 13831 leader_election.cc:304] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:12.215337 13906 leader_election.cc:304] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.218374 14596 raft_consensus.cc:2749] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.222066 14624 raft_consensus.cc:2804] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.226531 14446 raft_consensus.cc:493] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.227120 14446 raft_consensus.cc:515] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.229128 14446 leader_election.cc:290] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.233420 14594 raft_consensus.cc:493] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.234086 14594 raft_consensus.cc:515] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.236964 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.242190 14594 leader_election.cc:290] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:12.243995 14624 raft_consensus.cc:697] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
W20260709 13:04:12.249715 13833 leader_election.cc:336] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.253476 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.254447 13936 raft_consensus.cc:2468] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:12.245407 14624 consensus_queue.cc:237] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.258303 13831 leader_election.cc:304] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:12.259397 14627 raft_consensus.cc:2804] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.259789 14627 raft_consensus.cc:493] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.260270 14627 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:12.260568 13981 leader_election.cc:336] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.261096 13981 leader_election.cc:304] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
W20260709 13:04:12.268082 13833 leader_election.cc:336] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.279306 14571 raft_consensus.cc:2749] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.296304 14458 raft_consensus.cc:493] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.296994 14458 raft_consensus.cc:515] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.297072 14627 raft_consensus.cc:515] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.300177 14571 raft_consensus.cc:493] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.301290 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.300170 14458 leader_election.cc:290] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:12.301021 14571 raft_consensus.cc:515] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.306860 14571 leader_election.cc:290] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:12.307957 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:12.311110 13833 leader_election.cc:336] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.311650 13833 leader_election.cc:304] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.312382 14458 raft_consensus.cc:2749] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:12.313592 13981 leader_election.cc:336] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.314131 13981 leader_election.cc:304] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.315068 14540 raft_consensus.cc:2749] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.315964 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:12.316588 13941 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.319591 14592 raft_consensus.cc:493] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
W20260709 13:04:12.320614 13833 leader_election.cc:336] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.318961 14627 leader_election.cc:290] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:12.320170 14592 raft_consensus.cc:515] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.326051 14592 leader_election.cc:290] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.326978 13941 raft_consensus.cc:2468] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 2.
I20260709 13:04:12.328212 13831 leader_election.cc:304] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.330719 14625 raft_consensus.cc:2804] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.331251 14625 raft_consensus.cc:697] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:12.332151 14625 consensus_queue.cc:237] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.334383 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:12.338927 14571 raft_consensus.cc:493] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
W20260709 13:04:12.339460 13907 leader_election.cc:336] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.339947 13907 leader_election.cc:304] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.339713 14571 raft_consensus.cc:515] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.341423 14592 raft_consensus.cc:2749] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.343003 14571 leader_election.cc:290] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.348882 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
W20260709 13:04:12.362468 13981 leader_election.cc:336] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.365960 14592 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.367076 14592 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.370527 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:12.371229 14014 raft_consensus.cc:2468] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:12.371994 14596 raft_consensus.cc:493] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.372602 14596 raft_consensus.cc:515] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.372794 14592 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.363180 13981 leader_election.cc:304] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.374244 14540 raft_consensus.cc:2749] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.376281 13906 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:12.378372 14591 raft_consensus.cc:2804] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.378818 14591 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.379333 14591 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.383937 14596 leader_election.cc:290] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.394891 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:12.395896 14010 raft_consensus.cc:2468] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:12.399184 14590 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:12.404357 13906 leader_election.cc:304] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:12.406183 14640 raft_consensus.cc:2804] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.406641 14640 raft_consensus.cc:493] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.407019 14640 raft_consensus.cc:3060] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.408514 14458 raft_consensus.cc:493] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
W20260709 13:04:12.408816 13907 leader_election.cc:336] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.409085 14458 raft_consensus.cc:515] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.411335 14458 leader_election.cc:290] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.413836 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:12.414618 14014 raft_consensus.cc:2468] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:12.418676 13832 leader_election.cc:304] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:12.419860 14627 raft_consensus.cc:2804] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.420320 14627 raft_consensus.cc:493] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.420699 14627 raft_consensus.cc:3060] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.420534 14592 raft_consensus.cc:493] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.419189 14639 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.422806 14639 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:12.424034 13833 leader_election.cc:336] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.421869 14592 raft_consensus.cc:515] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.407918 14590 tablet_bootstrap.cc:492] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:12.431206 14590 ts_tablet_manager.cc:1403] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.246s	user 0.036s	sys 0.032s
I20260709 13:04:12.403079 14596 raft_consensus.cc:493] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.451584 14596 raft_consensus.cc:515] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.452145 14540 raft_consensus.cc:493] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.452829 14540 raft_consensus.cc:515] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.453915 14446 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.454409 14446 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.457180 14590 raft_consensus.cc:359] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.458096 14590 raft_consensus.cc:740] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.460131 14590 consensus_queue.cc:260] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.462916 14446 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.468556 14590 ts_tablet_manager.cc:1434] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
W20260709 13:04:12.472218 13907 leader_election.cc:336] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.473943 14596 leader_election.cc:290] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
W20260709 13:04:12.477888 13907 leader_election.cc:336] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.491055 14446 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.491645 14446 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:12.492033 13906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 63599us
I20260709 13:04:12.493706 14446 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.498571 14640 raft_consensus.cc:515] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.502661 14640 leader_election.cc:290] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.503515 14590 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:12.506265 14540 leader_election.cc:290] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.509184 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:12.510847 14012 raft_consensus.cc:2468] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:12.512255 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b443c5191ca74bf1afcc265171e53dd8" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:12.513108 14015 raft_consensus.cc:3060] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.495857 14596 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.527845 13906 leader_election.cc:304] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.529193 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.530179 14650 raft_consensus.cc:2804] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.530680 14650 raft_consensus.cc:493] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.531072 14650 raft_consensus.cc:3060] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.531278 14015 raft_consensus.cc:2468] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:12.536424 14639 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.540310 14591 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.542912 14596 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.545116 14627 raft_consensus.cc:515] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.546335 13937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.547122 14627 leader_election.cc:290] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.547360 13937 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
I20260709 13:04:12.548456 13906 leader_election.cc:304] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:12.549292 14640 raft_consensus.cc:493] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.549832 14640 raft_consensus.cc:515] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.550753 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:12.551110 14646 raft_consensus.cc:2804] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.551441 14014 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:12.551676 14646 raft_consensus.cc:697] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:12.552773 14646 consensus_queue.cc:237] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.555415 14592 leader_election.cc:290] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:12.558106 13941 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
W20260709 13:04:12.558661 13981 leader_election.cc:336] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:12.559273 13981 leader_election.cc:336] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:12.559760 13981 leader_election.cc:336] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:12.560751 13907 leader_election.cc:336] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:12.561514 13907 leader_election.cc:336] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.562206 13906 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.562963 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:12.572610 13867 raft_consensus.cc:2468] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:12.573498 14592 raft_consensus.cc:2804] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.574030 14592 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.574424 14592 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.567030 14596 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
W20260709 13:04:12.575491 13833 leader_election.cc:336] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.553090 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8809c926517048778c24dfaab0d66305" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:12.566465 14591 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.579713 14014 raft_consensus.cc:3060] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.580909 13906 leader_election.cc:304] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:12.581166 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:12.582103 13941 raft_consensus.cc:2468] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 1.
W20260709 13:04:12.582093 13907 leader_election.cc:336] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.569985 13690 catalog_manager.cc:5697] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.585613 13690 catalog_manager.cc:5697] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.585441 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:12.587806 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:12.588001 14015 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.588454 14012 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:12.585913 14591 raft_consensus.cc:2804] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.590590 14640 leader_election.cc:290] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:12.590730 14591 raft_consensus.cc:493] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.591483 14591 raft_consensus.cc:3060] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.601691 13906 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
W20260709 13:04:12.602646 13907 leader_election.cc:336] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:12.613922 13907 leader_election.cc:336] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.604440 14014 raft_consensus.cc:2468] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 2.
I20260709 13:04:12.602180 14592 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.618741 13832 leader_election.cc:304] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.619474 14625 raft_consensus.cc:2804] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.604605 14650 raft_consensus.cc:515] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.620023 14625 raft_consensus.cc:697] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
W20260709 13:04:12.620826 13907 leader_election.cc:336] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.621152 14625 consensus_queue.cc:237] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.622213 14650 leader_election.cc:290] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.623589 14591 raft_consensus.cc:515] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:12.627568 14591 leader_election.cc:290] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:12.604839 14640 raft_consensus.cc:2804] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.629415 14592 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.607527 13687 catalog_manager.cc:5697] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.607892 14596 raft_consensus.cc:493] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.631393 14596 raft_consensus.cc:515] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.611474 14590 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:12.633834 14590 tablet_bootstrap.cc:492] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:12.634498 14590 ts_tablet_manager.cc:1403] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.003s
I20260709 13:04:12.611737 14627 raft_consensus.cc:493] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.635221 14627 raft_consensus.cc:515] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.630172 14640 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.638717 14640 raft_consensus.cc:3060] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.642762 14596 leader_election.cc:290] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.643622 14590 raft_consensus.cc:359] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.603406 13979 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.646235 14540 raft_consensus.cc:2804] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.646618 13979 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.646796 14540 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.647334 14540 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.647390 14571 raft_consensus.cc:2804] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.647735 13979 leader_election.cc:304] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.647850 14571 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.648360 14571 raft_consensus.cc:3060] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.607220 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:12.649196 13867 raft_consensus.cc:2468] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:12.650007 14647 raft_consensus.cc:2804] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.650455 14647 raft_consensus.cc:493] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.650807 14647 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.645004 14627 leader_election.cc:290] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.655297 14590 raft_consensus.cc:740] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.656371 14590 consensus_queue.cc:260] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.657428 14571 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.658794 14590 ts_tablet_manager.cc:1434] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:12.660077 14590 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
W20260709 13:04:12.629739 13907 leader_election.cc:336] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.660550 14571 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.613231 14015 raft_consensus.cc:2468] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:12.660805 13937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:12.664675 14647 raft_consensus.cc:515] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:12.667315 13907 leader_election.cc:336] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.667670 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:12.668243 13941 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.679020 13941 raft_consensus.cc:2468] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 2.
W20260709 13:04:12.679682 13907 leader_election.cc:336] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:12.680881 13907 leader_election.cc:336] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.687186 13979 leader_election.cc:304] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:12.688859 14571 raft_consensus.cc:2804] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.690912 14571 raft_consensus.cc:697] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:12.691916 14571 consensus_queue.cc:237] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.682683 14647 leader_election.cc:290] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.697086 13906 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.698974 14590 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:12.700058 14590 tablet_bootstrap.cc:492] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:12.700778 14590 ts_tablet_manager.cc:1403] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.012s
I20260709 13:04:12.701632 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:12.702328 14015 raft_consensus.cc:2468] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 1.
I20260709 13:04:12.707875 14590 raft_consensus.cc:359] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.708717 14590 raft_consensus.cc:740] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.709618 14590 consensus_queue.cc:260] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.711709 14590 ts_tablet_manager.cc:1434] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:04:12.712487 14590 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:12.713917 13936 raft_consensus.cc:1275] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.724594 14626 consensus_queue.cc:1048] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:12.743897 13687 catalog_manager.cc:5697] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 2 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.745505 14592 raft_consensus.cc:2804] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.746165 14592 raft_consensus.cc:697] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:12.747066 14592 consensus_queue.cc:237] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:12.757632 13906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 60628.5us
I20260709 13:04:12.759213 13906 leader_election.cc:304] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.760069 14592 raft_consensus.cc:2804] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.760547 14592 raft_consensus.cc:493] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.760973 14592 raft_consensus.cc:3060] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.760169 13690 catalog_manager.cc:5697] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.772356 14540 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.777311 13688 catalog_manager.cc:5697] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:12.787557 13981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:40245, user_credentials={real_user=slave}} blocked reactor thread for 54228us
I20260709 13:04:12.789767 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:12.790076 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:12.790784 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
W20260709 13:04:12.795406 13981 leader_election.cc:336] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.795519 14014 raft_consensus.cc:2468] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:12.799185 14012 raft_consensus.cc:2393] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 2: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:12.800537 14015 raft_consensus.cc:3060] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.801326 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:12.802575 13941 raft_consensus.cc:2393] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 2: Already voted for candidate 48967ca777ee43ebaddd57da674bd3e1 in this term.
I20260709 13:04:12.809643 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fa4d4f818b438ab5523c23fc40d3a4" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:12.810683 13867 raft_consensus.cc:3060] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:12.812230 13981 leader_election.cc:336] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.813737 14540 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.816075 13906 leader_election.cc:304] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.819571 14596 raft_consensus.cc:2804] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.820209 14596 raft_consensus.cc:493] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.821046 14596 raft_consensus.cc:3060] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.782330 13832 leader_election.cc:304] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
W20260709 13:04:12.827903 13832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 45706.1us
I20260709 13:04:12.828727 14625 raft_consensus.cc:2804] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:12.834564 14625 raft_consensus.cc:493] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:12.835189 14625 raft_consensus.cc:3060] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.820164 13906 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.791402 14640 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.852542 13867 raft_consensus.cc:2468] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:12.845180 14015 raft_consensus.cc:2468] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:12.868065 13906 leader_election.cc:304] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.850991 14591 raft_consensus.cc:2749] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.887562 14640 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.891631 14590 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:12.893239 14590 tablet_bootstrap.cc:492] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:12.894356 14590 ts_tablet_manager.cc:1403] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.182s	user 0.025s	sys 0.086s
I20260709 13:04:12.897253 14590 raft_consensus.cc:359] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.898111 14590 raft_consensus.cc:740] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:12.873917 14646 raft_consensus.cc:2804] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.900532 13937 raft_consensus.cc:2393] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26396ddd557646e98bdbd64eba197c05 in current term 2: Already voted for candidate 48967ca777ee43ebaddd57da674bd3e1 in this term.
I20260709 13:04:12.901067 14592 raft_consensus.cc:515] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:12.904614 13981 leader_election.cc:336] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.908248 13981 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.908648 14590 consensus_queue.cc:260] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:12.909894 14446 raft_consensus.cc:2749] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.916323 14590 ts_tablet_manager.cc:1434] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:04:12.922951 14590 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:12.917734 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:12.928812 14015 raft_consensus.cc:2393] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 48967ca777ee43ebaddd57da674bd3e1 in current term 2: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:12.935654 14592 leader_election.cc:290] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:12.943917 14596 raft_consensus.cc:515] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:12.920351 14646 raft_consensus.cc:697] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:12.948596 14646 consensus_queue.cc:237] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:12.950508 13907 leader_election.cc:336] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:12.951126 13907 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1; no voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.954717 13937 raft_consensus.cc:1275] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.958397 14639 raft_consensus.cc:2749] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.961604 13979 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:12.963551 14660 raft_consensus.cc:2749] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:12.971699 14015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86368c5ec644579a96e52be386c82f6" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:12.972383 14015 raft_consensus.cc:3060] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.963757 14596 leader_election.cc:290] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:12.974779 14458 consensus_queue.cc:1048] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:12.983738 13907 leader_election.cc:336] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:13.001078 14015 raft_consensus.cc:2468] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:13.005880 13936 raft_consensus.cc:1275] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:13.007066 13907 leader_election.cc:336] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:13.008422 14669 consensus_queue.cc:1048] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:13.009351 13906 leader_election.cc:304] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:13.009387 14625 raft_consensus.cc:515] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:13.011891 14592 raft_consensus.cc:2804] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.011911 14015 raft_consensus.cc:1275] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.014468 14596 consensus_queue.cc:1048] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.013154 14592 raft_consensus.cc:697] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:13.016839 14592 consensus_queue.cc:237] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.044148 13906 leader_election.cc:304] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:13.057627 14650 raft_consensus.cc:2804] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:13.069161 13907 consensus_peers.cc:597] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.090904 13687 catalog_manager.cc:5697] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.072872 14650 raft_consensus.cc:697] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:13.094632 14650 consensus_queue.cc:237] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:13.108439 14625 leader_election.cc:290] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:13.120819 13936 raft_consensus.cc:1275] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.121162 14590 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:13.123229 14590 tablet_bootstrap.cc:492] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:13.123773 14660 consensus_queue.cc:1048] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:13.124313 14590 ts_tablet_manager.cc:1403] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.202s	user 0.027s	sys 0.006s
I20260709 13:04:13.128329 14590 raft_consensus.cc:359] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.129437 14590 raft_consensus.cc:740] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.134696 14012 raft_consensus.cc:1275] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.136608 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "97c52f3e93434bedbdc9755e64f33d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:13.137404 14014 raft_consensus.cc:3060] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:13.147415 13981 consensus_peers.cc:597] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.151103 14458 consensus_queue.cc:1048] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:13.195878 14601 raft_consensus.cc:493] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.196417 14601 raft_consensus.cc:515] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.202668 14601 leader_election.cc:290] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:13.217485 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4207a5906547482096df3ec41328292e" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:13.218276 13867 raft_consensus.cc:3060] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.213045 13688 catalog_manager.cc:5697] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.221055 13688 catalog_manager.cc:5697] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.220885 14014 raft_consensus.cc:2468] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97c52f3e93434bedbdc9755e64f33d4f in term 2.
I20260709 13:04:13.227218 13867 raft_consensus.cc:2468] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
W20260709 13:04:13.232790 13833 consensus_peers.cc:597] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.131089 14590 consensus_queue.cc:260] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.239464 14011 raft_consensus.cc:1275] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:13.233583 13833 leader_election.cc:336] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:13.250090 13907 consensus_peers.cc:597] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.234599 13832 leader_election.cc:304] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:13.269032 14670 raft_consensus.cc:2804] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.269522 14670 raft_consensus.cc:697] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Leader. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:13.271596 14670 consensus_queue.cc:237] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:13.249096 14590 ts_tablet_manager.cc:1434] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 13:04:13.281576 14590 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:13.284999 13906 leader_election.cc:304] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:13.286762 14650 raft_consensus.cc:2804] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.287405 14650 raft_consensus.cc:697] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:13.288451 14650 consensus_queue.cc:237] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
W20260709 13:04:13.290360 13981 consensus_peers.cc:597] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.308313 13833 consensus_peers.cc:597] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.309103 13833 consensus_peers.cc:597] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.311546 14592 consensus_queue.cc:1048] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:13.322844 13907 consensus_peers.cc:597] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.309726 13833 leader_election.cc:336] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:13.328476 14601 raft_consensus.cc:493] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.329063 14601 raft_consensus.cc:515] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:13.335943 13833 consensus_peers.cc:597] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.343261 14601 leader_election.cc:290] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:13.343856 14601 raft_consensus.cc:493] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.344298 14601 raft_consensus.cc:515] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.360481 13687 catalog_manager.cc:5697] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.374213 14712 raft_consensus.cc:493] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.374861 14712 raft_consensus.cc:515] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:13.388675 13688 catalog_manager.cc:5697] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f reported cstate change: term changed from 1 to 2, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "97c52f3e93434bedbdc9755e64f33d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.391314 14714 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.399994 14601 leader_election.cc:290] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:13.402271 14601 raft_consensus.cc:493] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.402782 14601 raft_consensus.cc:515] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:13.404964 14601 leader_election.cc:290] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:13.405479 14601 raft_consensus.cc:493] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.407140 14712 leader_election.cc:290] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:13.391939 14714 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:13.410615 13833 consensus_peers.cc:597] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.413036 14714 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:13.422727 14601 raft_consensus.cc:515] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:13.462598 13981 consensus_peers.cc:597] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.462949 14010 raft_consensus.cc:1275] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:13.462984 13907 consensus_peers.cc:597] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.465831 14650 consensus_queue.cc:1048] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:13.479903 14601 leader_election.cc:290] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:13.486234 13936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:13.486522 14601 raft_consensus.cc:493] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.487188 14601 raft_consensus.cc:515] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:13.487936 13833 consensus_peers.cc:597] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.488083 13939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7f9c6781bb4725847b8d5169cd3c02" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:13.489215 14601 leader_election.cc:290] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:13.489893 13937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:13.491622 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:13.493467 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:13.494699 13935 raft_consensus.cc:2393] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 2: Already voted for candidate 48967ca777ee43ebaddd57da674bd3e1 in this term.
W20260709 13:04:13.523001 13981 consensus_peers.cc:597] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.525760 14601 raft_consensus.cc:493] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.526422 14601 raft_consensus.cc:515] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:13.528465 14601 leader_election.cc:290] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:13.536984 14601 raft_consensus.cc:493] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.537536 14601 raft_consensus.cc:515] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:13.539991 14601 leader_election.cc:290] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
W20260709 13:04:13.547556 13833 consensus_peers.cc:597] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.565953 13981 consensus_peers.cc:597] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.581285 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:13.591327 14014 raft_consensus.cc:1275] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:13.592674 13833 consensus_peers.cc:597] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.596442 14639 consensus_queue.cc:1048] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:13.593549 13907 consensus_peers.cc:597] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.601641 14601 raft_consensus.cc:493] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.602264 14601 raft_consensus.cc:515] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:13.603425 13907 consensus_peers.cc:597] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.605458 14601 leader_election.cc:290] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:13.607180 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:13.618222 14601 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.619227 14601 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.623235 14601 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:13.624107 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:13.627326 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:13.629712 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "045c882b5c9b44cb867d853eb82d3f86" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:13.632411 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:13.634763 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d165767a6eb84e0ab6e475cb48c542ae" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:13.637331 13833 consensus_peers.cc:597] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.638268 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f494f81f71485b85b9551431ff68d0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.641696 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:13.642117 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e88dc464675442b8c7152dbf45e7b8b" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:13.643131 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:13.648417 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c8aaedf9904579b4f3e13ba43661bc" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.650691 14014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7f9c6781bb4725847b8d5169cd3c02" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
W20260709 13:04:13.651221 13907 consensus_peers.cc:597] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.653764 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d165767a6eb84e0ab6e475cb48c542ae" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.656056 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e88dc464675442b8c7152dbf45e7b8b" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.658075 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bebeea22ca415e8b677798ee3cea04" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.624537 14590 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:13.660166 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.661134 14590 tablet_bootstrap.cc:492] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:13.662572 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.664568 14586 leader_election.cc:304] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:13.665475 14601 raft_consensus.cc:2749] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.660231 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.666599 14010 raft_consensus.cc:2393] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce171b1b0d7341f59e3ba532f7b51d1b in current term 2: Already voted for candidate 26396ddd557646e98bdbd64eba197c05 in this term.
I20260709 13:04:13.668324 14586 leader_election.cc:304] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:13.669266 14601 raft_consensus.cc:2749] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.671574 14586 leader_election.cc:304] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:13.672456 14601 raft_consensus.cc:2749] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:13.672488 13907 consensus_peers.cc:597] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.674804 14586 leader_election.cc:304] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:13.675189 14590 ts_tablet_manager.cc:1403] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.394s	user 0.030s	sys 0.019s
I20260709 13:04:13.675802 14601 raft_consensus.cc:2749] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.676972 14586 leader_election.cc:304] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:13.677670 14601 raft_consensus.cc:2749] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.679251 14586 leader_election.cc:304] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:13.680258 13867 raft_consensus.cc:1275] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.682742 14590 raft_consensus.cc:359] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.683619 14590 raft_consensus.cc:740] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
W20260709 13:04:13.690357 13907 consensus_peers.cc:597] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.691141 14590 consensus_queue.cc:260] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.692898 14601 raft_consensus.cc:2749] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.693212 14586 leader_election.cc:304] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:13.694473 14010 raft_consensus.cc:1275] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 97c52f3e93434bedbdc9755e64f33d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.694808 14586 leader_election.cc:304] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:13.695652 14717 raft_consensus.cc:2749] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.696053 14586 leader_election.cc:304] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:13.696247 14669 consensus_queue.cc:1048] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.697289 14586 leader_election.cc:304] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
W20260709 13:04:13.697521 13833 consensus_peers.cc:597] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.697714 14715 raft_consensus.cc:2749] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.698056 14714 raft_consensus.cc:2749] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.698585 14650 consensus_queue.cc:1048] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.699327 14586 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:13.700137 14715 raft_consensus.cc:2749] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.696260 14717 raft_consensus.cc:2749] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.701453 14586 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:13.703392 14717 raft_consensus.cc:493] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.703855 14717 raft_consensus.cc:515] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:13.706029 14715 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.706813 14590 ts_tablet_manager.cc:1434] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:04:13.707799 14590 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
W20260709 13:04:13.713627 13907 consensus_peers.cc:597] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.723359 13833 consensus_peers.cc:597] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.728127 14715 raft_consensus.cc:2749] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.729076 14717 leader_election.cc:290] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:13.731436 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83902dd19424f4d9f3707d53bafb0b5" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.735641 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83902dd19424f4d9f3707d53bafb0b5" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
W20260709 13:04:13.746639 13833 consensus_peers.cc:597] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.770264 13981 consensus_peers.cc:597] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.791476 13907 consensus_peers.cc:597] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.794186 13833 consensus_peers.cc:597] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.816747 13907 consensus_peers.cc:597] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.816864 13981 consensus_peers.cc:597] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.819832 14590 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:13.821058 14590 tablet_bootstrap.cc:492] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:13.762632 14586 leader_election.cc:304] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
W20260709 13:04:13.823626 14586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.196:37991, user_credentials={real_user=slave}} blocked reactor thread for 61106.4us
I20260709 13:04:13.824420 14717 raft_consensus.cc:2749] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.824513 14715 raft_consensus.cc:493] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.824385 14590 ts_tablet_manager.cc:1403] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.005s
I20260709 13:04:13.825356 14715 raft_consensus.cc:515] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:13.828210 14715 leader_election.cc:290] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
W20260709 13:04:13.828636 13833 consensus_peers.cc:597] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.828495 14590 raft_consensus.cc:359] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
W20260709 13:04:13.829205 13833 consensus_peers.cc:597] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.829401 14590 raft_consensus.cc:740] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.831943 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:13.834187 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ba395804274ae6b50899d3c4839734" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:13.836349 14586 leader_election.cc:304] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:13.837299 14715 raft_consensus.cc:2749] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:13.838721  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:40245
I20260709 13:04:13.838868 14740 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:40245 every 8 connection(s)
I20260709 13:04:13.838858 14590 consensus_queue.cc:260] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:13.841154 14590 ts_tablet_manager.cc:1434] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:04:13.842039 14590 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:13.860400 13867 raft_consensus.cc:1275] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.874713 14650 consensus_queue.cc:1048] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:13.903541 14697 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.923988 14590 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:13.931597 14590 tablet_bootstrap.cc:492] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:13.932390 14590 ts_tablet_manager.cc:1403] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.012s
I20260709 13:04:13.945425 14590 raft_consensus.cc:359] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
W20260709 13:04:13.959731 13833 consensus_peers.cc:597] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.946213 14590 raft_consensus.cc:740] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
W20260709 13:04:13.960988 13833 consensus_peers.cc:597] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.961251 14590 consensus_queue.cc:260] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:13.964519 14590 ts_tablet_manager.cc:1434] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:04:13.965373 14590 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:13.978083 14741 heartbeater.cc:344] Connected to a master server at 127.7.28.254:46727
I20260709 13:04:13.978607 14741 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:13.979410 14741 heartbeater.cc:507] Master 127.7.28.254:46727 requested a full tablet report, sending...
I20260709 13:04:13.991454 14590 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:13.992578 14590 tablet_bootstrap.cc:492] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:13.993343 14590 ts_tablet_manager.cc:1403] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:04:13.995190 14590 raft_consensus.cc:359] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:13.995724 14590 raft_consensus.cc:740] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.996286 13688 ts_manager.cc:194] Re-registered known tserver with Master: ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:13.996372 14590 consensus_queue.cc:260] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:13.998464 14590 ts_tablet_manager.cc:1434] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 13:04:14.002331 14590 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.014137 14715 raft_consensus.cc:493] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.014775 14715 raft_consensus.cc:515] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.016856 14715 leader_election.cc:290] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:14.019034 14590 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.019842 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:14.020093 14590 tablet_bootstrap.cc:492] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.020265 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:14.021095 14590 ts_tablet_manager.cc:1403] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:04:14.021731 14586 leader_election.cc:304] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:14.022555 14715 raft_consensus.cc:2749] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.023567 14590 raft_consensus.cc:359] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.024132 14590 raft_consensus.cc:740] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.024730 14590 consensus_queue.cc:260] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.026443 14590 ts_tablet_manager.cc:1434] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:04:14.027117 14590 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.039813 13688 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57758
I20260709 13:04:14.041395 14590 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.042457 14590 tablet_bootstrap.cc:492] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.043159 14590 ts_tablet_manager.cc:1403] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 13:04:14.045145 14741 heartbeater.cc:499] Master 127.7.28.254:46727 was elected leader, sending a full tablet report...
I20260709 13:04:14.045867 14590 raft_consensus.cc:359] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.046638 14590 raft_consensus.cc:740] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.047307 14590 consensus_queue.cc:260] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.048722 14715 raft_consensus.cc:493] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.049269 14590 ts_tablet_manager.cc:1434] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:14.049228 14715 raft_consensus.cc:515] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.050215 14590 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.051730 14715 leader_election.cc:290] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:14.055045 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c945695696fc4b6a9ad5becbe6a236a7" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:14.055255 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c945695696fc4b6a9ad5becbe6a236a7" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:14.057723 14586 leader_election.cc:304] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:14.058656 14715 raft_consensus.cc:2749] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.065851 14590 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.066653 14590 tablet_bootstrap.cc:492] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.067313 14590 ts_tablet_manager.cc:1403] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:04:14.069358 14590 raft_consensus.cc:359] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.069896 14590 raft_consensus.cc:740] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.070513 14590 consensus_queue.cc:260] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.072011 14590 ts_tablet_manager.cc:1434] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:14.072640 14590 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.084359 14590 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.085206 14590 tablet_bootstrap.cc:492] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.085857 14590 ts_tablet_manager.cc:1403] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:04:14.088284 14590 raft_consensus.cc:359] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.089052 14590 raft_consensus.cc:740] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.089885 14590 consensus_queue.cc:260] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.092080 14590 ts_tablet_manager.cc:1434] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:14.092902 14590 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.107810 14590 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.108814 14590 tablet_bootstrap.cc:492] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.109480 14590 ts_tablet_manager.cc:1403] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:04:14.112052 14590 raft_consensus.cc:359] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.112713 14590 raft_consensus.cc:740] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.113384 14590 consensus_queue.cc:260] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.115518 14590 ts_tablet_manager.cc:1434] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:14.116576 14590 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.130044 14590 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.131001 14590 tablet_bootstrap.cc:492] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.131249 14689 raft_consensus.cc:3060] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.131676 14590 ts_tablet_manager.cc:1403] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:04:14.134462 14590 raft_consensus.cc:359] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.135157 14590 raft_consensus.cc:740] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.135763 14590 consensus_queue.cc:260] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.138288 14590 ts_tablet_manager.cc:1434] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:14.139816 14590 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.161434 14590 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.162741 14590 tablet_bootstrap.cc:492] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.163507 14590 ts_tablet_manager.cc:1403] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:04:14.166078 14590 raft_consensus.cc:359] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.166782 14590 raft_consensus.cc:740] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.167610 14590 consensus_queue.cc:260] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.170502 14590 ts_tablet_manager.cc:1434] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:14.171306 14590 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.193619 14590 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.194660 14590 tablet_bootstrap.cc:492] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.195456 14590 ts_tablet_manager.cc:1403] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.005s
I20260709 13:04:14.198110 14590 raft_consensus.cc:359] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.198853 14590 raft_consensus.cc:740] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.199749 14590 consensus_queue.cc:260] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.201613 14590 ts_tablet_manager.cc:1434] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:04:14.202628 14590 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.217854 14590 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.218626 14590 tablet_bootstrap.cc:492] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.219214 14590 ts_tablet_manager.cc:1403] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:04:14.221844 14590 raft_consensus.cc:359] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.222473 14590 raft_consensus.cc:740] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.223142 14590 consensus_queue.cc:260] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.225009 14590 ts_tablet_manager.cc:1434] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:14.226347 14590 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.230335 14715 raft_consensus.cc:493] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.230962 14715 raft_consensus.cc:515] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.232100 14689 raft_consensus.cc:3060] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.237540 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e08736e8bdd4624ae337513bd3f8903" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f" is_pre_election: true
I20260709 13:04:14.237749 14697 raft_consensus.cc:3060] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.242877 13937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e08736e8bdd4624ae337513bd3f8903" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48967ca777ee43ebaddd57da674bd3e1" is_pre_election: true
I20260709 13:04:14.247604 14715 leader_election.cc:290] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:14.248821 14585 leader_election.cc:304] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f
I20260709 13:04:14.251698 14715 raft_consensus.cc:2749] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.291580 14590 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.292413 14590 tablet_bootstrap.cc:492] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.293123 14590 ts_tablet_manager.cc:1403] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.067s	user 0.031s	sys 0.032s
I20260709 13:04:14.295261 14590 raft_consensus.cc:359] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.296020 14590 raft_consensus.cc:740] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.296721 14590 consensus_queue.cc:260] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.299105 14590 ts_tablet_manager.cc:1434] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:14.299934 14590 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.308682 14698 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.321879 14590 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.322953 14590 tablet_bootstrap.cc:492] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.323710 14590 ts_tablet_manager.cc:1403] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.001s
I20260709 13:04:14.326957 14590 raft_consensus.cc:359] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.327680 14590 raft_consensus.cc:740] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.328428 14590 consensus_queue.cc:260] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.330660 14590 ts_tablet_manager.cc:1434] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:14.335541 14590 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.348824 14590 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.349977 14590 tablet_bootstrap.cc:492] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.350574 14590 ts_tablet_manager.cc:1403] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:04:14.352828 14590 raft_consensus.cc:359] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.353440 14590 raft_consensus.cc:740] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.354038 14590 consensus_queue.cc:260] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.356127 14590 ts_tablet_manager.cc:1434] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:14.357477 14590 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.384424 14590 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.385253 14590 tablet_bootstrap.cc:492] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.386031 14590 ts_tablet_manager.cc:1403] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.014s
I20260709 13:04:14.388182 14590 raft_consensus.cc:359] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.388739 14590 raft_consensus.cc:740] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.389379 14590 consensus_queue.cc:260] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.391177 14590 ts_tablet_manager.cc:1434] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:14.392414 14590 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.398605 14698 raft_consensus.cc:3060] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.413324 14590 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.414507 14590 tablet_bootstrap.cc:492] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.415180 14590 ts_tablet_manager.cc:1403] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:04:14.417681 14590 raft_consensus.cc:359] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.419919 14590 raft_consensus.cc:740] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.420693 14590 consensus_queue.cc:260] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.422778 14590 ts_tablet_manager.cc:1434] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:14.423684 14590 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.462216 14590 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.463379 14590 tablet_bootstrap.cc:492] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.464152 14590 ts_tablet_manager.cc:1403] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.011s
I20260709 13:04:14.466640 14590 raft_consensus.cc:359] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.467336 14590 raft_consensus.cc:740] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.467970 14590 consensus_queue.cc:260] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.469642 14590 ts_tablet_manager.cc:1434] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:04:14.474056 14590 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.479661 14698 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.517202 14590 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:14.517266 13831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:39185, user_credentials={real_user=slave}} blocked reactor thread for 46179.5us
I20260709 13:04:14.518505 14590 tablet_bootstrap.cc:492] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.519232 14590 ts_tablet_manager.cc:1403] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.019s
I20260709 13:04:14.521908 14590 raft_consensus.cc:359] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.522835 14590 raft_consensus.cc:740] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.523658 14590 consensus_queue.cc:260] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:14.525710 14590 ts_tablet_manager.cc:1434] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:14.526578 14590 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.540335 14590 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.541162 14590 tablet_bootstrap.cc:492] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.541860 14590 ts_tablet_manager.cc:1403] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:04:14.543730 14590 raft_consensus.cc:359] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.544332 14590 raft_consensus.cc:740] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.544984 14590 consensus_queue.cc:260] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.547101 14590 ts_tablet_manager.cc:1434] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:14.548202 14590 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.562656 14590 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.564105 14590 tablet_bootstrap.cc:492] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.564834 14590 ts_tablet_manager.cc:1403] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:04:14.567299 14590 raft_consensus.cc:359] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.567921 14590 raft_consensus.cc:740] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.568540 14590 consensus_queue.cc:260] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.570493 14590 ts_tablet_manager.cc:1434] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:04:14.571276 14590 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.590101 14590 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.590909 14590 tablet_bootstrap.cc:492] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.591552 14590 ts_tablet_manager.cc:1403] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:04:14.593449 14590 raft_consensus.cc:359] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.594098 14590 raft_consensus.cc:740] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.594764 14590 consensus_queue.cc:260] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.596783 14590 ts_tablet_manager.cc:1434] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:14.597615 14590 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.604890 14689 raft_consensus.cc:3060] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.613379 14590 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.614466 14590 tablet_bootstrap.cc:492] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.615170 14590 ts_tablet_manager.cc:1403] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:04:14.617658 14590 raft_consensus.cc:359] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.618366 14590 raft_consensus.cc:740] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.619033 14590 consensus_queue.cc:260] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.621520 14590 ts_tablet_manager.cc:1434] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:14.622730 14590 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.640550 14590 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.641534 14590 tablet_bootstrap.cc:492] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.642253 14590 ts_tablet_manager.cc:1403] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:04:14.644876 14590 raft_consensus.cc:359] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.645625 14590 raft_consensus.cc:740] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.646340 14590 consensus_queue.cc:260] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.649633 14590 ts_tablet_manager.cc:1434] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:14.651003 14590 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.665934 14689 raft_consensus.cc:3060] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.688697 14697 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.694221 14646 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.695070 14646 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.698423 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:14.699126 14010 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:14.701152 13906 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:14.702106 14592 raft_consensus.cc:2804] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:14.702515 14592 raft_consensus.cc:493] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.702884 14592 raft_consensus.cc:3060] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.710641 14592 raft_consensus.cc:515] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.715201 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:14.715857 14010 raft_consensus.cc:3060] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.719264 14590 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.720289 14590 tablet_bootstrap.cc:492] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.720942 14590 ts_tablet_manager.cc:1403] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.028s
I20260709 13:04:14.721738 14646 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:14.724851 14590 raft_consensus.cc:359] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.725612 14590 raft_consensus.cc:740] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.726393 14590 consensus_queue.cc:260] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.728221 14698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:14.728639 14590 ts_tablet_manager.cc:1434] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:14.728967 14698 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 1.
I20260709 13:04:14.730077 14590 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap starting.
I20260709 13:04:14.734799 14010 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 3.
I20260709 13:04:14.753379 13906 leader_election.cc:304] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:14.754251 14650 raft_consensus.cc:2804] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:14.754763 14650 raft_consensus.cc:697] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:14.755610 14650 consensus_queue.cc:237] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.757694 14592 leader_election.cc:290] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:14.761839 14590 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.764351 14590 tablet_bootstrap.cc:492] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Bootstrap complete.
I20260709 13:04:14.765108 14590 ts_tablet_manager.cc:1403] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.000s
I20260709 13:04:14.767835 14590 raft_consensus.cc:359] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.768630 14590 raft_consensus.cc:740] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.769310 14590 consensus_queue.cc:260] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:14.772440 14590 ts_tablet_manager.cc:1434] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:14.778122 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d02328b2b94a7092dbb3d0645862c0" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:14.779851 14689 raft_consensus.cc:3060] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.830211 14689 raft_consensus.cc:2468] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 3.
W20260709 13:04:14.830797 13980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:37379, user_credentials={real_user=slave}} blocked reactor thread for 70141.4us
I20260709 13:04:14.841444 13687 catalog_manager.cc:5697] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 3, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.861486 14698 raft_consensus.cc:3060] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.961369 14646 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.961942 14646 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.965283 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05" is_pre_election: true
I20260709 13:04:14.965831 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" is_pre_election: true
I20260709 13:04:14.966569 14689 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:14.966121 14012 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:14.966202 14698 raft_consensus.cc:3060] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.967895 13907 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:14.968832 14790 raft_consensus.cc:2804] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:14.969188 14790 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.969537 14790 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.969211 14646 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:14.978094 14790 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:14.981314 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:14.981999 14012 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.982650 14697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
I20260709 13:04:14.983258 14790 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:14.983326 14697 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.989465 14012 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 3.
I20260709 13:04:14.989538 14697 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 3.
I20260709 13:04:14.990960 13906 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:14.992224 14790 raft_consensus.cc:2804] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:14.992998 14790 raft_consensus.cc:697] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:14.993894 14790 consensus_queue.cc:237] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:15.005448 13687 catalog_manager.cc:5697] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 3, leader changed from ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.165186 14012 raft_consensus.cc:1275] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:15.166625 14790 consensus_queue.cc:1048] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.180799 14697 raft_consensus.cc:1275] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:15.182446 14650 consensus_queue.cc:1048] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.455937 14698 raft_consensus.cc:1275] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:15.457350 14650 consensus_queue.cc:1048] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.469655 14012 raft_consensus.cc:1275] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:15.471244 14592 consensus_queue.cc:1048] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:23.887369  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:23.938222 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:23.938962 13865 raft_consensus.cc:606] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:23.952366 13935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05"
dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:37228
I20260709 13:04:23.952921 13935 raft_consensus.cc:606] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:23.955924 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84199221e2c348f0a790594df18c571e"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "26396ddd557646e98bdbd64eba197c05"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:23.956519 13865 raft_consensus.cc:606] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:23.959324 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:23.959865 13865 raft_consensus.cc:606] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:23.962317 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:23.962945 13865 raft_consensus.cc:606] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:23.963948  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:23.965637  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:24.000464 14824 raft_consensus.cc:993] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower 26396ddd557646e98bdbd64eba197c05 to start an election
I20260709 13:04:24.001142 14826 raft_consensus.cc:1081] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer 26396ddd557646e98bdbd64eba197c05 to start an election
I20260709 13:04:24.002978 14010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84199221e2c348f0a790594df18c571e"
dest_uuid: "26396ddd557646e98bdbd64eba197c05"
 from {username='slave'} at 127.0.0.1:46828
I20260709 13:04:24.003494 14010 raft_consensus.cc:493] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.003813 14010 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.010532 14010 raft_consensus.cc:515] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:24.014199 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84199221e2c348f0a790594df18c571e" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:24.014956 13935 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.014956 14010 leader_election.cc:290] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:24.013705 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84199221e2c348f0a790594df18c571e" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:24.016018 13865 raft_consensus.cc:3055] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.016623 13865 raft_consensus.cc:740] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:24.018572 13865 consensus_queue.cc:260] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:24.020049 13865 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.021431 14824 raft_consensus.cc:993] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:24.021951 14824 raft_consensus.cc:1081] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:24.023466 13935 raft_consensus.cc:2468] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 2.
I20260709 13:04:24.024257 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:24.024830 14689 raft_consensus.cc:493] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.024873 13979 leader_election.cc:304] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:24.025210 14689 raft_consensus.cc:3060] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.025957 14819 raft_consensus.cc:2804] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.026399 14819 raft_consensus.cc:697] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:24.027313 14819 consensus_queue.cc:237] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:24.030179 13865 raft_consensus.cc:2468] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 2.
I20260709 13:04:24.033470 14689 raft_consensus.cc:515] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:24.035310 14689 leader_election.cc:290] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:24.036451 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:24.036806 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27502a3045c14fbdaebb0312b250740e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:24.037113 13865 raft_consensus.cc:3055] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.037380 13935 raft_consensus.cc:3060] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.037434 13865 raft_consensus.cc:740] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:24.038447 13865 consensus_queue.cc:260] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:24.039716 13865 raft_consensus.cc:3060] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.041420 13688 catalog_manager.cc:5697] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 2 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.044713 13935 raft_consensus.cc:2468] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:24.047076 14585 leader_election.cc:304] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:24.049748 13865 raft_consensus.cc:2468] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:24.057967 14832 raft_consensus.cc:2804] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.062012 14832 raft_consensus.cc:697] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:24.063987 14832 consensus_queue.cc:237] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:24.075143 13688 catalog_manager.cc:5697] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 2 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.149107 14826 raft_consensus.cc:993] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:24.149767 14812 raft_consensus.cc:1081] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:24.151443 14697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:24.151939 14697 raft_consensus.cc:493] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.152248 14697 raft_consensus.cc:3060] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.160008 14697 raft_consensus.cc:515] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:24.162070 14697 leader_election.cc:290] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:24.162815 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:24.166116 13935 raft_consensus.cc:3060] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.163630 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983190c267f247bd8c93a67faff1a4f3" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:24.167029 13865 raft_consensus.cc:3055] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.167528 13865 raft_consensus.cc:740] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:24.168752 13865 consensus_queue.cc:260] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:24.170727 13865 raft_consensus.cc:3060] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.173545 13935 raft_consensus.cc:2468] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:24.174610 14585 leader_election.cc:304] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:24.175508 14832 raft_consensus.cc:2804] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.175969 14832 raft_consensus.cc:697] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:24.176816 14832 consensus_queue.cc:237] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:24.182219 13865 raft_consensus.cc:2468] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:24.187846 13688 catalog_manager.cc:5697] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 2 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.243907 14809 raft_consensus.cc:993] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:24.244488 14820 raft_consensus.cc:1081] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:24.246155 14697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33674
I20260709 13:04:24.246667 14697 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.246958 14697 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.253044 14697 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:24.254786 14697 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:24.255484 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:24.255914 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31306f2bb4a647168863d2675faf7f05" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:24.256174 13935 raft_consensus.cc:3055] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:24.256531 13935 raft_consensus.cc:740] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:24.256548 14010 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.257332 13935 consensus_queue.cc:260] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:24.258611 13935 raft_consensus.cc:3060] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.263710 14010 raft_consensus.cc:2468] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:24.265228 14586 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:24.266004 14832 raft_consensus.cc:2804] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:24.266525 14832 raft_consensus.cc:697] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:24.267447 14832 consensus_queue.cc:237] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:24.268601 13935 raft_consensus.cc:2468] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:24.279011 13688 catalog_manager.cc:5697] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 2 to 3, leader changed from 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 3 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.347232 14826 raft_consensus.cc:993] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:24.347733 14826 raft_consensus.cc:1081] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:24.349267 14697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:24.349766 14697 raft_consensus.cc:493] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.350085 14697 raft_consensus.cc:3060] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.355232 14697 raft_consensus.cc:515] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:24.356871 14697 leader_election.cc:290] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:24.358381 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:24.359001 13865 raft_consensus.cc:3055] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.359304 13865 raft_consensus.cc:740] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:24.359391 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ea2a360d5a4c0b86b352b5c79e3756" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:24.360061 13935 raft_consensus.cc:3060] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.360321 13865 consensus_queue.cc:260] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:24.361299 13865 raft_consensus.cc:3060] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.366304 13935 raft_consensus.cc:2468] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:24.367003 13865 raft_consensus.cc:2468] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:24.367478 14585 leader_election.cc:304] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:24.368278 14832 raft_consensus.cc:2804] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.368777 14832 raft_consensus.cc:697] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:24.369741 14832 consensus_queue.cc:237] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:24.379124 13688 catalog_manager.cc:5697] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 2 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.461180 13865 raft_consensus.cc:1275] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.462556 14832 consensus_queue.cc:1048] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:24.465380 13935 raft_consensus.cc:1275] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.467828 14825 consensus_queue.cc:1048] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.468317 13941 raft_consensus.cc:1275] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.469806 14832 consensus_queue.cc:1048] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:24.584136 13867 raft_consensus.cc:1275] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.586095 14849 consensus_queue.cc:1048] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:24.596603 13867 raft_consensus.cc:1275] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.598336 14834 consensus_queue.cc:1048] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:24.609411 13937 raft_consensus.cc:1275] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.610986 14832 consensus_queue.cc:1048] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.759910 14010 raft_consensus.cc:1275] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:24.760973 14832 consensus_queue.cc:1048] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:24.770366 13937 raft_consensus.cc:1275] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:24.772185 14834 consensus_queue.cc:1048] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:24.791363 13935 raft_consensus.cc:1275] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.792961 14834 consensus_queue.cc:1048] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.809675 13867 raft_consensus.cc:1275] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.812206 14832 consensus_queue.cc:1048] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.966591  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:25.004006  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:25.042984 13867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "26396ddd557646e98bdbd64eba197c05"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:25.043649 13867 raft_consensus.cc:606] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:25.056293 14012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84199221e2c348f0a790594df18c571e"
dest_uuid: "26396ddd557646e98bdbd64eba197c05"
mode: GRACEFUL
new_leader_uuid: "48967ca777ee43ebaddd57da674bd3e1"
 from {username='slave'} at 127.0.0.1:50570
I20260709 13:04:25.056818 14012 raft_consensus.cc:606] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Received request to transfer leadership to TS 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:25.059176 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:25.059641 13865 raft_consensus.cc:606] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:25.061777 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:25.062402 13865 raft_consensus.cc:606] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:25.065429 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:25.065981 13865 raft_consensus.cc:606] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:25.067801  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:25.069341  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:25.143730 14848 raft_consensus.cc:993] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05: : Instructing follower 48967ca777ee43ebaddd57da674bd3e1 to start an election
I20260709 13:04:25.144359 14825 raft_consensus.cc:1081] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Signalling peer 48967ca777ee43ebaddd57da674bd3e1 to start an election
I20260709 13:04:25.146099 13935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84199221e2c348f0a790594df18c571e"
dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
 from {username='slave'} at 127.0.0.1:57252
I20260709 13:04:25.146799 13935 raft_consensus.cc:493] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.147253 13935 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.151913 13935 raft_consensus.cc:515] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:25.153609 13935 leader_election.cc:290] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:25.154438 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84199221e2c348f0a790594df18c571e" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:25.154742 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84199221e2c348f0a790594df18c571e" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:25.154984 13865 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.155339 14012 raft_consensus.cc:3055] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:25.155645 14012 raft_consensus.cc:740] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:25.156217 14012 consensus_queue.cc:260] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:25.157326 14012 raft_consensus.cc:3060] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.160356 13865 raft_consensus.cc:2468] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 3.
I20260709 13:04:25.161487 13906 leader_election.cc:304] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:25.162211 14809 raft_consensus.cc:2804] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:25.162497 14012 raft_consensus.cc:2468] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 3.
I20260709 13:04:25.162617 14809 raft_consensus.cc:697] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:25.163668 14809 consensus_queue.cc:237] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:25.172300 13690 catalog_manager.cc:5697] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 2 to 3, leader changed from 26396ddd557646e98bdbd64eba197c05 (127.7.28.196) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.181042 14812 raft_consensus.cc:993] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:25.181509 14812 raft_consensus.cc:1081] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:25.182987 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:25.183521 14689 raft_consensus.cc:493] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.183835 14689 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.189218 14689 raft_consensus.cc:515] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:25.191151 14689 leader_election.cc:290] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:25.191629 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:25.192099 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9da06c8013b34581b8df0cae992146fd" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:25.192246 14012 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.192672 13865 raft_consensus.cc:3055] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:25.192982 13865 raft_consensus.cc:740] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:25.193496 13865 consensus_queue.cc:260] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:25.194439 13865 raft_consensus.cc:3060] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:25.198504 14012 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:25.199496 14586 leader_election.cc:304] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:25.199667 13865 raft_consensus.cc:2468] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:25.200313 14832 raft_consensus.cc:2804] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:25.200809 14832 raft_consensus.cc:697] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:25.201545 14832 consensus_queue.cc:237] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:25.212163 13690 catalog_manager.cc:5697] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 2 to 3, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 3 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.440276 14826 raft_consensus.cc:993] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:25.440780 14812 raft_consensus.cc:1081] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:25.442203 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:25.442657 14689 raft_consensus.cc:493] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.442965 14689 raft_consensus.cc:3060] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.449249 14689 raft_consensus.cc:515] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:25.450958 14689 leader_election.cc:290] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:25.451902 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:25.452268 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e974506c09fa4bc481abf11343fdbf3e" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:25.452543 13865 raft_consensus.cc:3055] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.452844 14012 raft_consensus.cc:3060] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.452872 13865 raft_consensus.cc:740] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:25.454919 13865 consensus_queue.cc:260] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:25.456624 13865 raft_consensus.cc:3060] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.459455 14012 raft_consensus.cc:2468] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:25.461053 14586 leader_election.cc:304] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:25.461972 14853 raft_consensus.cc:2804] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.462426 14853 raft_consensus.cc:697] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:25.462610 14865 raft_consensus.cc:993] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:25.463137 14826 raft_consensus.cc:1081] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:25.463303 14853 consensus_queue.cc:237] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:25.465335 14698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:25.465960 14698 raft_consensus.cc:493] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.466328 14698 raft_consensus.cc:3060] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.467135 13865 raft_consensus.cc:2468] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:25.474095 14698 raft_consensus.cc:515] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:25.475898 14698 leader_election.cc:290] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:25.476647 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:25.476280 13690 catalog_manager.cc:5697] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 2 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.477025 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be03c00128f434fa58d0cc4ac20c104" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:25.477537 13865 raft_consensus.cc:3055] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.477692 13941 raft_consensus.cc:3060] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.477898 13865 raft_consensus.cc:740] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:25.478884 13865 consensus_queue.cc:260] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:25.480020 13865 raft_consensus.cc:3060] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.489329 13865 raft_consensus.cc:2468] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:25.490595 14586 leader_election.cc:304] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:25.491477 14853 raft_consensus.cc:2804] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.493062 13941 raft_consensus.cc:2468] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:25.494221 14853 raft_consensus.cc:697] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:25.495419 14853 consensus_queue.cc:237] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:25.509105 14812 raft_consensus.cc:993] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower 26396ddd557646e98bdbd64eba197c05 to start an election
I20260709 13:04:25.509685 14812 raft_consensus.cc:1081] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer 26396ddd557646e98bdbd64eba197c05 to start an election
I20260709 13:04:25.512830 14012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82"
dest_uuid: "26396ddd557646e98bdbd64eba197c05"
 from {username='slave'} at 127.0.0.1:46828
I20260709 13:04:25.513741 14012 raft_consensus.cc:493] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.514314 14012 raft_consensus.cc:3060] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.523034 14012 raft_consensus.cc:515] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:25.525664 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:25.526312 13867 raft_consensus.cc:3055] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.526628 13867 raft_consensus.cc:740] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:25.527432 13867 consensus_queue.cc:260] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:25.527697 13690 catalog_manager.cc:5697] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 2 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.528554 13867 raft_consensus.cc:3060] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.536170 13867 raft_consensus.cc:2468] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 2.
I20260709 13:04:25.539646 13980 leader_election.cc:304] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:25.540563 14825 raft_consensus.cc:2804] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.540661 14012 leader_election.cc:290] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 2 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:25.541102 14825 raft_consensus.cc:697] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:25.542387 14825 consensus_queue.cc:237] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:25.544307 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7704202b34ee8a6faee074094ba82" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:25.544888 13941 raft_consensus.cc:3060] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.551641 13941 raft_consensus.cc:2468] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 2.
I20260709 13:04:25.560485 13690 catalog_manager.cc:5697] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 2 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.614539 13867 raft_consensus.cc:1275] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.615903 14820 consensus_queue.cc:1048] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.632572 14012 raft_consensus.cc:1275] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.634532 14820 consensus_queue.cc:1048] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.750129 14010 raft_consensus.cc:1275] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:25.751392 14853 consensus_queue.cc:1048] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.767766 13865 raft_consensus.cc:1275] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:25.769922 14853 consensus_queue.cc:1048] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.879513 13941 raft_consensus.cc:1275] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.880854 14877 consensus_queue.cc:1048] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.891098 13865 raft_consensus.cc:1275] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.892895 14832 consensus_queue.cc:1048] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.942998 13867 raft_consensus.cc:1275] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.944283 14848 consensus_queue.cc:1048] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.953116 13941 raft_consensus.cc:1275] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.955155 14848 consensus_queue.cc:1048] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.009414 14012 raft_consensus.cc:1275] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.010748 14877 consensus_queue.cc:1048] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.027033 13867 raft_consensus.cc:1275] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.029072 14834 consensus_queue.cc:1048] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.070222  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:26.118170  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:26.167351 14012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1"
dest_uuid: "26396ddd557646e98bdbd64eba197c05"
mode: GRACEFUL
new_leader_uuid: "48967ca777ee43ebaddd57da674bd3e1"
 from {username='slave'} at 127.0.0.1:50570
I20260709 13:04:26.167888 14012 raft_consensus.cc:606] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Received request to transfer leadership to TS 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:26.170682 13941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346"
dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:37228
I20260709 13:04:26.171310 13941 raft_consensus.cc:606] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:26.173954 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80485db7c3b94a4db01541f0e19253f4"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:26.174484 13865 raft_consensus.cc:606] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:26.176888 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "26396ddd557646e98bdbd64eba197c05"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:26.177511 13865 raft_consensus.cc:606] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Received request to transfer leadership to TS 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:26.180006 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1adcb00abdc43c4a025388310386956"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:26.180706 13865 raft_consensus.cc:606] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:26.181833  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:26.183550  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:26.237905 14826 raft_consensus.cc:993] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:26.238448 14865 raft_consensus.cc:1081] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:26.240216 14698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1adcb00abdc43c4a025388310386956"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:26.240725 14698 raft_consensus.cc:493] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.241077 14698 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.247424 14698 raft_consensus.cc:515] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:26.249866 14698 leader_election.cc:290] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:26.250064 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:26.250429 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1adcb00abdc43c4a025388310386956" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:26.251875 13865 raft_consensus.cc:3055] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:26.251935 13941 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.252242 13865 raft_consensus.cc:740] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:26.253670 13865 consensus_queue.cc:260] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:26.254747 13865 raft_consensus.cc:3060] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.257506 13941 raft_consensus.cc:2468] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:26.258615 14585 leader_election.cc:304] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:26.259464 14832 raft_consensus.cc:2804] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:26.259948 13865 raft_consensus.cc:2468] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:26.259958 14832 raft_consensus.cc:697] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:26.261142 14832 consensus_queue.cc:237] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:26.271133 13687 catalog_manager.cc:5697] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 2 to 3, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 3 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.301896 14826 raft_consensus.cc:993] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:26.302385 14826 raft_consensus.cc:1081] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:26.303889 14698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80485db7c3b94a4db01541f0e19253f4"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:26.304420 14698 raft_consensus.cc:493] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.304728 14698 raft_consensus.cc:3060] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.310948 14698 raft_consensus.cc:515] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:26.313205 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80485db7c3b94a4db01541f0e19253f4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:26.313778 14012 raft_consensus.cc:3060] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.313923 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80485db7c3b94a4db01541f0e19253f4" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:26.314443 13865 raft_consensus.cc:3055] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:26.314625 13865 raft_consensus.cc:740] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:26.315138 13865 consensus_queue.cc:260] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:26.315814 13865 raft_consensus.cc:3060] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.316751 14698 leader_election.cc:290] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:26.318878 14012 raft_consensus.cc:2468] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:26.319890 14586 leader_election.cc:304] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:26.320806 14832 raft_consensus.cc:2804] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.321295 14832 raft_consensus.cc:697] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:26.322013 13865 raft_consensus.cc:2468] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:26.322160 14832 consensus_queue.cc:237] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:26.333705 13687 catalog_manager.cc:5697] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 2 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.378774 14874 raft_consensus.cc:993] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05: : Instructing follower 48967ca777ee43ebaddd57da674bd3e1 to start an election
I20260709 13:04:26.379361 14874 raft_consensus.cc:1081] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Signalling peer 48967ca777ee43ebaddd57da674bd3e1 to start an election
I20260709 13:04:26.381103 13941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1"
dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
 from {username='slave'} at 127.0.0.1:57252
I20260709 13:04:26.381661 13941 raft_consensus.cc:493] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.382047 13941 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.390642 13941 raft_consensus.cc:515] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:26.392791 13941 leader_election.cc:290] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:26.394054 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:26.394690 13867 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.395027 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:26.395646 14010 raft_consensus.cc:3055] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:26.395958 14010 raft_consensus.cc:740] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:26.396714 14010 consensus_queue.cc:260] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:26.398036 14010 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.402074 13867 raft_consensus.cc:2468] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:26.403666 13906 leader_election.cc:304] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:26.404479 14820 raft_consensus.cc:2804] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.404942 14820 raft_consensus.cc:697] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:26.404994 14010 raft_consensus.cc:2468] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 2.
I20260709 13:04:26.405719 14820 consensus_queue.cc:237] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:26.415110 13690 catalog_manager.cc:5697] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 1 to 2, leader changed from 26396ddd557646e98bdbd64eba197c05 (127.7.28.196) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.544411 14865 raft_consensus.cc:993] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower 26396ddd557646e98bdbd64eba197c05 to start an election
I20260709 13:04:26.544919 14826 raft_consensus.cc:1081] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Signalling peer 26396ddd557646e98bdbd64eba197c05 to start an election
I20260709 13:04:26.546535 14010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5"
dest_uuid: "26396ddd557646e98bdbd64eba197c05"
 from {username='slave'} at 127.0.0.1:46828
I20260709 13:04:26.547431 14010 raft_consensus.cc:493] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.547782 14010 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.552865 14010 raft_consensus.cc:515] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:26.554607 14010 leader_election.cc:290] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 3 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:26.555505 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:26.555753 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:26.556144 13867 raft_consensus.cc:3055] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:26.556615 13867 raft_consensus.cc:740] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:26.556263 13941 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.557605 13867 consensus_queue.cc:260] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:26.560725 13867 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:26.564409 13941 raft_consensus.cc:2468] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 3.
I20260709 13:04:26.565647 13979 leader_election.cc:304] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 48967ca777ee43ebaddd57da674bd3e1; no voters: 
I20260709 13:04:26.566748 14825 raft_consensus.cc:2804] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:26.567225 14825 raft_consensus.cc:697] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 3 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:26.568082 14825 consensus_queue.cc:237] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:26.570462 13867 raft_consensus.cc:2468] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 3.
I20260709 13:04:26.591503 13690 catalog_manager.cc:5697] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 2 to 3, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 3 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.696482 14809 raft_consensus.cc:993] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:26.696939 14820 raft_consensus.cc:1081] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:26.698599 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33674
I20260709 13:04:26.699168 14689 raft_consensus.cc:493] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.699455 14689 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:26.704623 14689 raft_consensus.cc:515] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:26.709990 14689 leader_election.cc:290] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 4 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:26.710134 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:26.710825 13941 raft_consensus.cc:3055] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:26.710963 14012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244ea1e7aee643d2b606db7cd01d5346" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:26.711421 13941 raft_consensus.cc:740] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:26.711601 14012 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:26.712365 13941 consensus_queue.cc:260] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:26.713399 13941 raft_consensus.cc:3060] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:26.717772 14012 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 4.
I20260709 13:04:26.718549 13865 raft_consensus.cc:1275] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.720747 14586 leader_election.cc:304] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:26.720587 14853 consensus_queue.cc:1048] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.721560 14832 raft_consensus.cc:2804] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:26.722072 14832 raft_consensus.cc:697] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 4 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:26.723039 14832 consensus_queue.cc:237] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:26.724138 13941 raft_consensus.cc:2468] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 4.
I20260709 13:04:26.748167 14012 raft_consensus.cc:1275] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.748461 13941 raft_consensus.cc:1275] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:26.750154 14832 consensus_queue.cc:1048] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.749958 14853 consensus_queue.cc:1048] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.771481 13690 catalog_manager.cc:5697] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 3 to 4, leader changed from 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 4 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:26.794119 13867 raft_consensus.cc:1275] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:26.807164 14853 consensus_queue.cc:1048] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:04:26.887876 13867 raft_consensus.cc:1275] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.889341 14902 consensus_queue.cc:1048] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.899174 14012 raft_consensus.cc:1275] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.900671 14809 consensus_queue.cc:1048] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.969589 13867 raft_consensus.cc:1275] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:26.971277 14825 consensus_queue.cc:1048] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:26.980837 13935 raft_consensus.cc:1275] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:26.982728 14895 consensus_queue.cc:1048] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:27.184466  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.214613 14010 raft_consensus.cc:1275] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 4 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:27.215996 14898 consensus_queue.cc:1048] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.232833 13935 raft_consensus.cc:1275] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:27.234700 14834 consensus_queue.cc:1048] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.248265  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.295274 13941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1"
dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
mode: GRACEFUL
new_leader_uuid: "26396ddd557646e98bdbd64eba197c05"
 from {username='slave'} at 127.0.0.1:37228
I20260709 13:04:27.295918 13941 raft_consensus.cc:606] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Received request to transfer leadership to TS 26396ddd557646e98bdbd64eba197c05
I20260709 13:04:27.299245 13867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f75e791139c44b88609259665a1315b"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:27.299779 13867 raft_consensus.cc:606] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:27.302340 14010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5"
dest_uuid: "26396ddd557646e98bdbd64eba197c05"
mode: GRACEFUL
new_leader_uuid: "48967ca777ee43ebaddd57da674bd3e1"
 from {username='slave'} at 127.0.0.1:50570
I20260709 13:04:27.302875 14010 raft_consensus.cc:606] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 3 LEADER]: Received request to transfer leadership to TS 48967ca777ee43ebaddd57da674bd3e1
I20260709 13:04:27.305294 13867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0"
dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:41554
I20260709 13:04:27.305886 13867 raft_consensus.cc:606] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:27.307102  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:27.308305  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:27.373659 14820 raft_consensus.cc:993] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1: : Instructing follower 26396ddd557646e98bdbd64eba197c05 to start an election
I20260709 13:04:27.374294 14809 raft_consensus.cc:1081] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Signalling peer 26396ddd557646e98bdbd64eba197c05 to start an election
I20260709 13:04:27.376031 14010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1"
dest_uuid: "26396ddd557646e98bdbd64eba197c05"
 from {username='slave'} at 127.0.0.1:46840
I20260709 13:04:27.376582 14010 raft_consensus.cc:493] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.376883 14010 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.384362 14010 raft_consensus.cc:515] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:27.386121 14010 leader_election.cc:290] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 3 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:27.386977 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:27.387054 13941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2ce1afe6d47889a4314aacc80c2d1" candidate_uuid: "26396ddd557646e98bdbd64eba197c05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:27.387672 13867 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.387774 13941 raft_consensus.cc:3055] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:27.388211 13941 raft_consensus.cc:740] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:27.388872 13941 consensus_queue.cc:260] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:27.389755 13941 raft_consensus.cc:3060] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.394057 13867 raft_consensus.cc:2468] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 3.
I20260709 13:04:27.395346 13980 leader_election.cc:304] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:27.396224 14825 raft_consensus.cc:2804] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.396962 14825 raft_consensus.cc:697] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 3 LEADER]: Becoming Leader. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:27.398736 14848 raft_consensus.cc:993] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05: : Instructing follower 48967ca777ee43ebaddd57da674bd3e1 to start an election
I20260709 13:04:27.397675 14825 consensus_queue.cc:237] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:27.399276 14895 raft_consensus.cc:1081] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 3 LEADER]: Signalling peer 48967ca777ee43ebaddd57da674bd3e1 to start an election
I20260709 13:04:27.401479 13935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5"
dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
 from {username='slave'} at 127.0.0.1:57252
I20260709 13:04:27.402016 13941 raft_consensus.cc:2468] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26396ddd557646e98bdbd64eba197c05 in term 3.
I20260709 13:04:27.402029 13935 raft_consensus.cc:493] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.402781 13935 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.411700 13935 raft_consensus.cc:515] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:27.412740 13690 catalog_manager.cc:5697] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 reported cstate change: term changed from 2 to 3, leader changed from 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195) to 26396ddd557646e98bdbd64eba197c05 (127.7.28.196). New cstate: current_term: 3 leader_uuid: "26396ddd557646e98bdbd64eba197c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.414625 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:27.415275 13867 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.423072 13867 raft_consensus.cc:2468] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 4.
I20260709 13:04:27.423391 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc903e0b117245dbaafd89c8bcf21cb5" candidate_uuid: "48967ca777ee43ebaddd57da674bd3e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:27.422287 13935 leader_election.cc:290] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 4 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:27.424360 14010 raft_consensus.cc:3055] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:27.425243 14010 raft_consensus.cc:740] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:27.425992 14010 consensus_queue.cc:260] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:27.426681 14010 raft_consensus.cc:3060] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.424347 13906 leader_election.cc:304] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, 97c52f3e93434bedbdc9755e64f33d4f; no voters: 
I20260709 13:04:27.430800 14809 raft_consensus.cc:2804] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:27.432333 14809 raft_consensus.cc:697] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 LEADER]: Becoming Leader. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:27.433220 14809 consensus_queue.cc:237] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } }
I20260709 13:04:27.437124 14010 raft_consensus.cc:2468] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48967ca777ee43ebaddd57da674bd3e1 in term 4.
I20260709 13:04:27.445544 13690 catalog_manager.cc:5697] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 reported cstate change: term changed from 3 to 4, leader changed from 26396ddd557646e98bdbd64eba197c05 (127.7.28.196) to 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195). New cstate: current_term: 4 leader_uuid: "48967ca777ee43ebaddd57da674bd3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.550918 14865 raft_consensus.cc:993] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:27.551460 14826 raft_consensus.cc:1081] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:27.553260 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f75e791139c44b88609259665a1315b"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:27.553990 14689 raft_consensus.cc:493] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.554497 14689 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.560559 14689 raft_consensus.cc:515] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:27.564090 14689 leader_election.cc:290] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Requested vote from peers 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379), 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185)
I20260709 13:04:27.565761 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:27.565614 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75e791139c44b88609259665a1315b" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:27.566416 13867 raft_consensus.cc:3055] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:27.566588 13935 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.566785 13867 raft_consensus.cc:740] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:27.567714 13867 consensus_queue.cc:260] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:27.568811 13867 raft_consensus.cc:3060] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.572582 13935 raft_consensus.cc:2468] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:27.574004 14585 leader_election.cc:304] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:27.574148 13867 raft_consensus.cc:2468] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:27.575112 14900 raft_consensus.cc:2804] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.575677 14900 raft_consensus.cc:697] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:27.576596 14900 consensus_queue.cc:237] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } }
I20260709 13:04:27.594162 13690 catalog_manager.cc:5697] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 2 to 3, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 3 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.692744 14919 raft_consensus.cc:993] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:27.693742 14865 raft_consensus.cc:1081] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:27.695344 14698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:04:27.695856 14698 raft_consensus.cc:493] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.696201 14698 raft_consensus.cc:3060] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.702114 14698 raft_consensus.cc:515] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:27.703797 14698 leader_election.cc:290] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Requested vote from peers 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:27.705248 14010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:27.705267 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df17443f0bfc4fd69e14026addccdbf0" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97c52f3e93434bedbdc9755e64f33d4f"
I20260709 13:04:27.705943 14010 raft_consensus.cc:3060] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.706176 13867 raft_consensus.cc:3055] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:27.706616 13867 raft_consensus.cc:740] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97c52f3e93434bedbdc9755e64f33d4f, State: Running, Role: LEADER
I20260709 13:04:27.707314 13867 consensus_queue.cc:260] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:27.708469 13867 raft_consensus.cc:3060] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.712618 14010 raft_consensus.cc:2468] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:27.713745 14586 leader_election.cc:304] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:27.714766 14900 raft_consensus.cc:2804] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:27.715157 13867 raft_consensus.cc:2468] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:27.715253 14900 raft_consensus.cc:697] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:27.716336 14900 consensus_queue.cc:237] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:27.727411 13690 catalog_manager.cc:5697] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 1 to 2, leader changed from 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 2 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.888979 13935 raft_consensus.cc:1275] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.891180 14895 consensus_queue.cc:1048] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:27.912722 13865 raft_consensus.cc:1275] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 4 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:27.916060 14902 consensus_queue.cc:1048] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.964851 13941 raft_consensus.cc:1275] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.967743 14834 consensus_queue.cc:1048] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:27.979142 13865 raft_consensus.cc:1275] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Refusing update from remote peer 26396ddd557646e98bdbd64eba197c05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.993513 14825 consensus_queue.cc:1048] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:04:28.006645 14010 raft_consensus.cc:1275] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 4 FOLLOWER]: Refusing update from remote peer 48967ca777ee43ebaddd57da674bd3e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:28.136139 14902 consensus_queue.cc:1048] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:28.167377 13864 raft_consensus.cc:1275] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.170449 14900 consensus_queue.cc:1048] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:28.299304 14011 raft_consensus.cc:1275] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.301010 14938 consensus_queue.cc:1048] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:28.309509  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:28.316780 13867 raft_consensus.cc:1275] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.318662 14834 consensus_queue.cc:1048] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.376211  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:28.425128 13941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a"
dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:37228
I20260709 13:04:28.426007 13941 raft_consensus.cc:606] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:28.429195 14011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee"
dest_uuid: "26396ddd557646e98bdbd64eba197c05"
mode: GRACEFUL
new_leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:50570
I20260709 13:04:28.429893 14011 raft_consensus.cc:606] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Received request to transfer leadership to TS ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:28.431399  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:28.432627  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:28.562733 14848 raft_consensus.cc:993] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:28.563331 14848 raft_consensus.cc:1081] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:28.564960 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33692
I20260709 13:04:28.565478 14689 raft_consensus.cc:493] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.565778 14689 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.572432 14689 raft_consensus.cc:515] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:28.574368 14689 leader_election.cc:290] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:28.575521 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:28.575577 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834b53c6ebc41a7998a283270aaa5ee" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:28.576563 13935 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.576704 14011 raft_consensus.cc:3055] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:28.577242 14011 raft_consensus.cc:740] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26396ddd557646e98bdbd64eba197c05, State: Running, Role: LEADER
I20260709 13:04:28.578313 14011 consensus_queue.cc:260] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:28.579610 14011 raft_consensus.cc:3060] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.584165 13935 raft_consensus.cc:2468] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:28.585691 14585 leader_election.cc:304] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:28.586737 14900 raft_consensus.cc:2804] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:28.587227 14900 raft_consensus.cc:697] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:28.588143 14900 consensus_queue.cc:237] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:28.590268 14011 raft_consensus.cc:2468] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 3.
I20260709 13:04:28.601346 13687 catalog_manager.cc:5697] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 2 to 3, leader changed from 26396ddd557646e98bdbd64eba197c05 (127.7.28.196) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 3 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.785653 14945 raft_consensus.cc:993] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1: : Instructing follower ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:28.786415 14931 raft_consensus.cc:1081] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Signalling peer ce171b1b0d7341f59e3ba532f7b51d1b to start an election
I20260709 13:04:28.787938 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a"
dest_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b"
 from {username='slave'} at 127.0.0.1:33674
I20260709 13:04:28.788435 14689 raft_consensus.cc:493] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.788726 14689 raft_consensus.cc:3060] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.795217 14689 raft_consensus.cc:515] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:28.797163 14689 leader_election.cc:290] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Requested vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), 26396ddd557646e98bdbd64eba197c05 (127.7.28.196:37991)
I20260709 13:04:28.797639 13935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48967ca777ee43ebaddd57da674bd3e1"
I20260709 13:04:28.798241 14011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de0625f3be4f23896d250d94ffdd2a" candidate_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26396ddd557646e98bdbd64eba197c05"
I20260709 13:04:28.798274 13935 raft_consensus.cc:3055] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.798892 13935 raft_consensus.cc:740] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48967ca777ee43ebaddd57da674bd3e1, State: Running, Role: LEADER
I20260709 13:04:28.798962 14011 raft_consensus.cc:3060] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.799715 13935 consensus_queue.cc:260] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:28.800740 13935 raft_consensus.cc:3060] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.804946 14011 raft_consensus.cc:2468] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:28.806278 13935 raft_consensus.cc:2468] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce171b1b0d7341f59e3ba532f7b51d1b in term 2.
I20260709 13:04:28.806919 14586 leader_election.cc:304] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05, ce171b1b0d7341f59e3ba532f7b51d1b; no voters: 
I20260709 13:04:28.808154 14834 raft_consensus.cc:2804] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.808648 14834 raft_consensus.cc:697] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Becoming Leader. State: Replica: ce171b1b0d7341f59e3ba532f7b51d1b, State: Running, Role: LEADER
I20260709 13:04:28.809587 14834 consensus_queue.cc:237] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:28.820399 13687 catalog_manager.cc:5697] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b reported cstate change: term changed from 1 to 2, leader changed from 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195) to ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193). New cstate: current_term: 2 leader_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.198743 14011 raft_consensus.cc:1275] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.201368 14900 consensus_queue.cc:1048] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.209668 13935 raft_consensus.cc:1275] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.211731 14900 consensus_queue.cc:1048] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:29.280222 13935 raft_consensus.cc:1275] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.281643 14900 consensus_queue.cc:1048] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.292606 14011 raft_consensus.cc:1275] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Refusing update from remote peer ce171b1b0d7341f59e3ba532f7b51d1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.295238 14900 consensus_queue.cc:1048] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.433390  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:29.469875  7283 tablet_server.cc:179] TabletServer@127.7.28.193:40245 shutting down...
W20260709 13:04:29.484902 13981 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 240 similar messages]
W20260709 13:04:29.492270 13981 consensus_peers.cc:597] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.495229 13833 consensus_peers.cc:597] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.510193 13907 consensus_peers.cc:597] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.527456  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:29.530018  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.530877  7283 raft_consensus.cc:2243] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.531409  7283 raft_consensus.cc:2272] T 335fd22e76d14ce5822297f3f534fb0c P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.534428  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.535307  7283 raft_consensus.cc:2243] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.535905  7283 raft_consensus.cc:2272] T 7618e0b5f2c44b529f37ee7481482040 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.539120  7283 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:29.539230 13981 consensus_peers.cc:597] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.540079  7283 raft_consensus.cc:2243] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.541348  7283 raft_consensus.cc:2272] T 80485db7c3b94a4db01541f0e19253f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.544741  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.545650  7283 raft_consensus.cc:2243] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.546262  7283 raft_consensus.cc:2272] T 160582a28a9446428b13a46b942d62dc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.547399 13981 consensus_peers.cc:597] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.549563  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.551002  7283 raft_consensus.cc:2243] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.551648  7283 raft_consensus.cc:2272] T f3d96cc6c31040cead99c79b8a080c49 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.555068  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.555765  7283 raft_consensus.cc:2243] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.556367  7283 raft_consensus.cc:2272] T 8809c926517048778c24dfaab0d66305 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.556424 13833 consensus_peers.cc:597] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.557150 13833 consensus_peers.cc:597] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.559332  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.560102  7283 raft_consensus.cc:2243] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.560570  7283 raft_consensus.cc:2272] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.563175  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.563818  7283 raft_consensus.cc:2243] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.564250  7283 raft_consensus.cc:2272] T b33baea2ddc640ee86529fb3d422c920 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.567274  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.567795  7283 raft_consensus.cc:2243] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.568163  7283 raft_consensus.cc:2272] T 4207a5906547482096df3ec41328292e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.570168  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.570832  7283 raft_consensus.cc:2243] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.571700  7283 raft_consensus.cc:2272] T 7f75e791139c44b88609259665a1315b P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.574942  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.577319  7283 raft_consensus.cc:2243] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.577912  7283 raft_consensus.cc:2272] T 54fb16a8c2034fd2bbc250bf493ee9ca P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.580829  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.581481  7283 raft_consensus.cc:2243] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.582306  7283 raft_consensus.cc:2272] T e1adcb00abdc43c4a025388310386956 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.584396  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.585243  7283 raft_consensus.cc:2243] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.585740  7283 raft_consensus.cc:2272] T 2ef26422e31c46fe8f63d4388ae021a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.588092  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.588694  7283 raft_consensus.cc:2243] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.589087  7283 raft_consensus.cc:2272] T ec8e2fbb0a1541e7b82f6112cabed288 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.591643  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.592231  7283 raft_consensus.cc:2243] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.592639  7283 raft_consensus.cc:2272] T b86368c5ec644579a96e52be386c82f6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.594693  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.595314  7283 raft_consensus.cc:2243] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.596081  7283 raft_consensus.cc:2272] T 2834b53c6ebc41a7998a283270aaa5ee P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.598675  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.599258  7283 raft_consensus.cc:2243] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.599673  7283 raft_consensus.cc:2272] T 045c882b5c9b44cb867d853eb82d3f86 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.601776  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.602380  7283 raft_consensus.cc:2243] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.603081  7283 raft_consensus.cc:2272] T 23ba395804274ae6b50899d3c4839734 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.606590  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.607437  7283 raft_consensus.cc:2243] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.608011  7283 raft_consensus.cc:2272] T 7e08736e8bdd4624ae337513bd3f8903 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.608768 13907 consensus_peers.cc:597] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.610558  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.611196  7283 raft_consensus.cc:2243] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.611709  7283 raft_consensus.cc:2272] T 01fa4d4f818b438ab5523c23fc40d3a4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.614215  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.614981  7283 raft_consensus.cc:2243] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.615428  7283 raft_consensus.cc:2272] T b40d85c0caf94564b29d7771bd4691f4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.618502  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.619129  7283 raft_consensus.cc:2243] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.619949  7283 raft_consensus.cc:2272] T 244ea1e7aee643d2b606db7cd01d5346 P ce171b1b0d7341f59e3ba532f7b51d1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.622394  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.623005  7283 raft_consensus.cc:2243] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.623391  7283 raft_consensus.cc:2272] T 6464fa5a5f594fbd9f27a2a6f7988481 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.625710  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.626466  7283 raft_consensus.cc:2243] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.627583  7283 raft_consensus.cc:2272] T e974506c09fa4bc481abf11343fdbf3e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.630144  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.630697  7283 raft_consensus.cc:2243] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.631098  7283 raft_consensus.cc:2272] T 4a7f9c6781bb4725847b8d5169cd3c02 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.633222  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.633874  7283 raft_consensus.cc:2243] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.634786  7283 raft_consensus.cc:2272] T 31306f2bb4a647168863d2675faf7f05 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.637485  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.638116  7283 raft_consensus.cc:2243] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.638581  7283 raft_consensus.cc:2272] T b443c5191ca74bf1afcc265171e53dd8 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.640858  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.641471  7283 raft_consensus.cc:2243] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.642431  7283 raft_consensus.cc:2272] T 983190c267f247bd8c93a67faff1a4f3 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.645008  7283 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:29.645082 13981 consensus_peers.cc:597] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.645675  7283 raft_consensus.cc:2243] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.646672  7283 raft_consensus.cc:2272] T 10de0625f3be4f23896d250d94ffdd2a P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.649721  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.650606  7283 raft_consensus.cc:2243] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.651197  7283 raft_consensus.cc:2272] T 2e88dc464675442b8c7152dbf45e7b8b P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.653832  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.654412  7283 raft_consensus.cc:2243] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.654780  7283 raft_consensus.cc:2272] T 894a0cf3d92b439ba443a8b917912a68 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.656873  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.657378  7283 raft_consensus.cc:2243] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.657859  7283 raft_consensus.cc:2272] T c9f494f81f71485b85b9551431ff68d0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.660060  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.660526  7283 raft_consensus.cc:2243] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.661193  7283 raft_consensus.cc:2272] T df17443f0bfc4fd69e14026addccdbf0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.663904  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.664521  7283 raft_consensus.cc:2243] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.665463  7283 raft_consensus.cc:2272] T 9da06c8013b34581b8df0cae992146fd P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.667470  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.668023  7283 raft_consensus.cc:2243] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.668426  7283 raft_consensus.cc:2272] T d165767a6eb84e0ab6e475cb48c542ae P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.671041  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.671837  7283 raft_consensus.cc:2243] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.673053  7283 raft_consensus.cc:2272] T d3ea2a360d5a4c0b86b352b5c79e3756 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.674449 13833 consensus_peers.cc:597] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.676298  7283 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:29.676626 13981 consensus_peers.cc:597] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.677217  7283 raft_consensus.cc:2243] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.677927  7283 raft_consensus.cc:2272] T 2bc6c842bcd947ef97971e5b80b2fce4 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.680418  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.681125  7283 raft_consensus.cc:2243] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.681553  7283 raft_consensus.cc:2272] T 5b6ce7c8d44a4c72a07abbf0467105e6 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.683894  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.684478  7283 raft_consensus.cc:2243] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.684836  7283 raft_consensus.cc:2272] T c945695696fc4b6a9ad5becbe6a236a7 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.686880  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.687431  7283 raft_consensus.cc:2243] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.687829  7283 raft_consensus.cc:2272] T 88d02328b2b94a7092dbb3d0645862c0 P ce171b1b0d7341f59e3ba532f7b51d1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.690564  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.691215  7283 raft_consensus.cc:2243] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.692384  7283 raft_consensus.cc:2272] T 27502a3045c14fbdaebb0312b250740e P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.694831 13907 consensus_peers.cc:597] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.695632  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.696357  7283 raft_consensus.cc:2243] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.697495  7283 raft_consensus.cc:2272] T 9be03c00128f434fa58d0cc4ac20c104 P ce171b1b0d7341f59e3ba532f7b51d1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.697616 13907 consensus_peers.cc:597] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.700191  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.700870  7283 raft_consensus.cc:2243] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.701354  7283 raft_consensus.cc:2272] T b83902dd19424f4d9f3707d53bafb0b5 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.703701  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.704263  7283 raft_consensus.cc:2243] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.704675  7283 raft_consensus.cc:2272] T 71bebeea22ca415e8b677798ee3cea04 P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.707100  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:29.707743  7283 raft_consensus.cc:2243] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.708268  7283 raft_consensus.cc:2272] T 92c8aaedf9904579b4f3e13ba43661bc P ce171b1b0d7341f59e3ba532f7b51d1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.710052 13833 consensus_peers.cc:597] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.723688 13981 consensus_peers.cc:597] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.729106 13833 consensus_peers.cc:597] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.731576 13833 consensus_peers.cc:597] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.743686 13907 consensus_peers.cc:597] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.747107 13981 consensus_peers.cc:597] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.754379 13833 consensus_peers.cc:597] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.758925 13907 consensus_peers.cc:597] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.774544 13833 connection.cc:573] client connection to 127.7.28.193:40245 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:04:29.780053 13833 consensus_peers.cc:597] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.796679  7283 tablet_server.cc:196] TabletServer@127.7.28.193:40245 shutdown complete.
W20260709 13:04:29.819322 13907 consensus_peers.cc:597] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.827020 13907 consensus_peers.cc:597] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.828338 13833 consensus_peers.cc:597] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.900271 13907 consensus_peers.cc:597] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.902061  7283 tablet_server.cc:179] TabletServer@127.7.28.194:0 shutting down...
W20260709 13:04:29.910686 13981 consensus_peers.cc:597] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.935946 13907 consensus_peers.cc:597] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.936368 13981 consensus_peers.cc:597] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.939759 13980 consensus_peers.cc:597] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.941965 13980 consensus_peers.cc:597] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.957967  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:29.958808  7283 tablet_replica.cc:333] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.959580  7283 raft_consensus.cc:2243] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.960165  7283 raft_consensus.cc:2272] T a350bf7b4479428fa79f9b4aa9036423 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.962399  7283 tablet_replica.cc:333] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.963096  7283 raft_consensus.cc:2243] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.963601  7283 raft_consensus.cc:2272] T 8797238dd5cd494e936f80a38430878c P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.965646  7283 tablet_replica.cc:333] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.966277  7283 raft_consensus.cc:2243] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.966717  7283 raft_consensus.cc:2272] T 7f75e791139c44b88609259665a1315b P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.968631  7283 tablet_replica.cc:333] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.969218  7283 raft_consensus.cc:2243] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.970098  7283 raft_consensus.cc:2272] T 2bc6c842bcd947ef97971e5b80b2fce4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.972039  7283 tablet_replica.cc:333] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.972607  7283 raft_consensus.cc:2243] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.973385  7283 raft_consensus.cc:2272] T cd9a5b7830c74a849bdaee0374a8cabf P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.975510  7283 tablet_replica.cc:333] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.976130  7283 raft_consensus.cc:2243] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.976577  7283 raft_consensus.cc:2272] T df17443f0bfc4fd69e14026addccdbf0 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.978731  7283 tablet_replica.cc:333] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.979317  7283 raft_consensus.cc:2243] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.979769  7283 raft_consensus.cc:2272] T d3ea2a360d5a4c0b86b352b5c79e3756 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.981945  7283 tablet_replica.cc:333] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.982753  7283 raft_consensus.cc:2243] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.983307  7283 raft_consensus.cc:2272] T 045c882b5c9b44cb867d853eb82d3f86 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.986063  7283 tablet_replica.cc:333] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.986815  7283 raft_consensus.cc:2243] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.987794  7283 raft_consensus.cc:2272] T 23ba395804274ae6b50899d3c4839734 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.990447  7283 tablet_replica.cc:333] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.991182  7283 raft_consensus.cc:2243] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.992209  7283 raft_consensus.cc:2272] T 335fd22e76d14ce5822297f3f534fb0c P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.994921  7283 tablet_replica.cc:333] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:29.995774  7283 raft_consensus.cc:2243] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.996678  7283 raft_consensus.cc:2272] T c945695696fc4b6a9ad5becbe6a236a7 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.999692  7283 tablet_replica.cc:333] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.000478  7283 raft_consensus.cc:2243] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.001098  7283 raft_consensus.cc:2272] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.004446  7283 tablet_replica.cc:333] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
W20260709 13:04:30.004576 13980 consensus_peers.cc:597] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.005231  7283 raft_consensus.cc:2243] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.006232  7283 raft_consensus.cc:2272] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.007068 13980 consensus_peers.cc:597] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.008481  7283 tablet_replica.cc:333] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.009169  7283 raft_consensus.cc:2243] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.010080  7283 raft_consensus.cc:2272] T 2ef26422e31c46fe8f63d4388ae021a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.012243  7283 tablet_replica.cc:333] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.012850  7283 raft_consensus.cc:2243] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.013310  7283 raft_consensus.cc:2272] T 10a7704202b34ee8a6faee074094ba82 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.015621  7283 tablet_replica.cc:333] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.016353  7283 raft_consensus.cc:2243] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.016911  7283 raft_consensus.cc:2272] T e1adcb00abdc43c4a025388310386956 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.019842  7283 tablet_replica.cc:333] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.020591  7283 raft_consensus.cc:2243] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.021534  7283 raft_consensus.cc:2272] T b83902dd19424f4d9f3707d53bafb0b5 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.023896  7283 tablet_replica.cc:333] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.024407  7283 raft_consensus.cc:2243] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.024797  7283 raft_consensus.cc:2272] T 9be03c00128f434fa58d0cc4ac20c104 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.027557  7283 tablet_replica.cc:333] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
W20260709 13:04:30.027812 13906 consensus_peers.cc:597] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.028327  7283 raft_consensus.cc:2243] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.029008  7283 raft_consensus.cc:2272] T 92c8aaedf9904579b4f3e13ba43661bc P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.032048  7283 tablet_replica.cc:333] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.032685  7283 raft_consensus.cc:2243] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.033209  7283 raft_consensus.cc:2272] T b33baea2ddc640ee86529fb3d422c920 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.035599  7283 tablet_replica.cc:333] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.036192  7283 raft_consensus.cc:2243] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.036669  7283 raft_consensus.cc:2272] T 4207a5906547482096df3ec41328292e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.038846  7283 tablet_replica.cc:333] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.039574  7283 raft_consensus.cc:2243] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.040099  7283 raft_consensus.cc:2272] T 27502a3045c14fbdaebb0312b250740e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.042990  7283 tablet_replica.cc:333] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.043807  7283 raft_consensus.cc:2243] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.044773  7283 raft_consensus.cc:2272] T 8809c926517048778c24dfaab0d66305 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.045696 13906 consensus_peers.cc:597] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.047219  7283 tablet_replica.cc:333] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.048019  7283 raft_consensus.cc:2243] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.048540  7283 raft_consensus.cc:2272] T 17b2ce1afe6d47889a4314aacc80c2d1 P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.051082  7283 tablet_replica.cc:333] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
W20260709 13:04:30.051599 13907 consensus_peers.cc:597] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.051929  7283 raft_consensus.cc:2243] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.052505  7283 raft_consensus.cc:2272] T 80485db7c3b94a4db01541f0e19253f4 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.054623  7283 tablet_replica.cc:333] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.055285  7283 raft_consensus.cc:2243] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.056073  7283 raft_consensus.cc:2272] T ea20a419556e46b0b003c05c54815dc6 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.058142  7283 tablet_replica.cc:333] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.058715  7283 raft_consensus.cc:2243] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.059508  7283 raft_consensus.cc:2272] T 71bebeea22ca415e8b677798ee3cea04 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.062203  7283 tablet_replica.cc:333] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.062836  7283 raft_consensus.cc:2243] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.063906  7283 raft_consensus.cc:2272] T 7beb6d7b3ddc4918809eb22abca298db P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.066726  7283 tablet_replica.cc:333] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.067421  7283 raft_consensus.cc:2243] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.067803  7283 raft_consensus.cc:2272] T 01fa4d4f818b438ab5523c23fc40d3a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.069867  7283 tablet_replica.cc:333] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.070655  7283 raft_consensus.cc:2243] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.071231  7283 raft_consensus.cc:2272] T e974506c09fa4bc481abf11343fdbf3e P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.074241  7283 tablet_replica.cc:333] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.074925  7283 raft_consensus.cc:2243] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.075996  7283 raft_consensus.cc:2272] T 6464fa5a5f594fbd9f27a2a6f7988481 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.078601  7283 tablet_replica.cc:333] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.079262  7283 raft_consensus.cc:2243] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.079751  7283 raft_consensus.cc:2272] T 7618e0b5f2c44b529f37ee7481482040 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.082652  7283 tablet_replica.cc:333] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.083374  7283 raft_consensus.cc:2243] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.083941  7283 raft_consensus.cc:2272] T 84199221e2c348f0a790594df18c571e P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.086516  7283 tablet_replica.cc:333] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.087194  7283 raft_consensus.cc:2243] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.087769  7283 raft_consensus.cc:2272] T bc903e0b117245dbaafd89c8bcf21cb5 P 97c52f3e93434bedbdc9755e64f33d4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.090442  7283 tablet_replica.cc:333] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
W20260709 13:04:30.090758 13907 consensus_peers.cc:597] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 -> Peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Couldn't send request to peer ce171b1b0d7341f59e3ba532f7b51d1b. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.091153  7283 raft_consensus.cc:2243] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.092051  7283 raft_consensus.cc:2272] T 17b73e3362554ac58453d81770b9ad6f P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.095033  7283 tablet_replica.cc:333] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.095764  7283 raft_consensus.cc:2243] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.096295  7283 raft_consensus.cc:2272] T 217b4b051be04869b067d3f67aa80a4e P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.098464  7283 tablet_replica.cc:333] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.099025  7283 raft_consensus.cc:2243] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.099438  7283 raft_consensus.cc:2272] T 089b79bc7e3c4b9c9cd30f08cde86000 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.101444  7283 tablet_replica.cc:333] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.102185  7283 raft_consensus.cc:2243] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.102758  7283 raft_consensus.cc:2272] T 2e88dc464675442b8c7152dbf45e7b8b P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.105521  7283 tablet_replica.cc:333] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.106235  7283 raft_consensus.cc:2243] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.106774  7283 raft_consensus.cc:2272] T 7e08736e8bdd4624ae337513bd3f8903 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.109320  7283 tablet_replica.cc:333] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.110008  7283 raft_consensus.cc:2243] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.110455  7283 raft_consensus.cc:2272] T 8184075bc04f4f209f3b9d4f56d1522a P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.112720  7283 tablet_replica.cc:333] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.113341  7283 raft_consensus.cc:2243] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.114154  7283 raft_consensus.cc:2272] T e80b52ff804c4785baad8cca54adc6a4 P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.116183  7283 tablet_replica.cc:333] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.116722  7283 raft_consensus.cc:2243] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.117192  7283 raft_consensus.cc:2272] T 983190c267f247bd8c93a67faff1a4f3 P 97c52f3e93434bedbdc9755e64f33d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.119436  7283 tablet_replica.cc:333] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.120033  7283 raft_consensus.cc:2243] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.120544  7283 raft_consensus.cc:2272] T d165767a6eb84e0ab6e475cb48c542ae P 97c52f3e93434bedbdc9755e64f33d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.123453  7283 tablet_replica.cc:333] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f: stopping tablet replica
I20260709 13:04:30.124130  7283 raft_consensus.cc:2243] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.124709  7283 raft_consensus.cc:2272] T 9da06c8013b34581b8df0cae992146fd P 97c52f3e93434bedbdc9755e64f33d4f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.125504 13980 consensus_peers.cc:597] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.130455 13980 consensus_peers.cc:597] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.160046 13980 consensus_peers.cc:597] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.184342 13906 consensus_peers.cc:597] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.194195  7283 tablet_server.cc:196] TabletServer@127.7.28.194:0 shutdown complete.
W20260709 13:04:30.204485 13906 consensus_peers.cc:597] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.279661  7283 tablet_server.cc:179] TabletServer@127.7.28.195:0 shutting down...
W20260709 13:04:30.289064 13980 consensus_peers.cc:597] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.289747 13980 consensus_peers.cc:597] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.290390 13979 consensus_peers.cc:597] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.292644 13906 consensus_peers.cc:597] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.314482 13906 consensus_peers.cc:597] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.330441  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:30.331465  7283 tablet_replica.cc:333] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.332336  7283 raft_consensus.cc:2243] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.332921  7283 raft_consensus.cc:2272] T 8797238dd5cd494e936f80a38430878c P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.335888  7283 tablet_replica.cc:333] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.336858  7283 raft_consensus.cc:2243] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.337456  7283 raft_consensus.cc:2272] T 5bbed8f0ccba4b5fabb54cdb9abcead1 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.337989 13979 consensus_peers.cc:597] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.339686  7283 tablet_replica.cc:333] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.340379  7283 raft_consensus.cc:2243] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.341310  7283 raft_consensus.cc:2272] T 5b6ce7c8d44a4c72a07abbf0467105e6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.344183  7283 tablet_replica.cc:333] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.345103  7283 raft_consensus.cc:2243] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.345722  7283 raft_consensus.cc:2272] T 335fd22e76d14ce5822297f3f534fb0c P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.348512  7283 tablet_replica.cc:333] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.349443  7283 raft_consensus.cc:2243] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.350188  7283 raft_consensus.cc:2272] T 244ea1e7aee643d2b606db7cd01d5346 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.353827  7283 tablet_replica.cc:333] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.358475  7283 raft_consensus.cc:2243] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.359073  7283 raft_consensus.cc:2272] T f3d96cc6c31040cead99c79b8a080c49 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.362536  7283 tablet_replica.cc:333] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
W20260709 13:04:30.362640 13906 consensus_peers.cc:597] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.363642  7283 raft_consensus.cc:2243] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.364706  7283 raft_consensus.cc:2272] T 160582a28a9446428b13a46b942d62dc P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.366894  7283 tablet_replica.cc:333] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.367484  7283 raft_consensus.cc:2243] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.367957  7283 raft_consensus.cc:2272] T 10a7704202b34ee8a6faee074094ba82 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.370060  7283 tablet_replica.cc:333] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.370632  7283 raft_consensus.cc:2243] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.371063  7283 raft_consensus.cc:2272] T 54fb16a8c2034fd2bbc250bf493ee9ca P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.374958  7283 tablet_replica.cc:333] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.375811  7283 raft_consensus.cc:2243] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.376398  7283 raft_consensus.cc:2272] T e1adcb00abdc43c4a025388310386956 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.379407  7283 tablet_replica.cc:333] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.380169  7283 raft_consensus.cc:2243] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.380756  7283 raft_consensus.cc:2272] T d3ea2a360d5a4c0b86b352b5c79e3756 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.383734  7283 tablet_replica.cc:333] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
W20260709 13:04:30.383636 13979 consensus_peers.cc:597] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.384721  7283 raft_consensus.cc:2243] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.385398  7283 raft_consensus.cc:2272] T 17b2ce1afe6d47889a4314aacc80c2d1 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.388321  7283 tablet_replica.cc:333] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.389253  7283 raft_consensus.cc:2243] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.389859  7283 raft_consensus.cc:2272] T 7f75e791139c44b88609259665a1315b P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.393388  7283 tablet_replica.cc:333] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.394477  7283 raft_consensus.cc:2243] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:04:30.394816 13980 consensus_peers.cc:597] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.395558  7283 raft_consensus.cc:2272] T 84199221e2c348f0a790594df18c571e P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.398692  7283 tablet_replica.cc:333] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.399509  7283 raft_consensus.cc:2243] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.399983  7283 raft_consensus.cc:2272] T 7beb6d7b3ddc4918809eb22abca298db P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.402391  7283 tablet_replica.cc:333] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.403214  7283 raft_consensus.cc:2243] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.404160  7283 raft_consensus.cc:2272] T 01fa4d4f818b438ab5523c23fc40d3a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.406579  7283 tablet_replica.cc:333] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.407395  7283 raft_consensus.cc:2243] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.408274  7283 raft_consensus.cc:2272] T b40d85c0caf94564b29d7771bd4691f4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.410673  7283 tablet_replica.cc:333] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.411248  7283 raft_consensus.cc:2243] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.411705  7283 raft_consensus.cc:2272] T 9be03c00128f434fa58d0cc4ac20c104 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.414086  7283 tablet_replica.cc:333] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
W20260709 13:04:30.414505 13906 consensus_peers.cc:597] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 -> Peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Couldn't send request to peer 97c52f3e93434bedbdc9755e64f33d4f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.414871  7283 raft_consensus.cc:2243] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.415678  7283 raft_consensus.cc:2272] T 4207a5906547482096df3ec41328292e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.417584  7283 tablet_replica.cc:333] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.418195  7283 raft_consensus.cc:2243] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.418565  7283 raft_consensus.cc:2272] T ea20a419556e46b0b003c05c54815dc6 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.420542  7283 tablet_replica.cc:333] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.421181  7283 raft_consensus.cc:2243] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.422020  7283 raft_consensus.cc:2272] T bc903e0b117245dbaafd89c8bcf21cb5 P 48967ca777ee43ebaddd57da674bd3e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.423965  7283 tablet_replica.cc:333] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.424451  7283 raft_consensus.cc:2243] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.424820  7283 raft_consensus.cc:2272] T 17b73e3362554ac58453d81770b9ad6f P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.426887  7283 tablet_replica.cc:333] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.427381  7283 raft_consensus.cc:2243] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.427726  7283 raft_consensus.cc:2272] T 217b4b051be04869b067d3f67aa80a4e P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.429643  7283 tablet_replica.cc:333] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.430226  7283 raft_consensus.cc:2243] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.431066  7283 raft_consensus.cc:2272] T c9f494f81f71485b85b9551431ff68d0 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.432971  7283 tablet_replica.cc:333] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.433561  7283 raft_consensus.cc:2243] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.434351  7283 raft_consensus.cc:2272] T 88d02328b2b94a7092dbb3d0645862c0 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.436304  7283 tablet_replica.cc:333] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.436821  7283 raft_consensus.cc:2243] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.437258  7283 raft_consensus.cc:2272] T 27502a3045c14fbdaebb0312b250740e P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.439815  7283 tablet_replica.cc:333] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.440608  7283 raft_consensus.cc:2243] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.441162  7283 raft_consensus.cc:2272] T 983190c267f247bd8c93a67faff1a4f3 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.443631  7283 tablet_replica.cc:333] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.444197  7283 raft_consensus.cc:2243] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.445386  7283 raft_consensus.cc:2272] T b443c5191ca74bf1afcc265171e53dd8 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.446951 13979 consensus_peers.cc:597] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.447852  7283 tablet_replica.cc:333] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.448508  7283 raft_consensus.cc:2243] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.448931  7283 raft_consensus.cc:2272] T 10de0625f3be4f23896d250d94ffdd2a P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.450979  7283 tablet_replica.cc:333] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.451560  7283 raft_consensus.cc:2243] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.451973  7283 raft_consensus.cc:2272] T ec8e2fbb0a1541e7b82f6112cabed288 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.453994  7283 tablet_replica.cc:333] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.454568  7283 raft_consensus.cc:2243] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.454995  7283 raft_consensus.cc:2272] T 8184075bc04f4f209f3b9d4f56d1522a P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.457237  7283 tablet_replica.cc:333] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.457891  7283 raft_consensus.cc:2243] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.458446  7283 raft_consensus.cc:2272] T e80b52ff804c4785baad8cca54adc6a4 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.461036  7283 tablet_replica.cc:333] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.461690  7283 raft_consensus.cc:2243] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.462198  7283 raft_consensus.cc:2272] T cd9a5b7830c74a849bdaee0374a8cabf P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.464262  7283 tablet_replica.cc:333] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.464808  7283 raft_consensus.cc:2243] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.465226  7283 raft_consensus.cc:2272] T 6464fa5a5f594fbd9f27a2a6f7988481 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.467097  7283 tablet_replica.cc:333] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.467697  7283 raft_consensus.cc:2243] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.468434  7283 raft_consensus.cc:2272] T 7618e0b5f2c44b529f37ee7481482040 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.470329  7283 tablet_replica.cc:333] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.470806  7283 raft_consensus.cc:2243] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.471490  7283 raft_consensus.cc:2272] T 045c882b5c9b44cb867d853eb82d3f86 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.473341  7283 tablet_replica.cc:333] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.473898  7283 raft_consensus.cc:2243] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.474292  7283 raft_consensus.cc:2272] T 2834b53c6ebc41a7998a283270aaa5ee P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.476118  7283 tablet_replica.cc:333] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.476596  7283 raft_consensus.cc:2243] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.477284  7283 raft_consensus.cc:2272] T b86368c5ec644579a96e52be386c82f6 P 48967ca777ee43ebaddd57da674bd3e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.479375  7283 tablet_replica.cc:333] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.479933  7283 raft_consensus.cc:2243] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.480713  7283 raft_consensus.cc:2272] T a350bf7b4479428fa79f9b4aa9036423 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.482782  7283 tablet_replica.cc:333] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.483318  7283 raft_consensus.cc:2243] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.483737  7283 raft_consensus.cc:2272] T 894a0cf3d92b439ba443a8b917912a68 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.485574  7283 tablet_replica.cc:333] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.486112  7283 raft_consensus.cc:2243] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.486539  7283 raft_consensus.cc:2272] T 31306f2bb4a647168863d2675faf7f05 P 48967ca777ee43ebaddd57da674bd3e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.488620  7283 tablet_replica.cc:333] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.489112  7283 raft_consensus.cc:2243] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.489563  7283 raft_consensus.cc:2272] T 4a7f9c6781bb4725847b8d5169cd3c02 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.491525  7283 tablet_replica.cc:333] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.492043  7283 raft_consensus.cc:2243] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.492486  7283 raft_consensus.cc:2272] T 089b79bc7e3c4b9c9cd30f08cde86000 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.494423  7283 tablet_replica.cc:333] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1: stopping tablet replica
I20260709 13:04:30.494913  7283 raft_consensus.cc:2243] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.495769  7283 raft_consensus.cc:2272] T 7e08736e8bdd4624ae337513bd3f8903 P 48967ca777ee43ebaddd57da674bd3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.499656 13979 consensus_peers.cc:597] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.519259 13979 consensus_peers.cc:597] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.572789  7283 tablet_server.cc:196] TabletServer@127.7.28.195:0 shutdown complete.
W20260709 13:04:30.598526 13979 consensus_peers.cc:597] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.195:39185: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.645216 13979 consensus_peers.cc:597] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.195:39185: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.651296  7283 tablet_server.cc:179] TabletServer@127.7.28.196:0 shutting down...
W20260709 13:04:30.684904 13979 consensus_peers.cc:597] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.195:39185: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.694782  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:30.695839  7283 tablet_replica.cc:333] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.696774  7283 raft_consensus.cc:2243] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.698036  7283 raft_consensus.cc:2272] T 8797238dd5cd494e936f80a38430878c P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.700445  7283 tablet_replica.cc:333] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.701011  7283 raft_consensus.cc:2243] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.701486  7283 raft_consensus.cc:2272] T c945695696fc4b6a9ad5becbe6a236a7 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.703615  7283 tablet_replica.cc:333] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.704262  7283 raft_consensus.cc:2243] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.704767  7283 raft_consensus.cc:2272] T 244ea1e7aee643d2b606db7cd01d5346 P 26396ddd557646e98bdbd64eba197c05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.706761  7283 tablet_replica.cc:333] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.707343  7283 raft_consensus.cc:2243] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.707763  7283 raft_consensus.cc:2272] T e974506c09fa4bc481abf11343fdbf3e P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.709620  7283 tablet_replica.cc:333] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.710254  7283 raft_consensus.cc:2243] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.710678  7283 raft_consensus.cc:2272] T cd9a5b7830c74a849bdaee0374a8cabf P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.712512  7283 tablet_replica.cc:333] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.713084  7283 raft_consensus.cc:2243] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.713532  7283 raft_consensus.cc:2272] T 2ef26422e31c46fe8f63d4388ae021a4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.715910  7283 tablet_replica.cc:333] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.716562  7283 raft_consensus.cc:2243] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.717374  7283 raft_consensus.cc:2272] T 54fb16a8c2034fd2bbc250bf493ee9ca P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.719456  7283 tablet_replica.cc:333] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.720052  7283 raft_consensus.cc:2243] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.720849  7283 raft_consensus.cc:2272] T 10a7704202b34ee8a6faee074094ba82 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.723024  7283 tablet_replica.cc:333] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.723541  7283 raft_consensus.cc:2243] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.723954  7283 raft_consensus.cc:2272] T 2bc6c842bcd947ef97971e5b80b2fce4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.725842  7283 tablet_replica.cc:333] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.726356  7283 raft_consensus.cc:2243] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.726722  7283 raft_consensus.cc:2272] T 160582a28a9446428b13a46b942d62dc P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.728667  7283 tablet_replica.cc:333] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.729208  7283 raft_consensus.cc:2243] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.729998  7283 raft_consensus.cc:2272] T 92c8aaedf9904579b4f3e13ba43661bc P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.730728 14927 raft_consensus.cc:493] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:30.731242 14927 raft_consensus.cc:515] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:30.732673  7283 tablet_replica.cc:333] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.733844  7283 raft_consensus.cc:2243] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.734345  7283 raft_consensus.cc:2272] T 7beb6d7b3ddc4918809eb22abca298db P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.737203  7283 tablet_replica.cc:333] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.737959  7283 raft_consensus.cc:2243] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.738504  7283 raft_consensus.cc:2272] T b40d85c0caf94564b29d7771bd4691f4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.740563 14927 leader_election.cc:290] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:30.741245  7283 tablet_replica.cc:333] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
W20260709 13:04:30.741218 13981 leader_election.cc:336] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:30.742025 13979 leader_election.cc:336] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Network error: Client connection negotiation failed: client connection to 127.7.28.195:39185: connect: Connection refused (error 111)
I20260709 13:04:30.742265  7283 raft_consensus.cc:2243] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.742436 13979 leader_election.cc:304] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:30.742919  7283 raft_consensus.cc:2272] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.743259 14927 raft_consensus.cc:2706] T 2834b53c6ebc41a7998a283270aaa5ee P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Received pre-election callback for term 4 while not running: Illegal state: RaftConsensus is not running: State = Stopped
W20260709 13:04:30.744755 13979 consensus_peers.cc:597] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 -> Peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Couldn't send request to peer 48967ca777ee43ebaddd57da674bd3e1. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.195:39185: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.745414  7283 tablet_replica.cc:333] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.746120  7283 raft_consensus.cc:2243] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.746559  7283 raft_consensus.cc:2272] T 23ba395804274ae6b50899d3c4839734 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.747992 14927 raft_consensus.cc:493] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:30.748566  7283 tablet_replica.cc:333] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.748450 14927 raft_consensus.cc:515] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } } peers { permanent_uuid: "97c52f3e93434bedbdc9755e64f33d4f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 37379 } }
I20260709 13:04:30.749377  7283 raft_consensus.cc:2243] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.749943  7283 raft_consensus.cc:2272] T b86368c5ec644579a96e52be386c82f6 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.750630 14927 leader_election.cc:290] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245), 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379)
I20260709 13:04:30.752408  7283 tablet_replica.cc:333] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.753221  7283 raft_consensus.cc:2243] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.753822  7283 raft_consensus.cc:2272] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.755044 13981 leader_election.cc:336] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
W20260709 13:04:30.755613 13980 leader_election.cc:336] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97c52f3e93434bedbdc9755e64f33d4f (127.7.28.194:37379): Network error: Client connection negotiation failed: client connection to 127.7.28.194:37379: connect: Connection refused (error 111)
I20260709 13:04:30.755972 13980 leader_election.cc:304] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 97c52f3e93434bedbdc9755e64f33d4f, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:30.756333  7283 tablet_replica.cc:333] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
W20260709 13:04:30.756428 13980 raft_consensus.cc:2686] T 80485db7c3b94a4db01541f0e19253f4 P 26396ddd557646e98bdbd64eba197c05: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:30.757018  7283 raft_consensus.cc:2243] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.757772  7283 raft_consensus.cc:2272] T 17b2ce1afe6d47889a4314aacc80c2d1 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.759743  7283 tablet_replica.cc:333] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.760479  7283 raft_consensus.cc:2243] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.760946  7283 raft_consensus.cc:2272] T b83902dd19424f4d9f3707d53bafb0b5 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.763569  7283 tablet_replica.cc:333] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.764420  7283 raft_consensus.cc:2243] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.764900  7283 raft_consensus.cc:2272] T df17443f0bfc4fd69e14026addccdbf0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.766777  7283 tablet_replica.cc:333] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.767249  7283 raft_consensus.cc:2243] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.767614  7283 raft_consensus.cc:2272] T c9f494f81f71485b85b9551431ff68d0 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.769292  7283 tablet_replica.cc:333] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.769892  7283 raft_consensus.cc:2243] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.770275  7283 raft_consensus.cc:2272] T 10de0625f3be4f23896d250d94ffdd2a P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.772118  7283 tablet_replica.cc:333] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.772611  7283 raft_consensus.cc:2243] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.772981  7283 raft_consensus.cc:2272] T b443c5191ca74bf1afcc265171e53dd8 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.774909  7283 tablet_replica.cc:333] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.775393  7283 raft_consensus.cc:2243] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.776110  7283 raft_consensus.cc:2272] T ec8e2fbb0a1541e7b82f6112cabed288 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.778012  7283 tablet_replica.cc:333] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.778620  7283 raft_consensus.cc:2243] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.779397  7283 raft_consensus.cc:2272] T 8184075bc04f4f209f3b9d4f56d1522a P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.781263  7283 tablet_replica.cc:333] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.781867  7283 raft_consensus.cc:2243] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.782281  7283 raft_consensus.cc:2272] T e80b52ff804c4785baad8cca54adc6a4 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.784166  7283 tablet_replica.cc:333] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.784687  7283 raft_consensus.cc:2243] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.785548  7283 raft_consensus.cc:2272] T f3d96cc6c31040cead99c79b8a080c49 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.787371  7283 tablet_replica.cc:333] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.787914  7283 raft_consensus.cc:2243] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.788329  7283 raft_consensus.cc:2272] T 8809c926517048778c24dfaab0d66305 P 26396ddd557646e98bdbd64eba197c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.790132  7283 tablet_replica.cc:333] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.790653  7283 raft_consensus.cc:2243] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.791067  7283 raft_consensus.cc:2272] T 88d02328b2b94a7092dbb3d0645862c0 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.792814  7283 tablet_replica.cc:333] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.793499  7283 raft_consensus.cc:2243] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.794411  7283 raft_consensus.cc:2272] T b33baea2ddc640ee86529fb3d422c920 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.796732  7283 tablet_replica.cc:333] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.797291  7283 raft_consensus.cc:2243] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.797756  7283 raft_consensus.cc:2272] T ea20a419556e46b0b003c05c54815dc6 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.799578  7283 tablet_replica.cc:333] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.800127  7283 raft_consensus.cc:2243] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.800544  7283 raft_consensus.cc:2272] T 71bebeea22ca415e8b677798ee3cea04 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.802322  7283 tablet_replica.cc:333] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.802889  7283 raft_consensus.cc:2243] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.803365  7283 raft_consensus.cc:2272] T 84199221e2c348f0a790594df18c571e P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.805344  7283 tablet_replica.cc:333] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.805964  7283 raft_consensus.cc:2243] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.806428  7283 raft_consensus.cc:2272] T 17b73e3362554ac58453d81770b9ad6f P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.809024  7283 tablet_replica.cc:333] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.809716  7283 raft_consensus.cc:2243] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.810767  7283 raft_consensus.cc:2272] T 217b4b051be04869b067d3f67aa80a4e P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.812871  7283 tablet_replica.cc:333] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.813347  7283 raft_consensus.cc:2243] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.813717  7283 raft_consensus.cc:2272] T bc903e0b117245dbaafd89c8bcf21cb5 P 26396ddd557646e98bdbd64eba197c05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.815616  7283 tablet_replica.cc:333] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.816107  7283 raft_consensus.cc:2243] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.816808  7283 raft_consensus.cc:2272] T d165767a6eb84e0ab6e475cb48c542ae P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.818804  7283 tablet_replica.cc:333] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.819269  7283 raft_consensus.cc:2243] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.819717  7283 raft_consensus.cc:2272] T 9da06c8013b34581b8df0cae992146fd P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.821738  7283 tablet_replica.cc:333] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.822263  7283 raft_consensus.cc:2243] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.822883 14927 raft_consensus.cc:493] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce171b1b0d7341f59e3ba532f7b51d1b)
I20260709 13:04:30.823113  7283 raft_consensus.cc:2272] T 2e88dc464675442b8c7152dbf45e7b8b P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.823431 14927 raft_consensus.cc:515] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48967ca777ee43ebaddd57da674bd3e1" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 39185 } } peers { permanent_uuid: "26396ddd557646e98bdbd64eba197c05" member_type: VOTER last_known_addr { host: "127.7.28.196" port: 37991 } } peers { permanent_uuid: "ce171b1b0d7341f59e3ba532f7b51d1b" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 40245 } }
I20260709 13:04:30.825417  7283 tablet_replica.cc:333] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.825417 14927 leader_election.cc:290] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185), ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245)
I20260709 13:04:30.826416  7283 raft_consensus.cc:2243] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.826910  7283 raft_consensus.cc:2272] T a350bf7b4479428fa79f9b4aa9036423 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.829346 13981 leader_election.cc:336] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce171b1b0d7341f59e3ba532f7b51d1b (127.7.28.193:40245): Network error: Client connection negotiation failed: client connection to 127.7.28.193:40245: connect: Connection refused (error 111)
I20260709 13:04:30.829830  7283 tablet_replica.cc:333] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.830545  7283 raft_consensus.cc:2243] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:30.830579 13979 leader_election.cc:336] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 48967ca777ee43ebaddd57da674bd3e1 (127.7.28.195:39185): Network error: Client connection negotiation failed: client connection to 127.7.28.195:39185: connect: Connection refused (error 111)
I20260709 13:04:30.831059 13979 leader_election.cc:304] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26396ddd557646e98bdbd64eba197c05; no voters: 48967ca777ee43ebaddd57da674bd3e1, ce171b1b0d7341f59e3ba532f7b51d1b
I20260709 13:04:30.831389  7283 raft_consensus.cc:2272] T 894a0cf3d92b439ba443a8b917912a68 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.831629 14927 raft_consensus.cc:2749] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:30.833508  7283 tablet_replica.cc:333] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.834132  7283 raft_consensus.cc:2243] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.834606  7283 raft_consensus.cc:2272] T 31306f2bb4a647168863d2675faf7f05 P 26396ddd557646e98bdbd64eba197c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.836447  7283 tablet_replica.cc:333] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.836922  7283 raft_consensus.cc:2243] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.837643  7283 raft_consensus.cc:2272] T 4a7f9c6781bb4725847b8d5169cd3c02 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.839382  7283 tablet_replica.cc:333] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05: stopping tablet replica
I20260709 13:04:30.839819  7283 raft_consensus.cc:2243] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.840524  7283 raft_consensus.cc:2272] T 089b79bc7e3c4b9c9cd30f08cde86000 P 26396ddd557646e98bdbd64eba197c05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.914728  7283 tablet_server.cc:196] TabletServer@127.7.28.196:0 shutdown complete.
I20260709 13:04:30.977835  7283 master.cc:562] Master@127.7.28.254:46727 shutting down...
I20260709 13:04:31.003726  7283 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:31.004314  7283 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:31.004714  7283 tablet_replica.cc:333] T 00000000000000000000000000000000 P 136e4e7f3c974a86aef81c720891d47e: stopping tablet replica
I20260709 13:04:31.027010  7283 master.cc:584] Master@127.7.28.254:46727 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33725 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:04:31.116374  7283 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.28.254:34819
I20260709 13:04:31.117565  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:31.123883 14971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.123871 14972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.124974 14974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:31.125111  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:31.126459  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:31.126641  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:31.126752  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602271126741 us; error 0 us; skew 500 ppm
I20260709 13:04:31.127202  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:31.129503  7283 webserver.cc:533] Webserver started at http://127.7.28.254:45855/ using document root <none> and password file <none>
I20260709 13:04:31.130015  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:31.130177  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:31.130402  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:31.131572  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/master-0-root/instance:
uuid: "2b49d454095d4cb4ab8e1ed0136cdb16"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:31.136163  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:31.139765 14979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.140645  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:31.141013  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/master-0-root
uuid: "2b49d454095d4cb4ab8e1ed0136cdb16"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:31.141368  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:31.162856  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:31.164142  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:31.203176  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.254:34819
I20260709 13:04:31.203300 15030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.254:34819 every 8 connection(s)
I20260709 13:04:31.207182 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.218181 15031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16: Bootstrap starting.
I20260709 13:04:31.223202 15031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.227571 15031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16: No bootstrap required, opened a new log
I20260709 13:04:31.229760 15031 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b49d454095d4cb4ab8e1ed0136cdb16" member_type: VOTER }
I20260709 13:04:31.230195 15031 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.230371 15031 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b49d454095d4cb4ab8e1ed0136cdb16, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.230996 15031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b49d454095d4cb4ab8e1ed0136cdb16" member_type: VOTER }
I20260709 13:04:31.231562 15031 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:31.231771 15031 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:31.231978 15031 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.236752 15031 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b49d454095d4cb4ab8e1ed0136cdb16" member_type: VOTER }
I20260709 13:04:31.237248 15031 leader_election.cc:304] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b49d454095d4cb4ab8e1ed0136cdb16; no voters: 
I20260709 13:04:31.238330 15031 leader_election.cc:290] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:31.238770 15034 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.240257 15034 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 1 LEADER]: Becoming Leader. State: Replica: 2b49d454095d4cb4ab8e1ed0136cdb16, State: Running, Role: LEADER
I20260709 13:04:31.240942 15034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b49d454095d4cb4ab8e1ed0136cdb16" member_type: VOTER }
I20260709 13:04:31.241338 15031 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:31.245580 15036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b49d454095d4cb4ab8e1ed0136cdb16. Latest consensus state: current_term: 1 leader_uuid: "2b49d454095d4cb4ab8e1ed0136cdb16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b49d454095d4cb4ab8e1ed0136cdb16" member_type: VOTER } }
I20260709 13:04:31.246205 15035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b49d454095d4cb4ab8e1ed0136cdb16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b49d454095d4cb4ab8e1ed0136cdb16" member_type: VOTER } }
I20260709 13:04:31.246577 15036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:31.247035 15035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:31.249861 15041 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:31.254989 15041 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:31.258903  7283 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:31.264125 15041 catalog_manager.cc:1383] Generated new cluster ID: 0e02429521b4436eba2c845459a59d7d
I20260709 13:04:31.264431 15041 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:31.278954 15041 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:31.280306 15041 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:31.297612 15041 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16: Generated new TSK 0
I20260709 13:04:31.298372 15041 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:31.326134  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:31.332186 15052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.333365 15053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.335696 15055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:31.335698  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:31.337136  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:31.337386  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:31.337589  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602271337560 us; error 0 us; skew 500 ppm
I20260709 13:04:31.338186  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:31.340597  7283 webserver.cc:533] Webserver started at http://127.7.28.193:41019/ using document root <none> and password file <none>
I20260709 13:04:31.341097  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:31.341301  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:31.341588  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:31.342767  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root/instance:
uuid: "06fdeaa2b6a4470faa45a334d44397fc"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:31.347328  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:31.350978 15060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.351841  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:31.352252  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "06fdeaa2b6a4470faa45a334d44397fc"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:31.352609  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:31.396663  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:31.398067  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:31.399674  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:31.402141  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:31.402387  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.402661  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:31.402863  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.444986  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:34303
I20260709 13:04:31.445075 15122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:34303 every 8 connection(s)
I20260709 13:04:31.450090  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:31.456815 15127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.457902 15128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.461742 15130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:31.461776  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:31.463354  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:31.463590  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:31.463791  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602271463773 us; error 0 us; skew 500 ppm
I20260709 13:04:31.464525  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:31.466785 15123 heartbeater.cc:344] Connected to a master server at 127.7.28.254:34819
I20260709 13:04:31.467182 15123 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:31.467489  7283 webserver.cc:533] Webserver started at http://127.7.28.194:42037/ using document root <none> and password file <none>
I20260709 13:04:31.468075  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:31.468014 15123 heartbeater.cc:507] Master 127.7.28.254:34819 requested a full tablet report, sending...
I20260709 13:04:31.468475  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:31.468783  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:31.470048  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-1-root/instance:
uuid: "e2fddfc7789b46a08028bf85c3f99a00"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:31.470500 14996 ts_manager.cc:194] Registered new tserver with Master: 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303)
I20260709 13:04:31.472993 14996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50328
I20260709 13:04:31.476157  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:31.479664 15135 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.480544  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:31.480876  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-1-root
uuid: "e2fddfc7789b46a08028bf85c3f99a00"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:31.481251  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:31.505188  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:31.506644  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:31.508446  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:31.510825  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:31.511062  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.511332  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:31.511510  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.552301  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.194:41727
I20260709 13:04:31.552417 15197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.194:41727 every 8 connection(s)
I20260709 13:04:31.557327  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:31.564889 15201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.567413 15202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:31.567950  7283 server_base.cc:1061] running on GCE node
W20260709 13:04:31.569006 15204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:31.570309  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:31.570573  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:31.570791  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602271570770 us; error 0 us; skew 500 ppm
I20260709 13:04:31.571080 15198 heartbeater.cc:344] Connected to a master server at 127.7.28.254:34819
I20260709 13:04:31.571462  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:31.571506 15198 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:31.572535 15198 heartbeater.cc:507] Master 127.7.28.254:34819 requested a full tablet report, sending...
I20260709 13:04:31.574268  7283 webserver.cc:533] Webserver started at http://127.7.28.195:43083/ using document root <none> and password file <none>
I20260709 13:04:31.574910  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:31.574932 14996 ts_manager.cc:194] Registered new tserver with Master: e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:31.575155  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:31.575529  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:31.576529 14996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50340
I20260709 13:04:31.576745  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-2-root/instance:
uuid: "1838964b2aae45c28e801d9e5da69f01"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:31.581838  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:04:31.585502 15209 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.586381  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:31.586728  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-2-root
uuid: "1838964b2aae45c28e801d9e5da69f01"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:31.587059  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:31.598574  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:31.599835  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:31.601332  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:31.603662  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:31.603905  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.604161  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:31.604349  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.648622  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.195:32923
I20260709 13:04:31.648741 15271 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.195:32923 every 8 connection(s)
I20260709 13:04:31.662981 15272 heartbeater.cc:344] Connected to a master server at 127.7.28.254:34819
I20260709 13:04:31.663451 15272 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:31.664199 15272 heartbeater.cc:507] Master 127.7.28.254:34819 requested a full tablet report, sending...
I20260709 13:04:31.666162 14996 ts_manager.cc:194] Registered new tserver with Master: 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:31.666419  7283 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014904203s
I20260709 13:04:31.668016 14996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50344
I20260709 13:04:31.694928 14996 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50352:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:31.697916 14996 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:31.776512 15237 tablet_service.cc:1511] Processing CreateTablet for tablet d51af513a7ac41759dc6df639002bba1 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:31.778160 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51af513a7ac41759dc6df639002bba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.782991 15236 tablet_service.cc:1511] Processing CreateTablet for tablet 6c09d86d2e7b459f89c5b5ded871c216 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:31.783669 15234 tablet_service.cc:1511] Processing CreateTablet for tablet 0e55727326574cd3855d0279ebae337c (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:31.784626 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c09d86d2e7b459f89c5b5ded871c216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.785270 15234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e55727326574cd3855d0279ebae337c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.786919 15235 tablet_service.cc:1511] Processing CreateTablet for tablet c594d695e06b48c398968b370c298900 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:31.788480 15235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c594d695e06b48c398968b370c298900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.792260 15233 tablet_service.cc:1511] Processing CreateTablet for tablet 825a48f3e0104dac8c4da361de73ec52 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:31.793840 15233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825a48f3e0104dac8c4da361de73ec52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.795622 15163 tablet_service.cc:1511] Processing CreateTablet for tablet d51af513a7ac41759dc6df639002bba1 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:31.797035 15163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51af513a7ac41759dc6df639002bba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.796772 15161 tablet_service.cc:1511] Processing CreateTablet for tablet c594d695e06b48c398968b370c298900 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:31.798169 15161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c594d695e06b48c398968b370c298900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.798983 15232 tablet_service.cc:1511] Processing CreateTablet for tablet d16e2ada8c464687b12a10e7721a35d6 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:31.799193 15162 tablet_service.cc:1511] Processing CreateTablet for tablet 6c09d86d2e7b459f89c5b5ded871c216 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:31.800552 15232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16e2ada8c464687b12a10e7721a35d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.800771 15162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c09d86d2e7b459f89c5b5ded871c216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.803339 15231 tablet_service.cc:1511] Processing CreateTablet for tablet 712262456e0a449f8fdd3bc68606c014 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:31.804863 15231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712262456e0a449f8fdd3bc68606c014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.820744 15160 tablet_service.cc:1511] Processing CreateTablet for tablet 0e55727326574cd3855d0279ebae337c (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:31.822268 15160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e55727326574cd3855d0279ebae337c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.834261 15286 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:31.839794 15159 tablet_service.cc:1511] Processing CreateTablet for tablet 825a48f3e0104dac8c4da361de73ec52 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:31.841361 15159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825a48f3e0104dac8c4da361de73ec52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.845875 15158 tablet_service.cc:1511] Processing CreateTablet for tablet d16e2ada8c464687b12a10e7721a35d6 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:31.847585 15158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16e2ada8c464687b12a10e7721a35d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.851521 15286 tablet_bootstrap.cc:654] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.852813 15157 tablet_service.cc:1511] Processing CreateTablet for tablet 712262456e0a449f8fdd3bc68606c014 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:31.862339 15157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712262456e0a449f8fdd3bc68606c014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.867937 15235 tablet_service.cc:1511] Processing CreateTablet for tablet 70afda3f9ac9405593c54f4edefb498d (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:31.868327 15156 tablet_service.cc:1511] Processing CreateTablet for tablet 70afda3f9ac9405593c54f4edefb498d (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:31.869573 15235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70afda3f9ac9405593c54f4edefb498d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.867870 15161 tablet_service.cc:1511] Processing CreateTablet for tablet 714ba4c1394344b8a9537629229b1172 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:31.871627 15155 tablet_service.cc:1511] Processing CreateTablet for tablet 509899574a9e4fc3955ad3ee9c05e0ef (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:31.874523 15082 tablet_service.cc:1511] Processing CreateTablet for tablet 712262456e0a449f8fdd3bc68606c014 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:31.874836 15088 tablet_service.cc:1511] Processing CreateTablet for tablet d51af513a7ac41759dc6df639002bba1 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:31.876027 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712262456e0a449f8fdd3bc68606c014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.877244 15087 tablet_service.cc:1511] Processing CreateTablet for tablet 6c09d86d2e7b459f89c5b5ded871c216 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:31.866056 15237 tablet_service.cc:1511] Processing CreateTablet for tablet 714ba4c1394344b8a9537629229b1172 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:31.878734 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714ba4c1394344b8a9537629229b1172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.879076 15236 tablet_service.cc:1511] Processing CreateTablet for tablet 509899574a9e4fc3955ad3ee9c05e0ef (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:31.879803 15086 tablet_service.cc:1511] Processing CreateTablet for tablet c594d695e06b48c398968b370c298900 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:31.880364 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509899574a9e4fc3955ad3ee9c05e0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.882076 15085 tablet_service.cc:1511] Processing CreateTablet for tablet 0e55727326574cd3855d0279ebae337c (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:31.884363 15084 tablet_service.cc:1511] Processing CreateTablet for tablet 825a48f3e0104dac8c4da361de73ec52 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:31.878734 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c09d86d2e7b459f89c5b5ded871c216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.887666 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c594d695e06b48c398968b370c298900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.869714 15156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70afda3f9ac9405593c54f4edefb498d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.895016 15083 tablet_service.cc:1511] Processing CreateTablet for tablet d16e2ada8c464687b12a10e7721a35d6 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:31.895721 15287 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:31.896085 15080 tablet_service.cc:1511] Processing CreateTablet for tablet 70afda3f9ac9405593c54f4edefb498d (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:31.887938 15081 tablet_service.cc:1511] Processing CreateTablet for tablet 714ba4c1394344b8a9537629229b1172 (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:31.899097 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51af513a7ac41759dc6df639002bba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.899904 15161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714ba4c1394344b8a9537629229b1172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.900694 15155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509899574a9e4fc3955ad3ee9c05e0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.902374 15079 tablet_service.cc:1511] Processing CreateTablet for tablet 509899574a9e4fc3955ad3ee9c05e0ef (DEFAULT_TABLE table=test-workload [id=59d11d81333e493f901664d52c1bb104]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:31.903820 15079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509899574a9e4fc3955ad3ee9c05e0ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.904704 15080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70afda3f9ac9405593c54f4edefb498d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.905315 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714ba4c1394344b8a9537629229b1172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.907729 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16e2ada8c464687b12a10e7721a35d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.918172 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825a48f3e0104dac8c4da361de73ec52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.922199 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e55727326574cd3855d0279ebae337c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.950230 15286 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:31.950809 15286 ts_tablet_manager.cc:1403] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.010s
I20260709 13:04:31.954010 15286 raft_consensus.cc:359] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:31.954777 15286 raft_consensus.cc:385] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.955075 15286 raft_consensus.cc:740] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.955786 15286 consensus_queue.cc:260] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:31.981042 15287 tablet_bootstrap.cc:654] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.015904 15289 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.023277 15272 heartbeater.cc:499] Master 127.7.28.254:34819 was elected leader, sending a full tablet report...
I20260709 13:04:32.023993 15289 tablet_bootstrap.cc:654] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.025008 15286 ts_tablet_manager.cc:1434] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.074s	user 0.016s	sys 0.022s
I20260709 13:04:32.026566 15286 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.035497 15286 tablet_bootstrap.cc:654] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.035990 15287 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.036595 15287 ts_tablet_manager.cc:1403] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.009s
I20260709 13:04:32.036028 15289 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.039479 15289 ts_tablet_manager.cc:1403] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 13:04:32.039924 15287 raft_consensus.cc:359] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.040769 15287 raft_consensus.cc:385] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.041077 15287 raft_consensus.cc:740] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.041814 15286 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.041999 15287 consensus_queue.cc:260] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.042491 15286 ts_tablet_manager.cc:1403] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:04:32.042591 15289 raft_consensus.cc:359] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.043853 15289 raft_consensus.cc:385] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.044256 15289 raft_consensus.cc:740] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.045277 15289 consensus_queue.cc:260] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.046437 15286 raft_consensus.cc:359] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.047246 15286 raft_consensus.cc:385] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.047611 15286 raft_consensus.cc:740] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.048519 15286 consensus_queue.cc:260] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.051002 15286 ts_tablet_manager.cc:1434] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:32.052057 15286 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.058852 15286 tablet_bootstrap.cc:654] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.061358 15198 heartbeater.cc:499] Master 127.7.28.254:34819 was elected leader, sending a full tablet report...
I20260709 13:04:32.062286 15287 ts_tablet_manager.cc:1434] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:04:32.063932 15287 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.073467 15287 tablet_bootstrap.cc:654] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.083663 15123 heartbeater.cc:499] Master 127.7.28.254:34819 was elected leader, sending a full tablet report...
I20260709 13:04:32.084131 15289 ts_tablet_manager.cc:1434] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.044s	user 0.027s	sys 0.016s
I20260709 13:04:32.085285 15289 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.092212 15289 tablet_bootstrap.cc:654] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.100200 15286 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.100745 15286 ts_tablet_manager.cc:1403] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.049s	user 0.036s	sys 0.009s
I20260709 13:04:32.103061 15287 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.103695 15287 ts_tablet_manager.cc:1403] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.004s
I20260709 13:04:32.103770 15286 raft_consensus.cc:359] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.104655 15286 raft_consensus.cc:385] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.104964 15286 raft_consensus.cc:740] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.105929 15286 consensus_queue.cc:260] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.107379 15287 raft_consensus.cc:359] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.108327 15287 raft_consensus.cc:385] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.108692 15287 raft_consensus.cc:740] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.109527 15287 consensus_queue.cc:260] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.110638 15286 ts_tablet_manager.cc:1434] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:32.111737 15286 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.113267 15287 ts_tablet_manager.cc:1434] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:32.114394 15287 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.117308 15289 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.117911 15289 ts_tablet_manager.cc:1403] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.033s	user 0.026s	sys 0.003s
I20260709 13:04:32.118371 15286 tablet_bootstrap.cc:654] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.120782 15294 raft_consensus.cc:493] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.120877 15289 raft_consensus.cc:359] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.121390 15287 tablet_bootstrap.cc:654] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.121717 15289 raft_consensus.cc:385] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.122121 15289 raft_consensus.cc:740] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.121454 15294 raft_consensus.cc:515] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.122936 15289 consensus_queue.cc:260] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.125387 15289 ts_tablet_manager.cc:1434] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:32.126427 15289 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.125401 15294 leader_election.cc:290] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.132867 15289 tablet_bootstrap.cc:654] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.135432 15287 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.136165 15287 ts_tablet_manager.cc:1403] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:04:32.150197 15289 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.150817 15289 ts_tablet_manager.cc:1403] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.008s
W20260709 13:04:32.152622 15273 tablet.cc:2406] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:32.154079 15289 raft_consensus.cc:359] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.140226 15287 raft_consensus.cc:359] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.154970 15289 raft_consensus.cc:385] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.155282 15287 raft_consensus.cc:385] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.155325 15289 raft_consensus.cc:740] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.155895 15287 raft_consensus.cc:740] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.157008 15287 consensus_queue.cc:260] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.157812 15289 consensus_queue.cc:260] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.159507 15286 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.162189 15287 ts_tablet_manager.cc:1434] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:04:32.162362 15286 ts_tablet_manager.cc:1403] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.023s
I20260709 13:04:32.163306 15287 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.165565 15286 raft_consensus.cc:359] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.165850 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c594d695e06b48c398968b370c298900" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.169636 15286 raft_consensus.cc:385] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.170028 15286 raft_consensus.cc:740] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.160270 15289 ts_tablet_manager.cc:1434] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:04:32.170819 15286 consensus_queue.cc:260] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.172075 15289 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.173240 15286 ts_tablet_manager.cc:1434] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260709 13:04:32.174343 15286 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.178776 15289 tablet_bootstrap.cc:654] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.180492 15287 tablet_bootstrap.cc:654] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.180846 15286 tablet_bootstrap.cc:654] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:32.171087 15137 leader_election.cc:343] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.193993 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c594d695e06b48c398968b370c298900" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.194754 15247 raft_consensus.cc:2468] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 0.
I20260709 13:04:32.194911 15287 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.195562 15287 ts_tablet_manager.cc:1403] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.004s
I20260709 13:04:32.196076 15286 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.196008 15137 leader_election.cc:304] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 06fdeaa2b6a4470faa45a334d44397fc
I20260709 13:04:32.196969 15286 ts_tablet_manager.cc:1403] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 13:04:32.196251 15289 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.197221 15294 raft_consensus.cc:2804] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.197643 15294 raft_consensus.cc:493] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.197764 15289 ts_tablet_manager.cc:1403] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.005s
I20260709 13:04:32.198045 15294 raft_consensus.cc:3060] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.198607 15287 raft_consensus.cc:359] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.199368 15287 raft_consensus.cc:385] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.199652 15287 raft_consensus.cc:740] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.199887 15286 raft_consensus.cc:359] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.200600 15286 raft_consensus.cc:385] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.200400 15287 consensus_queue.cc:260] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.200979 15286 raft_consensus.cc:740] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.200910 15289 raft_consensus.cc:359] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.201749 15289 raft_consensus.cc:385] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.202087 15289 raft_consensus.cc:740] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.202116 15286 consensus_queue.cc:260] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.203027 15289 consensus_queue.cc:260] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.204819 15286 ts_tablet_manager.cc:1434] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:32.205883 15286 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.207682 15289 ts_tablet_manager.cc:1434] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:32.208815 15289 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.211374 15294 raft_consensus.cc:515] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.212235 15286 tablet_bootstrap.cc:654] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.215492 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c594d695e06b48c398968b370c298900" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
W20260709 13:04:32.217090 15137 leader_election.cc:343] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.219962 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c594d695e06b48c398968b370c298900" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:32.220571 15247 raft_consensus.cc:3060] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.221521 15289 tablet_bootstrap.cc:654] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.229948 15294 leader_election.cc:290] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.231957 15247 raft_consensus.cc:2468] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 1.
I20260709 13:04:32.243723 15137 leader_election.cc:304] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 06fdeaa2b6a4470faa45a334d44397fc
I20260709 13:04:32.245745 15294 raft_consensus.cc:2804] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.246505 15294 raft_consensus.cc:697] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:32.247831 15294 consensus_queue.cc:237] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.250465 15295 raft_consensus.cc:493] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.251236 15295 raft_consensus.cc:515] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
W20260709 13:04:32.256573 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:32.257591 15295 leader_election.cc:290] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.258671 15286 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.259232 15286 ts_tablet_manager.cc:1403] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.019s
I20260709 13:04:32.259537 15287 ts_tablet_manager.cc:1434] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.064s	user 0.017s	sys 0.018s
I20260709 13:04:32.260694 15287 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.262300 15286 raft_consensus.cc:359] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.263196 15286 raft_consensus.cc:385] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.263525 15286 raft_consensus.cc:740] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.264007 15289 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.264734 15289 ts_tablet_manager.cc:1403] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.027s
I20260709 13:04:32.264375 15286 consensus_queue.cc:260] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.266889 15286 ts_tablet_manager.cc:1434] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:32.267858 15286 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.273573 15290 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.274326 15290 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.275621 15286 tablet_bootstrap.cc:654] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.277087 15307 raft_consensus.cc:493] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.277663 15307 raft_consensus.cc:515] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.279925 15307 leader_election.cc:290] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.280313 15289 raft_consensus.cc:359] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.281122 15289 raft_consensus.cc:385] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.281412 15289 raft_consensus.cc:740] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.282691 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c09d86d2e7b459f89c5b5ded871c216" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.283450 15098 raft_consensus.cc:2468] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 0.
I20260709 13:04:32.284912 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c09d86d2e7b459f89c5b5ded871c216" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.285689 15247 raft_consensus.cc:2468] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 0.
I20260709 13:04:32.290205 15137 leader_election.cc:304] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.290501 15295 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.291898 15307 raft_consensus.cc:2804] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.292434 15307 raft_consensus.cc:493] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.292835 15307 raft_consensus.cc:3060] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.293231 15289 consensus_queue.cc:260] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.291399 15295 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.297029 15295 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.300630 15290 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.304102 14996 catalog_manager.cc:5697] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.304615 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509899574a9e4fc3955ad3ee9c05e0ef" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.306102 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.306687 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509899574a9e4fc3955ad3ee9c05e0ef" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.308732 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.309379 15247 raft_consensus.cc:2468] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fdeaa2b6a4470faa45a334d44397fc in term 0.
W20260709 13:04:32.310840 15062 leader_election.cc:343] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:32.311579 15062 leader_election.cc:343] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:32.312229 15062 leader_election.cc:343] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.312638 15062 leader_election.cc:304] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc; no voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:32.313642 15295 raft_consensus.cc:2749] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.313934 15062 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:32.316246 15314 raft_consensus.cc:2804] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.316658 15314 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.317027 15314 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.317232 15307 raft_consensus.cc:515] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.320590 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c09d86d2e7b459f89c5b5ded871c216" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:32.321199 15098 raft_consensus.cc:3060] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.323441 15289 ts_tablet_manager.cc:1434] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:04:32.324642 15289 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.330286 15098 raft_consensus.cc:2468] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 1.
I20260709 13:04:32.331475 15289 tablet_bootstrap.cc:654] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.334471 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c09d86d2e7b459f89c5b5ded871c216" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:32.335172 15247 raft_consensus.cc:3060] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.338366 15314 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.339576 15137 leader_election.cc:304] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.340963 15295 raft_consensus.cc:493] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.342260 15314 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 election: Requested vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.343146 15294 raft_consensus.cc:2804] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.342859 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:32.347958 15246 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.349050 15294 raft_consensus.cc:697] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:32.350417 15294 consensus_queue.cc:237] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.344164 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:32.345031 15295 raft_consensus.cc:515] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
W20260709 13:04:32.358501 15062 leader_election.cc:343] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.358693 15307 leader_election.cc:290] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.360954 15295 leader_election.cc:290] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.346841 15247 raft_consensus.cc:2468] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 1.
I20260709 13:04:32.362105 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.362295 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.363324 15290 raft_consensus.cc:493] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:32.363443 15062 leader_election.cc:343] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.363945 15290 raft_consensus.cc:515] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
W20260709 13:04:32.364425 15062 leader_election.cc:343] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.365031 15062 leader_election.cc:304] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc; no voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:32.365660 15286 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.366288 15286 ts_tablet_manager.cc:1403] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.099s	user 0.050s	sys 0.044s
I20260709 13:04:32.367455 15295 raft_consensus.cc:2749] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.370167 15286 raft_consensus.cc:359] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.366219 15290 leader_election.cc:290] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303)
I20260709 13:04:32.371404 15286 raft_consensus.cc:385] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.371775 15286 raft_consensus.cc:740] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.372582 15286 consensus_queue.cc:260] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.375461 15286 ts_tablet_manager.cc:1434] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:32.376690 15286 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.377722 15287 tablet_bootstrap.cc:654] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.384645 15286 tablet_bootstrap.cc:654] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.373528 15246 raft_consensus.cc:2468] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fdeaa2b6a4470faa45a334d44397fc in term 1.
I20260709 13:04:32.395900 15062 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:32.397718 15295 raft_consensus.cc:2804] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.398511 15295 raft_consensus.cc:697] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 LEADER]: Becoming Leader. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Running, Role: LEADER
I20260709 13:04:32.399744 15295 consensus_queue.cc:237] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.403030 15290 raft_consensus.cc:493] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.403613 15290 raft_consensus.cc:515] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.405890 15290 leader_election.cc:290] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.415256 15289 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.416138 15289 ts_tablet_manager.cc:1403] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.047s
I20260709 13:04:32.420604 15289 raft_consensus.cc:359] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.423031 15289 raft_consensus.cc:385] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.423491 15289 raft_consensus.cc:740] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.424132 15294 raft_consensus.cc:493] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.424701 15294 raft_consensus.cc:515] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.425570 15287 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.426116 15287 ts_tablet_manager.cc:1403] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.006s
I20260709 13:04:32.425168 15289 consensus_queue.cc:260] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.426863 15294 leader_election.cc:290] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.429381 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714ba4c1394344b8a9537629229b1172" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.429461 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714ba4c1394344b8a9537629229b1172" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.430171 15098 raft_consensus.cc:2468] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 0.
I20260709 13:04:32.428828 15289 ts_tablet_manager.cc:1434] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:04:32.431991 15137 leader_election.cc:304] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.432354 15289 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
W20260709 13:04:32.432915 15137 leader_election.cc:343] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.433203 15295 raft_consensus.cc:493] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.433673 15295 raft_consensus.cc:515] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.434441 15294 raft_consensus.cc:2804] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.434898 15294 raft_consensus.cc:493] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.435324 15294 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.436796 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c594d695e06b48c398968b370c298900" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.440364 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c594d695e06b48c398968b370c298900" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.441193 15246 raft_consensus.cc:2393] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06fdeaa2b6a4470faa45a334d44397fc in current term 1: Already voted for candidate e2fddfc7789b46a08028bf85c3f99a00 in this term.
I20260709 13:04:32.442421 15062 leader_election.cc:304] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc; no voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:32.443403 15289 tablet_bootstrap.cc:654] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.443498 15314 raft_consensus.cc:3060] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.443621 15294 raft_consensus.cc:515] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.447804 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714ba4c1394344b8a9537629229b1172" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:32.448407 15098 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.451877 15314 raft_consensus.cc:2749] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.452790 15295 leader_election.cc:290] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.458482 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.459704 15098 raft_consensus.cc:2468] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 1.
I20260709 13:04:32.460915 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.462742 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.464318 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
W20260709 13:04:32.466266 15211 leader_election.cc:343] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.465250 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.464458 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.467664 15172 raft_consensus.cc:2468] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 0.
W20260709 13:04:32.467832 15211 leader_election.cc:343] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.469014 15211 leader_election.cc:304] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.469971 15290 raft_consensus.cc:2804] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.470362 15290 raft_consensus.cc:493] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.470177 15211 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01; no voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:32.470788 15290 raft_consensus.cc:3060] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.471894 15289 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.471716 15137 leader_election.cc:304] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.472491 15289 ts_tablet_manager.cc:1403] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.007s
I20260709 13:04:32.475221 15307 raft_consensus.cc:2804] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.475824 15307 raft_consensus.cc:697] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:32.478200 15307 consensus_queue.cc:237] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.475430 15287 raft_consensus.cc:359] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.479800 15287 raft_consensus.cc:385] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.479563 15290 raft_consensus.cc:515] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.480178 15287 raft_consensus.cc:740] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.480991 15287 consensus_queue.cc:260] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.481899 15290 leader_election.cc:290] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Requested vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303)
I20260709 13:04:32.482551 15290 raft_consensus.cc:2749] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:32.483693 15211 leader_election.cc:343] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:32.484663 15211 leader_election.cc:343] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.475767 15289 raft_consensus.cc:359] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.486132 15289 raft_consensus.cc:385] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.486640 15289 raft_consensus.cc:740] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.485029 15211 leader_election.cc:304] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01; no voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:32.487762 15287 ts_tablet_manager.cc:1434] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 13:04:32.488819 15287 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.490352 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:32.491528 15286 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.490476 14995 catalog_manager.cc:5697] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193). New cstate: current_term: 1 leader_uuid: "06fdeaa2b6a4470faa45a334d44397fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.492049 15286 ts_tablet_manager.cc:1403] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.116s	user 0.031s	sys 0.056s
I20260709 13:04:32.492494 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:32.493146 15172 raft_consensus.cc:3060] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.495090 15286 raft_consensus.cc:359] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.495848 15286 raft_consensus.cc:385] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.496121 15286 raft_consensus.cc:740] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.496380 15287 tablet_bootstrap.cc:654] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.496853 15286 consensus_queue.cc:260] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.498100 15327 raft_consensus.cc:2749] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.502221 15289 consensus_queue.cc:260] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
W20260709 13:04:32.501298 15211 leader_election.cc:343] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.509963 15294 leader_election.cc:290] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.512224 15289 ts_tablet_manager.cc:1434] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.005s
I20260709 13:04:32.513604 15289 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.514737 15286 ts_tablet_manager.cc:1434] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.006s
I20260709 13:04:32.515798 15286 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.515652 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714ba4c1394344b8a9537629229b1172" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:32.516324 15246 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.521178 15289 tablet_bootstrap.cc:654] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.521693 15172 raft_consensus.cc:2468] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 1.
I20260709 13:04:32.523351 15286 tablet_bootstrap.cc:654] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.533157 15286 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.532822 15211 leader_election.cc:304] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 06fdeaa2b6a4470faa45a334d44397fc
I20260709 13:04:32.533707 15286 ts_tablet_manager.cc:1403] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:04:32.533977 15290 raft_consensus.cc:2804] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.534544 15290 raft_consensus.cc:697] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:32.535475 15246 raft_consensus.cc:2468] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 1.
I20260709 13:04:32.535418 15290 consensus_queue.cc:237] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.536587 15286 raft_consensus.cc:359] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.537297 15286 raft_consensus.cc:385] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.537997 14992 catalog_manager.cc:5697] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.539707 15287 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.540267 15287 ts_tablet_manager.cc:1403] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.008s
I20260709 13:04:32.537549 15286 raft_consensus.cc:740] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.541633 15286 consensus_queue.cc:260] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.539943 14992 catalog_manager.cc:5697] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.544529 15286 ts_tablet_manager.cc:1434] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:32.545826 15286 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01: Bootstrap starting.
I20260709 13:04:32.548722 15289 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.549288 15289 ts_tablet_manager.cc:1403] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.003s
I20260709 13:04:32.549708 15287 raft_consensus.cc:359] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.550529 15287 raft_consensus.cc:385] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.550817 15287 raft_consensus.cc:740] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.551709 15287 consensus_queue.cc:260] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.552014 15289 raft_consensus.cc:359] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.552731 15289 raft_consensus.cc:385] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.553018 15289 raft_consensus.cc:740] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.553128 15286 tablet_bootstrap.cc:654] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.554462 15287 ts_tablet_manager.cc:1434] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:04:32.555584 15287 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.555639 15289 consensus_queue.cc:260] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.561281 15289 ts_tablet_manager.cc:1434] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:32.562351 15289 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.562847 15287 tablet_bootstrap.cc:654] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.568233 15286 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01: No bootstrap required, opened a new log
I20260709 13:04:32.568738 15286 ts_tablet_manager.cc:1403] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 13:04:32.570968 15289 tablet_bootstrap.cc:654] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.572880 15286 raft_consensus.cc:359] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.573606 15286 raft_consensus.cc:385] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.576036 15286 raft_consensus.cc:740] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.575505 14992 catalog_manager.cc:5697] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.577041 15286 consensus_queue.cc:260] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.580241 15287 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.580783 15287 ts_tablet_manager.cc:1403] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.005s
I20260709 13:04:32.580927 15289 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.581403 15289 ts_tablet_manager.cc:1403] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 13:04:32.583923 15287 raft_consensus.cc:359] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.584096 15289 raft_consensus.cc:359] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.584789 15287 raft_consensus.cc:385] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.584837 15289 raft_consensus.cc:385] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.585240 15287 raft_consensus.cc:740] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.585299 15289 raft_consensus.cc:740] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.586225 15289 consensus_queue.cc:260] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.586206 15287 consensus_queue.cc:260] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.587481 15286 ts_tablet_manager.cc:1434] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:04:32.589000 15287 ts_tablet_manager.cc:1434] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:32.590108 15287 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.591051 15289 ts_tablet_manager.cc:1434] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:32.592010 15289 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:32.596048 15290 raft_consensus.cc:493] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.596421 15287 tablet_bootstrap.cc:654] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.596652 15290 raft_consensus.cc:515] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.597455 15289 tablet_bootstrap.cc:654] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.598914 15290 leader_election.cc:290] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.600354 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.600835 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.601058 15172 raft_consensus.cc:2468] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 0.
I20260709 13:04:32.601526 15095 raft_consensus.cc:2468] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 0.
I20260709 13:04:32.602386 15211 leader_election.cc:304] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.606251 15290 raft_consensus.cc:2804] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.606653 15290 raft_consensus.cc:493] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.607007 15290 raft_consensus.cc:3060] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.610471 15287 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.611203 15287 ts_tablet_manager.cc:1403] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 13:04:32.615432 15287 raft_consensus.cc:359] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.616394 15287 raft_consensus.cc:385] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.616746 15287 raft_consensus.cc:740] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.617472 15290 raft_consensus.cc:515] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.617627 15287 consensus_queue.cc:260] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.619724 15290 leader_election.cc:290] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.619781 15287 ts_tablet_manager.cc:1434] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:32.620903 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:32.621361 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:32.621544 15095 raft_consensus.cc:3060] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.622112 15289 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: No bootstrap required, opened a new log
I20260709 13:04:32.622079 15172 raft_consensus.cc:3060] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.624614 15289 ts_tablet_manager.cc:1403] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.012s
I20260709 13:04:32.627447 15289 raft_consensus.cc:359] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.628188 15289 raft_consensus.cc:385] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.628530 15289 raft_consensus.cc:740] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.629379 15172 raft_consensus.cc:2468] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 1.
I20260709 13:04:32.629225 15289 consensus_queue.cc:260] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.630679 15211 leader_election.cc:304] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.631552 15289 ts_tablet_manager.cc:1434] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:32.631601 15290 raft_consensus.cc:2804] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.629379 15095 raft_consensus.cc:2468] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 1.
I20260709 13:04:32.633108 15327 raft_consensus.cc:493] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.633421 15290 raft_consensus.cc:697] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:32.634125 15327 raft_consensus.cc:515] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.634778 15290 consensus_queue.cc:237] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.636217 15327 leader_election.cc:290] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.629827 15287 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.637949 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.638609 15096 raft_consensus.cc:2468] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 0.
I20260709 13:04:32.640581 15211 leader_election.cc:304] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:32.641287 15327 raft_consensus.cc:2804] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.641682 15327 raft_consensus.cc:493] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.642323 15307 raft_consensus.cc:493] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.642951 15307 raft_consensus.cc:515] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.644240 15287 tablet_bootstrap.cc:654] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.644968 15307 leader_election.cc:290] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.644766 14995 catalog_manager.cc:5697] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.646996 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.649111 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.649312 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.649828 15096 raft_consensus.cc:2468] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 0.
I20260709 13:04:32.650210 15327 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.651599 15137 leader_election.cc:304] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.652400 15307 consensus_queue.cc:1048] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.650229 15172 raft_consensus.cc:2468] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 0.
I20260709 13:04:32.651640 15287 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.654850 15287 ts_tablet_manager.cc:1403] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:04:32.655777 15294 raft_consensus.cc:2804] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.658087 15327 raft_consensus.cc:515] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.659381 15246 raft_consensus.cc:2393] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2fddfc7789b46a08028bf85c3f99a00 in current term 1: Already voted for candidate 1838964b2aae45c28e801d9e5da69f01 in this term.
I20260709 13:04:32.660647 15307 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.662052 15307 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.664923 15307 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.665148 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:32.665055 15287 raft_consensus.cc:359] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.665869 15287 raft_consensus.cc:385] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.666364 15327 leader_election.cc:290] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.666268 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.666721 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.665906 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:32.665910 15172 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.667528 15245 raft_consensus.cc:2393] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2fddfc7789b46a08028bf85c3f99a00 in current term 1: Already voted for candidate 06fdeaa2b6a4470faa45a334d44397fc in this term.
I20260709 13:04:32.667784 15095 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.674010 15137 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2fddfc7789b46a08028bf85c3f99a00; no voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:32.666231 15287 raft_consensus.cc:740] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.675318 15287 consensus_queue.cc:260] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.675961 15172 raft_consensus.cc:2468] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 1.
I20260709 13:04:32.676548 15294 raft_consensus.cc:493] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.677115 15294 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.678074 15287 ts_tablet_manager.cc:1434] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.004s
I20260709 13:04:32.679164 15287 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00: Bootstrap starting.
I20260709 13:04:32.680207 15211 leader_election.cc:304] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.681113 15327 raft_consensus.cc:2804] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.681610 15327 raft_consensus.cc:697] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:32.676247 15307 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.682467 15327 consensus_queue.cc:237] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.685230 15095 raft_consensus.cc:2468] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 1.
I20260709 13:04:32.690100 15287 tablet_bootstrap.cc:654] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.692119 15294 raft_consensus.cc:515] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.695348 15307 raft_consensus.cc:2749] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.697919 15287 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00: No bootstrap required, opened a new log
I20260709 13:04:32.698529 15287 ts_tablet_manager.cc:1403] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:04:32.698930 15294 leader_election.cc:290] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.700732 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:32.700981 15287 raft_consensus.cc:359] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.701423 15095 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.701660 15287 raft_consensus.cc:385] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.702080 15287 raft_consensus.cc:740] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.702189 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:32.702879 15287 consensus_queue.cc:260] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.705053 15287 ts_tablet_manager.cc:1434] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:04:32.712798 14993 catalog_manager.cc:5697] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.714704 15318 consensus_queue.cc:1048] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.717351 15095 raft_consensus.cc:2468] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 2.
I20260709 13:04:32.718806 15137 leader_election.cc:304] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:32.719601 15318 raft_consensus.cc:2804] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.720112 15318 raft_consensus.cc:697] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:32.722178 15318 consensus_queue.cc:237] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.741887 14995 catalog_manager.cc:5697] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 1 to 2, leader changed from 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195) to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.758159 15295 raft_consensus.cc:493] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.758731 15295 raft_consensus.cc:515] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.760465 15295 leader_election.cc:290] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.761255 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.761515 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.762049 15172 raft_consensus.cc:2468] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fdeaa2b6a4470faa45a334d44397fc in term 0.
I20260709 13:04:32.762187 15246 raft_consensus.cc:2468] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06fdeaa2b6a4470faa45a334d44397fc in term 0.
I20260709 13:04:32.763435 15062 leader_election.cc:304] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:32.764364 15295 raft_consensus.cc:2804] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.764720 15295 raft_consensus.cc:493] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.764999 15295 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.770013 15295 raft_consensus.cc:515] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.771785 15295 leader_election.cc:290] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 election: Requested vote from peers e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.772768 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:32.773000 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:32.773310 15172 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.773711 15246 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.778493 15172 raft_consensus.cc:2468] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fdeaa2b6a4470faa45a334d44397fc in term 1.
I20260709 13:04:32.779313 15246 raft_consensus.cc:2468] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06fdeaa2b6a4470faa45a334d44397fc in term 1.
I20260709 13:04:32.779650 15062 leader_election.cc:304] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.780524 15295 raft_consensus.cc:2804] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.780992 15295 raft_consensus.cc:697] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 LEADER]: Becoming Leader. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Running, Role: LEADER
I20260709 13:04:32.781682 15295 consensus_queue.cc:237] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.790241 14995 catalog_manager.cc:5697] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193). New cstate: current_term: 1 leader_uuid: "06fdeaa2b6a4470faa45a334d44397fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.807224 15318 consensus_queue.cc:1048] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.819960 15318 consensus_queue.cc:1048] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.826412 15307 raft_consensus.cc:493] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.827028 15307 raft_consensus.cc:515] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.829430 15307 leader_election.cc:290] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.830147 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.830422 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.830890 15095 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 0.
I20260709 13:04:32.831071 15246 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 0.
I20260709 13:04:32.831920 15137 leader_election.cc:304] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.832713 15307 raft_consensus.cc:2804] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.833073 15307 raft_consensus.cc:493] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.833401 15307 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.838749 15307 raft_consensus.cc:515] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.840440 15307 leader_election.cc:290] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:32.841174 15095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:32.841526 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:32.841764 15095 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.842223 15246 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.847622 15246 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 1.
I20260709 13:04:32.847772 15095 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 1.
I20260709 13:04:32.848811 15137 leader_election.cc:304] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:32.849545 15307 raft_consensus.cc:2804] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.850044 15307 raft_consensus.cc:697] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:32.850721 15307 consensus_queue.cc:237] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.855337 15295 raft_consensus.cc:493] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.855952 15295 raft_consensus.cc:515] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:32.857914 15295 leader_election.cc:290] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.858888 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.858747 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1" candidate_uuid: "06fdeaa2b6a4470faa45a334d44397fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:32.859845 15172 raft_consensus.cc:2393] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06fdeaa2b6a4470faa45a334d44397fc in current term 1: Already voted for candidate 1838964b2aae45c28e801d9e5da69f01 in this term.
I20260709 13:04:32.859403 14993 catalog_manager.cc:5697] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.860900 15062 leader_election.cc:304] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc; no voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:32.861589 15295 raft_consensus.cc:3060] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.868244 15295 raft_consensus.cc:2749] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.900548 15307 consensus_queue.cc:1048] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.903695 15327 raft_consensus.cc:493] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.904325 15327 raft_consensus.cc:515] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.906597 15327 leader_election.cc:290] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.908397 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509899574a9e4fc3955ad3ee9c05e0ef" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc" is_pre_election: true
I20260709 13:04:32.909127 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509899574a9e4fc3955ad3ee9c05e0ef" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:32.909163 15096 raft_consensus.cc:2468] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 0.
I20260709 13:04:32.909884 15172 raft_consensus.cc:2468] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 0.
I20260709 13:04:32.910908 15211 leader_election.cc:304] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:32.910956 15344 consensus_queue.cc:1048] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.912427 15327 raft_consensus.cc:2804] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.913302 15327 raft_consensus.cc:493] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.913694 15327 raft_consensus.cc:3060] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.926199 15327 raft_consensus.cc:515] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.927784 15327 leader_election.cc:290] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:32.928581 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509899574a9e4fc3955ad3ee9c05e0ef" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:32.929071 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509899574a9e4fc3955ad3ee9c05e0ef" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:32.929433 15096 raft_consensus.cc:3060] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.929734 15172 raft_consensus.cc:3060] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.936642 15172 raft_consensus.cc:2468] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 1.
I20260709 13:04:32.936646 15096 raft_consensus.cc:2468] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 1.
I20260709 13:04:32.938084 15211 leader_election.cc:304] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:32.938717 15327 raft_consensus.cc:2804] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.939182 15327 raft_consensus.cc:697] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:32.939857 15327 consensus_queue.cc:237] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:32.947000 14995 catalog_manager.cc:5697] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.995036 15295 consensus_queue.cc:1048] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.008913 15358 consensus_queue.cc:1048] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.042498 15327 consensus_queue.cc:1048] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.054363 15361 consensus_queue.cc:1048] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.072243 15361 consensus_queue.cc:1048] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.084699 15364 consensus_queue.cc:1048] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.119575 15096 raft_consensus.cc:1275] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:33.121106 15307 consensus_queue.cc:1048] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.130443 15246 raft_consensus.cc:3055] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:33.130861 15246 raft_consensus.cc:740] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:33.131708 15246 consensus_queue.cc:260] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:33.132859 15246 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.140878 15246 raft_consensus.cc:1275] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:04:33.141242 15246 pending_rounds.cc:85] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01: Aborting all ops after (but not including) 0
I20260709 13:04:33.141482 15246 pending_rounds.cc:107] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:33.141759 15246 raft_consensus.cc:2889] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:33.142426  7283 ts_manager.cc:295] Set tserver state for 06fdeaa2b6a4470faa45a334d44397fc to MAINTENANCE_MODE
I20260709 13:04:33.143527  7283 tablet_server.cc:179] TabletServer@127.7.28.193:0 shutting down...
I20260709 13:04:33.143572 15307 consensus_queue.cc:1048] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.182641  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.183398  7283 tablet_replica.cc:333] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.184075  7283 raft_consensus.cc:2243] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.184624  7283 raft_consensus.cc:2272] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.187592  7283 tablet_replica.cc:333] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.188563  7283 raft_consensus.cc:2243] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.189306  7283 pending_rounds.cc:70] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Trying to abort 1 pending ops.
I20260709 13:04:33.189509  7283 pending_rounds.cc:77] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634909323055104 op_type: NO_OP noop_request { }
I20260709 13:04:33.189934  7283 raft_consensus.cc:2889] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:33.190248  7283 raft_consensus.cc:2272] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.191210 15137 consensus_peers.cc:597] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.192871  7283 tablet_replica.cc:333] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.193579  7283 raft_consensus.cc:2243] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.194038  7283 raft_consensus.cc:2272] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.195845  7283 tablet_replica.cc:333] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.196456  7283 raft_consensus.cc:2243] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.197031  7283 raft_consensus.cc:2272] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.199344  7283 tablet_replica.cc:333] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.199859  7283 raft_consensus.cc:2243] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.200232  7283 raft_consensus.cc:2272] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.202421  7283 tablet_replica.cc:333] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.202966  7283 raft_consensus.cc:2243] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.203320  7283 raft_consensus.cc:2272] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.205472  7283 tablet_replica.cc:333] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.206295  7283 raft_consensus.cc:2243] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.207072  7283 raft_consensus.cc:2272] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.209280  7283 tablet_replica.cc:333] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.209764  7283 raft_consensus.cc:2243] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.210225  7283 raft_consensus.cc:2272] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.212520  7283 tablet_replica.cc:333] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.213008  7283 raft_consensus.cc:2243] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.213361  7283 raft_consensus.cc:2272] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.215901  7283 tablet_replica.cc:333] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: stopping tablet replica
I20260709 13:04:33.216346  7283 raft_consensus.cc:2243] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.216673  7283 raft_consensus.cc:2272] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.247975  7283 tablet_server.cc:196] TabletServer@127.7.28.193:0 shutdown complete.
W20260709 13:04:33.257769 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:33.257951 15307 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:33.278292 15137 consensus_peers.cc:597] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.373231 15137 consensus_peers.cc:597] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.466601 15364 consensus_queue.cc:1048] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:33.478464 15137 consensus_peers.cc:597] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.486107 15211 consensus_peers.cc:597] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.523070 15211 consensus_peers.cc:597] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.639241 15211 consensus_peers.cc:597] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.744256 15137 consensus_peers.cc:597] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.258958 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:34.505556 15318 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06fdeaa2b6a4470faa45a334d44397fc)
I20260709 13:04:34.506198 15318 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
W20260709 13:04:34.506901 15137 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111) [suppressed 120 similar messages]
I20260709 13:04:34.507853 15318 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:34.509617 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
W20260709 13:04:34.511775 15137 leader_election.cc:336] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111)
I20260709 13:04:34.512274 15137 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2fddfc7789b46a08028bf85c3f99a00; no voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:34.512403 15290 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06fdeaa2b6a4470faa45a334d44397fc)
I20260709 13:04:34.513036 15318 raft_consensus.cc:2749] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:34.512990 15290 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:34.515112 15290 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:34.517503 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00" is_pre_election: true
I20260709 13:04:34.518263 15172 raft_consensus.cc:2468] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 1.
W20260709 13:04:34.519198 15211 leader_election.cc:336] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111)
I20260709 13:04:34.519963 15211 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 06fdeaa2b6a4470faa45a334d44397fc
I20260709 13:04:34.520627 15290 raft_consensus.cc:2804] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:34.520998 15290 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06fdeaa2b6a4470faa45a334d44397fc)
I20260709 13:04:34.521284 15290 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:34.527144 15290 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:34.528908 15290 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:34.530459 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:34.531101 15172 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:34.532747 15211 leader_election.cc:336] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111)
I20260709 13:04:34.536659 15172 raft_consensus.cc:2468] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:34.537748 15211 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 06fdeaa2b6a4470faa45a334d44397fc
I20260709 13:04:34.538551 15290 raft_consensus.cc:2804] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:34.538996 15290 raft_consensus.cc:697] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:34.539785 15290 consensus_queue.cc:237] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:34.547716 14993 catalog_manager.cc:5697] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 1 to 2, leader changed from 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.777460 15307 raft_consensus.cc:493] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.777977 15307 raft_consensus.cc:515] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:34.780102 15307 leader_election.cc:290] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:34.781634 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01" is_pre_election: true
I20260709 13:04:34.782364 15246 raft_consensus.cc:2468] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 1.
I20260709 13:04:34.783416 15137 leader_election.cc:304] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:34.784108 15307 raft_consensus.cc:2804] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:34.784126 15137 leader_election.cc:336] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111)
I20260709 13:04:34.784448 15307 raft_consensus.cc:493] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.784813 15307 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:34.790273 15307 raft_consensus.cc:515] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:34.792510 15307 leader_election.cc:290] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:34.793489 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:34.794212 15246 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:34.795622 15137 leader_election.cc:336] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111)
I20260709 13:04:34.799610 15246 raft_consensus.cc:2468] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 2.
I20260709 13:04:34.800787 15137 leader_election.cc:304] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 06fdeaa2b6a4470faa45a334d44397fc
I20260709 13:04:34.801522 15307 raft_consensus.cc:2804] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:34.801978 15307 raft_consensus.cc:697] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:34.802716 15307 consensus_queue.cc:237] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:34.810446 14993 catalog_manager.cc:5697] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 1 to 2, leader changed from 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193) to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.063432 15172 raft_consensus.cc:1275] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.064916 15290 consensus_queue.cc:1048] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:35.083442 15211 consensus_peers.cc:597] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.194046 15245 raft_consensus.cc:1275] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:35.195886 15307 consensus_queue.cc:1048] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:35.213581 15137 consensus_peers.cc:597] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.260164 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:35.528718 15137 consensus_peers.cc:597] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.254370 15027 debug-util.cc:398] Leaking SignalData structure 0x7b080023b300 after lost signal to thread 7286
W20260709 13:04:36.255554 15027 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5c00 after lost signal to thread 15030
W20260709 13:04:36.256960 15027 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2fa0 after lost signal to thread 15197
W20260709 13:04:36.259130 15027 debug-util.cc:398] Leaking SignalData structure 0x7b080037dfc0 after lost signal to thread 15271
W20260709 13:04:36.270226 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:36.324848 15137 consensus_peers.cc:597] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.326205 15137 consensus_peers.cc:597] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.350909 15211 consensus_peers.cc:597] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.351868 15211 consensus_peers.cc:597] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.358906 15137 consensus_peers.cc:597] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.359411 15137 consensus_peers.cc:597] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.800547 15211 consensus_peers.cc:597] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:37.028795 15194 debug-util.cc:398] Leaking SignalData structure 0x7b0800364980 after lost signal to thread 7286
W20260709 13:04:37.029971 15194 debug-util.cc:398] Leaking SignalData structure 0x7b0800307bc0 after lost signal to thread 15030
W20260709 13:04:37.031054 15194 debug-util.cc:398] Leaking SignalData structure 0x7b0800051280 after lost signal to thread 15197
W20260709 13:04:37.032001 15194 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5620 after lost signal to thread 15271
W20260709 13:04:37.271541 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:37.877341 15211 consensus_peers.cc:597] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.273586 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:38.292006 15137 consensus_peers.cc:597] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.418022 15137 consensus_peers.cc:597] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:38.617637 15211 consensus_peers.cc:597] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:38.652164 15137 consensus_peers.cc:597] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:38.830907 15137 consensus_peers.cc:597] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:38.871681 15137 consensus_peers.cc:597] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:38.897023 15137 consensus_peers.cc:597] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:38.930279 15211 consensus_peers.cc:597] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:39.042060  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:39.053366 15396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.068672 15397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.070036 15399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:39.071857  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:39.074033  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:39.074422  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:39.074671  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602279074654 us; error 0 us; skew 500 ppm
I20260709 13:04:39.075603  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:39.079958  7283 webserver.cc:533] Webserver started at http://127.7.28.193:41019/ using document root <none> and password file <none>
I20260709 13:04:39.080802  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:39.081076  7283 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:39.088047  7283 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:39.101058 15404 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.102180  7283 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:39.102612  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "06fdeaa2b6a4470faa45a334d44397fc"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-ll1f"
I20260709 13:04:39.103271  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:39.128814  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:39.130388  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:39.132354  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:39.137408 15411 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:04:39.202623  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:04:39.202976  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.067s	user 0.002s	sys 0.002s
I20260709 13:04:39.203302  7283 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:04:39.209723 15411 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.273389 15411 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:39.274938 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:39.281081 15411 tablet_bootstrap.cc:492] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.288082 15411 ts_tablet_manager.cc:1403] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.079s	user 0.026s	sys 0.035s
I20260709 13:04:39.294258 15411 raft_consensus.cc:359] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.295748 15411 raft_consensus.cc:740] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.296763 15411 consensus_queue.cc:260] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.316161 15411 ts_tablet_manager.cc:1434] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.014s
I20260709 13:04:39.317327 15411 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.317855  7283 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:04:39.318404  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.115s	user 0.071s	sys 0.006s
I20260709 13:04:39.381049 15411 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:39.382565 15411 tablet_bootstrap.cc:492] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.383579 15411 ts_tablet_manager.cc:1403] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.015s
I20260709 13:04:39.388454 15411 raft_consensus.cc:359] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.389853 15411 raft_consensus.cc:740] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.391162 15411 consensus_queue.cc:260] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.393942 15411 ts_tablet_manager.cc:1434] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.006s
I20260709 13:04:39.394914 15411 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.438803 15411 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:39.440269 15411 tablet_bootstrap.cc:492] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.441102 15411 ts_tablet_manager.cc:1403] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.010s
W20260709 13:04:39.441982 15211 consensus_peers.cc:597] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:39.444948 15411 raft_consensus.cc:359] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.446626 15411 raft_consensus.cc:740] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.448161 15411 consensus_queue.cc:260] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.452248 15411 ts_tablet_manager.cc:1434] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:39.455348 15411 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.483837 15411 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:39.485024 15411 tablet_bootstrap.cc:492] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.485824 15411 ts_tablet_manager.cc:1403] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:04:39.489039 15411 raft_consensus.cc:359] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.489961 15411 raft_consensus.cc:740] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.490844 15411 consensus_queue.cc:260] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.493434 15411 ts_tablet_manager.cc:1434] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:39.494481 15411 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.517549 15411 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:39.518710 15411 tablet_bootstrap.cc:492] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.519537 15411 ts_tablet_manager.cc:1403] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:04:39.522812 15411 raft_consensus.cc:359] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.523666 15411 raft_consensus.cc:740] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.524389 15411 consensus_queue.cc:260] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.526136 15411 ts_tablet_manager.cc:1434] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:39.527338 15411 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.554177 15411 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:39.555604 15411 tablet_bootstrap.cc:492] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.556670 15411 ts_tablet_manager.cc:1403] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.006s
I20260709 13:04:39.560732 15411 raft_consensus.cc:359] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.562659 15411 raft_consensus.cc:740] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.563737 15411 consensus_queue.cc:260] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.567214 15411 ts_tablet_manager.cc:1434] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:04:39.568480 15411 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.594004 15411 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:39.595443 15411 tablet_bootstrap.cc:492] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.596279 15411 ts_tablet_manager.cc:1403] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.006s
I20260709 13:04:39.599751 15411 raft_consensus.cc:359] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.600821 15411 raft_consensus.cc:740] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.602896 15411 consensus_queue.cc:260] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.611407 15411 ts_tablet_manager.cc:1434] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:04:39.612450 15411 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.639954 15411 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:39.641108 15411 tablet_bootstrap.cc:492] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.642218 15411 ts_tablet_manager.cc:1403] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.003s
I20260709 13:04:39.646257 15411 raft_consensus.cc:359] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:39.647300 15411 raft_consensus.cc:740] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.648267 15411 consensus_queue.cc:260] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:39.651652 15411 ts_tablet_manager.cc:1434] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:39.652976 15411 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
W20260709 13:04:39.654788 15137 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111) [suppressed 97 similar messages]
I20260709 13:04:39.681186 15411 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:39.682722 15411 tablet_bootstrap.cc:492] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.683781 15411 ts_tablet_manager.cc:1403] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.007s
I20260709 13:04:39.687794 15411 raft_consensus.cc:359] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.688879 15411 raft_consensus.cc:740] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.689857 15411 consensus_queue.cc:260] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.693023 15411 ts_tablet_manager.cc:1434] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:39.693977 15411 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap starting.
I20260709 13:04:39.721500 15411 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:39.722724 15411 tablet_bootstrap.cc:492] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Bootstrap complete.
I20260709 13:04:39.723519 15411 ts_tablet_manager.cc:1403] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.012s
I20260709 13:04:39.726316 15411 raft_consensus.cc:359] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.727120 15411 raft_consensus.cc:740] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06fdeaa2b6a4470faa45a334d44397fc, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.727964 15411 consensus_queue.cc:260] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.731019 15411 ts_tablet_manager.cc:1434] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:39.747383  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:34303
I20260709 13:04:39.747516 15479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:34303 every 8 connection(s)
I20260709 13:04:39.757387  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:39.806208 15480 heartbeater.cc:344] Connected to a master server at 127.7.28.254:34819
I20260709 13:04:39.806783 15480 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:39.808564 15480 heartbeater.cc:507] Master 127.7.28.254:34819 requested a full tablet report, sending...
I20260709 13:04:39.816138 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e55727326574cd3855d0279ebae337c"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
mode: GRACEFUL
new_leader_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:47126
I20260709 13:04:39.817013 15173 raft_consensus.cc:606] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Received request to transfer leadership to TS 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:39.817746 14995 ts_manager.cc:194] Re-registered known tserver with Master: 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303)
I20260709 13:04:39.820786 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
mode: GRACEFUL
new_leader_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:47126
I20260709 13:04:39.821614 15173 raft_consensus.cc:606] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Received request to transfer leadership to TS 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:39.823608  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:39.824373  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:39.825268  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:39.843406 14995 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57196
I20260709 13:04:39.850133 15480 heartbeater.cc:499] Master 127.7.28.254:34819 was elected leader, sending a full tablet report...
I20260709 13:04:39.865403 15428 raft_consensus.cc:993] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00: : Instructing follower 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:39.866051 15428 raft_consensus.cc:1081] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Signalling peer 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:39.868355 15247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e55727326574cd3855d0279ebae337c"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:04:39.869020 15247 raft_consensus.cc:493] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.869474 15247 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.881139 15247 raft_consensus.cc:515] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.894593 15247 leader_election.cc:290] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:39.897454 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:39.898295 15173 raft_consensus.cc:3055] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:39.898653 15173 raft_consensus.cc:740] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:39.899797 15173 consensus_queue.cc:260] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.901510 15173 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.909124 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:39.909989 15453 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.918560 15173 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:39.920363 15211 leader_election.cc:304] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:39.921535 15383 raft_consensus.cc:2804] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.921687 15453 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:39.930611 15383 raft_consensus.cc:697] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:39.931784 15383 consensus_queue.cc:237] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:39.942593 14995 catalog_manager.cc:5697] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 1 to 2, leader changed from e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.985904 15453 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.212028 15453 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.217871 15453 pending_rounds.cc:85] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Aborting all ops after (but not including) 0
I20260709 13:04:40.218161 15453 pending_rounds.cc:107] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:40.218652 15453 raft_consensus.cc:2889] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:40.222767 15428 raft_consensus.cc:993] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00: : Instructing follower 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:40.223502 15394 raft_consensus.cc:1081] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Signalling peer 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:40.225767 15247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:04:40.226424 15247 raft_consensus.cc:493] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.226812 15247 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:40.235827 15247 raft_consensus.cc:515] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:40.238538 15247 leader_election.cc:290] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 3 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:40.240576 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:40.240864 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825a48f3e0104dac8c4da361de73ec52" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:40.241313 15173 raft_consensus.cc:3055] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:40.241449 15453 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:40.241717 15173 raft_consensus.cc:740] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:40.242697 15173 consensus_queue.cc:260] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:40.244211 15173 raft_consensus.cc:3060] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:40.250666 15453 raft_consensus.cc:2468] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 3.
I20260709 13:04:40.252607 15211 leader_election.cc:304] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:40.253531 15173 raft_consensus.cc:2468] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 3.
I20260709 13:04:40.253863 15383 raft_consensus.cc:2804] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:40.254525 15383 raft_consensus.cc:697] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 3 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:40.255836 15383 consensus_queue.cc:237] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:40.267745 14995 catalog_manager.cc:5697] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 2 to 3, leader changed from e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:40.276108 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:40.505846 15173 raft_consensus.cc:1275] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.507251 15500 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.518244 15453 raft_consensus.cc:1275] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.520457 15489 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:40.643558 15453 raft_consensus.cc:1275] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:40.644958 15500 consensus_queue.cc:1048] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.652855 15173 raft_consensus.cc:1275] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:40.654873 15383 consensus_queue.cc:1048] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.853559  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:40.861351 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "714ba4c1394344b8a9537629229b1172"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
mode: GRACEFUL
new_leader_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:47126
I20260709 13:04:40.861970 15173 raft_consensus.cc:606] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Received request to transfer leadership to TS 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:40.874312 15247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
mode: GRACEFUL
new_leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:53184
I20260709 13:04:40.874982 15247 raft_consensus.cc:606] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Received request to transfer leadership to TS e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:40.877761 15247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
mode: GRACEFUL
new_leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:53184
I20260709 13:04:40.878407 15247 raft_consensus.cc:606] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Received request to transfer leadership to TS e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:40.879482  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:40.880057  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:40.880669  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:41.102264 15489 raft_consensus.cc:993] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01: : Instructing follower e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:41.102780 15489 raft_consensus.cc:1081] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Signalling peer e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:41.104221 15173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:33600
I20260709 13:04:41.104743 15173 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:41.105063 15173 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:41.110370 15173 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:41.112152 15173 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 3 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:41.113039 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:41.113201 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:41.113845 15453 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:41.113962 15247 raft_consensus.cc:3055] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:41.114409 15247 raft_consensus.cc:740] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:41.115185 15247 consensus_queue.cc:260] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:41.116163 15247 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:41.119603 15453 raft_consensus.cc:2468] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 3.
I20260709 13:04:41.120882 15137 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:41.121963 15499 raft_consensus.cc:2804] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:41.122027 15247 raft_consensus.cc:2468] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 3.
I20260709 13:04:41.122624 15499 raft_consensus.cc:697] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:41.123818 15499 consensus_queue.cc:237] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:41.131299 14993 catalog_manager.cc:5697] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 2 to 3, leader changed from 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195) to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 3 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.153074 15383 raft_consensus.cc:993] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01: : Instructing follower e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:41.153679 15489 raft_consensus.cc:1081] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Signalling peer e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:41.155437 15173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:33600
I20260709 13:04:41.155889 15173 raft_consensus.cc:493] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:41.156139 15173 raft_consensus.cc:3060] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.161500 15173 raft_consensus.cc:515] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:41.163506 15173 leader_election.cc:290] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: Requested vote from peers 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923), 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303)
I20260709 13:04:41.164399 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:41.164803 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51af513a7ac41759dc6df639002bba1" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:41.165097 15247 raft_consensus.cc:3055] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:41.165427 15453 raft_consensus.cc:3060] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.165472 15247 raft_consensus.cc:740] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:41.166497 15247 consensus_queue.cc:260] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:41.171957 15247 raft_consensus.cc:3060] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.173067 15453 raft_consensus.cc:2468] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 2.
I20260709 13:04:41.174018 15450 raft_consensus.cc:1240] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Rejecting Update request from peer 1838964b2aae45c28e801d9e5da69f01 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:41.174633 15137 leader_election.cc:304] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:41.175650 15499 raft_consensus.cc:2804] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:41.176189 15499 raft_consensus.cc:697] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:41.177174 15499 consensus_queue.cc:237] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } }
I20260709 13:04:41.179952 15247 raft_consensus.cc:2468] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 2.
I20260709 13:04:41.186257 14993 catalog_manager.cc:5697] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 1 to 2, leader changed from 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195) to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.234735 15394 raft_consensus.cc:993] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00: : Instructing follower 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:41.235242 15499 raft_consensus.cc:1081] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Signalling peer 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:41.236913 15247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "714ba4c1394344b8a9537629229b1172"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:04:41.237422 15247 raft_consensus.cc:493] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:41.237701 15247 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.243772 15247 raft_consensus.cc:515] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:41.245620 15247 leader_election.cc:290] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:41.246538 15450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714ba4c1394344b8a9537629229b1172" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:41.246791 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714ba4c1394344b8a9537629229b1172" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:41.247354 15450 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.247531 15173 raft_consensus.cc:3055] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:41.247967 15173 raft_consensus.cc:740] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:41.248672 15173 consensus_queue.cc:260] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:41.249753 15173 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.253729 15450 raft_consensus.cc:2468] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:41.254964 15173 raft_consensus.cc:2468] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:41.255084 15211 leader_election.cc:304] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:41.256078 15383 raft_consensus.cc:2804] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:41.256646 15383 raft_consensus.cc:697] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:41.257730 15383 consensus_queue.cc:237] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:41.266012 14993 catalog_manager.cc:5697] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 1 to 2, leader changed from e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:41.277184 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:41.684546 15450 raft_consensus.cc:1275] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:41.686070 15499 consensus_queue.cc:1048] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:41.690084 15453 raft_consensus.cc:1275] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.691732 15499 consensus_queue.cc:1048] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:41.699612 15453 raft_consensus.cc:1275] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.702746 15383 consensus_queue.cc:1048] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:41.713922 15247 raft_consensus.cc:1275] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:41.720014 15499 consensus_queue.cc:1048] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:41.728308 15173 raft_consensus.cc:1275] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.730494 15383 consensus_queue.cc:1048] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:41.751962 15247 raft_consensus.cc:1275] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.754277 15394 consensus_queue.cc:1048] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:41.887439  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:41.895103 15247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e55727326574cd3855d0279ebae337c"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
mode: GRACEFUL
new_leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:53184
I20260709 13:04:41.895754 15247 raft_consensus.cc:606] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Received request to transfer leadership to TS e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:41.898862 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c09d86d2e7b459f89c5b5ded871c216"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
mode: GRACEFUL
new_leader_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:47126
I20260709 13:04:41.899469 15173 raft_consensus.cc:606] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Received request to transfer leadership to TS 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:41.902688 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c594d695e06b48c398968b370c298900"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
mode: GRACEFUL
new_leader_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:47126
I20260709 13:04:41.903287 15173 raft_consensus.cc:606] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Received request to transfer leadership to TS 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:41.904462  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:41.904959  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:41.905526  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:42.149344 15523 raft_consensus.cc:993] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00: : Instructing follower 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:42.150023 15499 raft_consensus.cc:1081] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Signalling peer 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:42.151587 15247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c594d695e06b48c398968b370c298900"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:04:42.152107 15247 raft_consensus.cc:493] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.152436 15247 raft_consensus.cc:3060] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.157480 15247 raft_consensus.cc:515] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.159291 15247 leader_election.cc:290] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:42.160214 15450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c594d695e06b48c398968b370c298900" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:42.160424 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c594d695e06b48c398968b370c298900" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:42.160925 15450 raft_consensus.cc:3060] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.160939 15173 raft_consensus.cc:3055] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:42.161507 15173 raft_consensus.cc:740] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:42.162407 15173 consensus_queue.cc:260] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.163810 15173 raft_consensus.cc:3060] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.168697 15450 raft_consensus.cc:2468] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:42.170239 15211 leader_election.cc:304] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:42.171043 15383 raft_consensus.cc:2804] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.171113 15173 raft_consensus.cc:2468] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:42.171533 15383 raft_consensus.cc:697] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:42.172513 15383 consensus_queue.cc:237] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.179316 14995 catalog_manager.cc:5697] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 1 to 2, leader changed from e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.251096 15499 raft_consensus.cc:993] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00: : Instructing follower 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:42.251574 15394 raft_consensus.cc:1081] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Signalling peer 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:42.253381 15247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c09d86d2e7b459f89c5b5ded871c216"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:04:42.253952 15247 raft_consensus.cc:493] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.254319 15247 raft_consensus.cc:3060] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.257300 15489 raft_consensus.cc:993] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: : Instructing follower e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:42.258008 15489 raft_consensus.cc:1081] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Signalling peer e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:42.260116 15173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e55727326574cd3855d0279ebae337c"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:33600
I20260709 13:04:42.260664 15173 raft_consensus.cc:493] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.261001 15173 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.261906 15247 raft_consensus.cc:515] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.263967 15247 leader_election.cc:290] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:42.264531 15450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c09d86d2e7b459f89c5b5ded871c216" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:42.265208 15450 raft_consensus.cc:3060] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.267901 15171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c09d86d2e7b459f89c5b5ded871c216" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:42.268819 15171 raft_consensus.cc:3055] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:42.268278 15173 raft_consensus.cc:515] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.269598 15171 raft_consensus.cc:740] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:42.270606 15171 consensus_queue.cc:260] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.271277 15173 leader_election.cc:290] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 3 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:42.271873 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:42.272574 15453 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.273270 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:42.274354 15247 raft_consensus.cc:3055] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:42.274631 15247 raft_consensus.cc:740] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:42.275331 15247 consensus_queue.cc:260] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.276546 15247 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.271991 15171 raft_consensus.cc:3060] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:42.278200 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:42.283177 15247 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 3.
I20260709 13:04:42.284608 15137 leader_election.cc:304] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:42.284915 15171 raft_consensus.cc:2468] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:42.285552 15499 raft_consensus.cc:2804] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:42.286125 15499 raft_consensus.cc:697] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:42.286724 15211 leader_election.cc:304] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1838964b2aae45c28e801d9e5da69f01, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:42.287081 15450 raft_consensus.cc:2468] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 2.
I20260709 13:04:42.287176 15453 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 3.
I20260709 13:04:42.286965 15499 consensus_queue.cc:237] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.288054 15383 raft_consensus.cc:2804] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.288609 15383 raft_consensus.cc:697] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:42.290472 15383 consensus_queue.cc:237] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:42.296578 14995 catalog_manager.cc:5697] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 2 to 3, leader changed from 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195) to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 3 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:42.300556 14993 catalog_manager.cc:5697] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 1 to 2, leader changed from e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.561897 15453 raft_consensus.cc:1275] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:42.563333 15383 consensus_queue.cc:1048] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:42.576555 15171 raft_consensus.cc:1275] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:42.578051 15529 consensus_queue.cc:1048] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:42.683635 15453 raft_consensus.cc:1275] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:42.684957 15394 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:42.696848 15247 raft_consensus.cc:1275] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:42.698230 15523 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:42.908234 15171 raft_consensus.cc:1275] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:42.909825 15529 consensus_queue.cc:1048] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:42.910265 15453 raft_consensus.cc:1275] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:42.912113  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:42.912106 15529 consensus_queue.cc:1048] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:42.928170 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e55727326574cd3855d0279ebae337c"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
mode: GRACEFUL
new_leader_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:47126
I20260709 13:04:42.928869 15173 raft_consensus.cc:606] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Received request to transfer leadership to TS 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:42.932446 15247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
mode: GRACEFUL
new_leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:53184
I20260709 13:04:42.933056 15247 raft_consensus.cc:606] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Received request to transfer leadership to TS e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:42.936379 15247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "714ba4c1394344b8a9537629229b1172"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
mode: GRACEFUL
new_leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:53184
I20260709 13:04:42.937098 15247 raft_consensus.cc:606] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Received request to transfer leadership to TS e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:42.938576  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:42.939205  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:42.939939  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.099134 15523 raft_consensus.cc:993] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00: : Instructing follower 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:43.099647 15394 raft_consensus.cc:1081] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Signalling peer 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:43.101903 15247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e55727326574cd3855d0279ebae337c"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:04:43.102690 15247 raft_consensus.cc:493] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.103125 15247 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:43.107849 15247 raft_consensus.cc:515] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.109190 15247 leader_election.cc:290] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 4 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:43.110141 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:43.110383 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:43.110836 15453 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:43.110946 15173 raft_consensus.cc:3055] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:43.111359 15173 raft_consensus.cc:740] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:43.112174 15173 consensus_queue.cc:260] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.113348 15173 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:43.118322 15453 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 4.
I20260709 13:04:43.119572 15211 leader_election.cc:304] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:43.120114 15173 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 4.
I20260709 13:04:43.120388 15529 raft_consensus.cc:2804] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:43.121119 15529 raft_consensus.cc:697] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 4 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:43.122076 15529 consensus_queue.cc:237] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.128857 14992 catalog_manager.cc:5697] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 3 to 4, leader changed from e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 4 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:43.279378 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:43.337324 15383 raft_consensus.cc:993] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01: : Instructing follower e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:43.337844 15383 raft_consensus.cc:1081] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Signalling peer e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:43.339203 15173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "714ba4c1394344b8a9537629229b1172"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:33600
I20260709 13:04:43.339706 15173 raft_consensus.cc:493] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.340003 15173 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.344806 15173 raft_consensus.cc:515] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.346266 15173 leader_election.cc:290] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 3 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:43.347312 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714ba4c1394344b8a9537629229b1172" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:43.347747 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714ba4c1394344b8a9537629229b1172" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:43.348091 15453 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.348495 15244 raft_consensus.cc:3055] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.348882 15244 raft_consensus.cc:740] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:43.349699 15244 consensus_queue.cc:260] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.351082 15244 raft_consensus.cc:3060] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.354539 15453 raft_consensus.cc:2468] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 3.
I20260709 13:04:43.355680 15137 leader_election.cc:304] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:43.356418 15394 raft_consensus.cc:2804] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.356920 15394 raft_consensus.cc:697] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:43.357990 15244 raft_consensus.cc:2468] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 3.
I20260709 13:04:43.357817 15394 consensus_queue.cc:237] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.365873 14992 catalog_manager.cc:5697] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 2 to 3, leader changed from 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195) to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 3 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.462469 15529 raft_consensus.cc:993] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01: : Instructing follower e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:43.462981 15383 raft_consensus.cc:1081] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Signalling peer e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:43.464381 15173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:33600
I20260709 13:04:43.464829 15173 raft_consensus.cc:493] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.465171 15173 raft_consensus.cc:3060] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.469674 15173 raft_consensus.cc:515] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.471171 15173 leader_election.cc:290] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:43.472138 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:43.472241 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70afda3f9ac9405593c54f4edefb498d" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:43.472952 15453 raft_consensus.cc:3060] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.472982 15244 raft_consensus.cc:3055] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.473489 15244 raft_consensus.cc:740] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:43.474472 15244 consensus_queue.cc:260] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.475747 15244 raft_consensus.cc:3060] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.480408 15453 raft_consensus.cc:2468] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 2.
I20260709 13:04:43.481673 15137 leader_election.cc:304] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:43.482554 15394 raft_consensus.cc:2804] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.483057 15394 raft_consensus.cc:697] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:43.483071 15244 raft_consensus.cc:2468] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 2.
I20260709 13:04:43.484002 15394 consensus_queue.cc:237] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:43.491820 14992 catalog_manager.cc:5697] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 1 to 2, leader changed from 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195) to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.622817 15450 raft_consensus.cc:1275] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 4 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:43.624109 15383 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.633446 15173 raft_consensus.cc:1275] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 4 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:43.635591 15549 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.821885 15450 raft_consensus.cc:1275] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:43.823647 15523 consensus_queue.cc:1048] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:43.832978 15244 raft_consensus.cc:1275] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:43.835237 15523 consensus_queue.cc:1048] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:43.878361 15453 raft_consensus.cc:1275] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.879567 15523 consensus_queue.cc:1048] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.889421 15244 raft_consensus.cc:1275] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.891198 15394 consensus_queue.cc:1048] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.946296  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.954386 15244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e55727326574cd3855d0279ebae337c"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
mode: GRACEFUL
new_leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:53184
I20260709 13:04:43.954972 15244 raft_consensus.cc:606] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 4 LEADER]: Received request to transfer leadership to TS e2fddfc7789b46a08028bf85c3f99a00
I20260709 13:04:43.957649 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
mode: GRACEFUL
new_leader_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:47126
I20260709 13:04:43.958252 15173 raft_consensus.cc:606] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Received request to transfer leadership to TS 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:43.960698 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
mode: GRACEFUL
new_leader_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:47126
I20260709 13:04:43.961148 15173 raft_consensus.cc:606] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Received request to transfer leadership to TS 1838964b2aae45c28e801d9e5da69f01
I20260709 13:04:43.962383  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:43.962999  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:43.963572  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:44.167497 15558 raft_consensus.cc:993] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: : Instructing follower e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:44.168041 15558 raft_consensus.cc:1081] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 4 LEADER]: Signalling peer e2fddfc7789b46a08028bf85c3f99a00 to start an election
I20260709 13:04:44.169550 15173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e55727326574cd3855d0279ebae337c"
dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
 from {username='slave'} at 127.0.0.1:33600
I20260709 13:04:44.170042 15173 raft_consensus.cc:493] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.170312 15173 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:44.175158 15173 raft_consensus.cc:515] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.176796 15173 leader_election.cc:290] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 5 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195:32923)
I20260709 13:04:44.177641 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:44.177896 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e55727326574cd3855d0279ebae337c" candidate_uuid: "e2fddfc7789b46a08028bf85c3f99a00" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
I20260709 13:04:44.178316 15453 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:44.178434 15244 raft_consensus.cc:3055] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:44.178850 15244 raft_consensus.cc:740] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:44.179677 15244 consensus_queue.cc:260] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.180899 15244 raft_consensus.cc:3060] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:44.185309 15453 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 5.
I20260709 13:04:44.186538 15137 leader_election.cc:304] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, e2fddfc7789b46a08028bf85c3f99a00; no voters: 
I20260709 13:04:44.187208 15394 raft_consensus.cc:2804] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:44.187722 15394 raft_consensus.cc:697] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 5 LEADER]: Becoming Leader. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:44.188030 15244 raft_consensus.cc:2468] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fddfc7789b46a08028bf85c3f99a00 in term 5.
I20260709 13:04:44.188584 15394 consensus_queue.cc:237] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.195237 15553 raft_consensus.cc:993] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00: : Instructing follower 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:44.194752 14992 catalog_manager.cc:5697] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 reported cstate change: term changed from 4 to 5, leader changed from 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195) to e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194). New cstate: current_term: 5 leader_uuid: "e2fddfc7789b46a08028bf85c3f99a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:44.196067 15394 raft_consensus.cc:1081] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Signalling peer 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:44.197681 15244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:04:44.198338 15244 raft_consensus.cc:493] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.198685 15244 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.205185 15244 raft_consensus.cc:515] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.207170 15244 leader_election.cc:290] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 4 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:44.207877 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:44.208106 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e2ada8c464687b12a10e7721a35d6" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:44.208608 15453 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.208655 15173 raft_consensus.cc:3055] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:44.209064 15173 raft_consensus.cc:740] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:44.209662 15173 consensus_queue.cc:260] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.210557 15173 raft_consensus.cc:3060] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.214145 15453 raft_consensus.cc:2468] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 4.
I20260709 13:04:44.215293 15211 leader_election.cc:304] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:44.215986 15558 raft_consensus.cc:2804] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:44.216405 15558 raft_consensus.cc:697] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 4 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:44.216599 15173 raft_consensus.cc:2468] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 4.
I20260709 13:04:44.217159 15558 consensus_queue.cc:237] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.224542 14992 catalog_manager.cc:5697] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 3 to 4, leader changed from e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 4 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.279029 15394 raft_consensus.cc:993] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00: : Instructing follower 1838964b2aae45c28e801d9e5da69f01 to start an election
I20260709 13:04:44.279564 15394 raft_consensus.cc:1081] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Signalling peer 1838964b2aae45c28e801d9e5da69f01 to start an election
W20260709 13:04:44.280241 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:44.281032 15244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014"
dest_uuid: "1838964b2aae45c28e801d9e5da69f01"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:04:44.281587 15244 raft_consensus.cc:493] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.281944 15244 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.287272 15244 raft_consensus.cc:515] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.288960 15244 leader_election.cc:290] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 3 election: Requested vote from peers 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303), e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727)
I20260709 13:04:44.289772 15453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "06fdeaa2b6a4470faa45a334d44397fc"
I20260709 13:04:44.290110 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712262456e0a449f8fdd3bc68606c014" candidate_uuid: "1838964b2aae45c28e801d9e5da69f01" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e2fddfc7789b46a08028bf85c3f99a00"
I20260709 13:04:44.290616 15453 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.290654 15173 raft_consensus.cc:3055] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:44.291113 15173 raft_consensus.cc:740] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2fddfc7789b46a08028bf85c3f99a00, State: Running, Role: LEADER
I20260709 13:04:44.291733 15173 consensus_queue.cc:260] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.292693 15173 raft_consensus.cc:3060] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.296416 15453 raft_consensus.cc:2468] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 3.
I20260709 13:04:44.297561 15211 leader_election.cc:304] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06fdeaa2b6a4470faa45a334d44397fc, 1838964b2aae45c28e801d9e5da69f01; no voters: 
I20260709 13:04:44.298478 15558 raft_consensus.cc:2804] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:44.298559 15173 raft_consensus.cc:2468] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1838964b2aae45c28e801d9e5da69f01 in term 3.
I20260709 13:04:44.299039 15558 raft_consensus.cc:697] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 3 LEADER]: Becoming Leader. State: Replica: 1838964b2aae45c28e801d9e5da69f01, State: Running, Role: LEADER
I20260709 13:04:44.299955 15558 consensus_queue.cc:237] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } }
I20260709 13:04:44.307762 14992 catalog_manager.cc:5697] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 reported cstate change: term changed from 2 to 3, leader changed from e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194) to 1838964b2aae45c28e801d9e5da69f01 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "1838964b2aae45c28e801d9e5da69f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.695484 15450 raft_consensus.cc:1275] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:44.696722 15558 consensus_queue.cc:1048] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.706540 15450 raft_consensus.cc:1275] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 5 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:44.708066 15394 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:44.709327 15173 raft_consensus.cc:1275] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:44.711444 15549 consensus_queue.cc:1048] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.726190 15244 raft_consensus.cc:1275] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 5 FOLLOWER]: Refusing update from remote peer e2fddfc7789b46a08028bf85c3f99a00: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:44.727686 15523 consensus_queue.cc:1048] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1838964b2aae45c28e801d9e5da69f01" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:44.754773 15173 raft_consensus.cc:1275] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 4 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:44.756078 15557 consensus_queue.cc:1048] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fddfc7789b46a08028bf85c3f99a00" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:44.765875 15450 raft_consensus.cc:1275] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 4 FOLLOWER]: Refusing update from remote peer 1838964b2aae45c28e801d9e5da69f01: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:44.769112 15549 consensus_queue.cc:1048] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06fdeaa2b6a4470faa45a334d44397fc" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:44.969651  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.000160  7283 tablet_server.cc:179] TabletServer@127.7.28.193:34303 shutting down...
I20260709 13:04:45.023180  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:45.023869  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.024499  7283 raft_consensus.cc:2243] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.025027  7283 raft_consensus.cc:2272] T 6c09d86d2e7b459f89c5b5ded871c216 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.027134  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.027765  7283 raft_consensus.cc:2243] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.028236  7283 raft_consensus.cc:2272] T d16e2ada8c464687b12a10e7721a35d6 P 06fdeaa2b6a4470faa45a334d44397fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.030666  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.031283  7283 raft_consensus.cc:2243] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.031751  7283 raft_consensus.cc:2272] T d51af513a7ac41759dc6df639002bba1 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.033766  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.034401  7283 raft_consensus.cc:2243] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.034829  7283 raft_consensus.cc:2272] T c594d695e06b48c398968b370c298900 P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.036756  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.037307  7283 raft_consensus.cc:2243] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.037743  7283 raft_consensus.cc:2272] T 509899574a9e4fc3955ad3ee9c05e0ef P 06fdeaa2b6a4470faa45a334d44397fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.039657  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.040207  7283 raft_consensus.cc:2243] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.040637  7283 raft_consensus.cc:2272] T 712262456e0a449f8fdd3bc68606c014 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.043380  7283 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:45.043882 15137 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 13:04:45.044162  7283 raft_consensus.cc:2243] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.044888  7283 raft_consensus.cc:2272] T 825a48f3e0104dac8c4da361de73ec52 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:45.046752 15137 consensus_peers.cc:597] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.047425  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.048061  7283 raft_consensus.cc:2243] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.048501  7283 raft_consensus.cc:2272] T 0e55727326574cd3855d0279ebae337c P 06fdeaa2b6a4470faa45a334d44397fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.050843  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.051339  7283 raft_consensus.cc:2243] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.051720  7283 raft_consensus.cc:2272] T 70afda3f9ac9405593c54f4edefb498d P 06fdeaa2b6a4470faa45a334d44397fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.053637  7283 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:45.054162  7283 raft_consensus.cc:2243] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.054549  7283 raft_consensus.cc:2272] T 714ba4c1394344b8a9537629229b1172 P 06fdeaa2b6a4470faa45a334d44397fc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:45.081943 15211 consensus_peers.cc:597] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.084771  7283 tablet_server.cc:196] TabletServer@127.7.28.193:34303 shutdown complete.
W20260709 13:04:45.091146 15211 consensus_peers.cc:597] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.104647  7283 tablet_server.cc:179] TabletServer@127.7.28.194:0 shutting down...
W20260709 13:04:45.112969 15211 consensus_peers.cc:597] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:45.119812 15211 consensus_peers.cc:597] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 -> Peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Couldn't send request to peer e2fddfc7789b46a08028bf85c3f99a00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:45.124445 15211 consensus_peers.cc:597] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 -> Peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Couldn't send request to peer e2fddfc7789b46a08028bf85c3f99a00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.140786  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:45.141621  7283 tablet_replica.cc:333] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.142364  7283 raft_consensus.cc:2243] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.143216  7283 raft_consensus.cc:2272] T 70afda3f9ac9405593c54f4edefb498d P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.145550  7283 tablet_replica.cc:333] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.146253  7283 raft_consensus.cc:2243] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.146713  7283 raft_consensus.cc:2272] T 825a48f3e0104dac8c4da361de73ec52 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.148787  7283 tablet_replica.cc:333] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.149333  7283 raft_consensus.cc:2243] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.149750  7283 raft_consensus.cc:2272] T 712262456e0a449f8fdd3bc68606c014 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.152839  7283 tablet_replica.cc:333] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.153414  7283 raft_consensus.cc:2243] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.154313  7283 raft_consensus.cc:2272] T 0e55727326574cd3855d0279ebae337c P e2fddfc7789b46a08028bf85c3f99a00 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.156999  7283 tablet_replica.cc:333] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.157553  7283 raft_consensus.cc:2243] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.158360  7283 raft_consensus.cc:2272] T 714ba4c1394344b8a9537629229b1172 P e2fddfc7789b46a08028bf85c3f99a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.160439  7283 tablet_replica.cc:333] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.161003  7283 raft_consensus.cc:2243] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.161451  7283 raft_consensus.cc:2272] T 509899574a9e4fc3955ad3ee9c05e0ef P e2fddfc7789b46a08028bf85c3f99a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.163671  7283 tablet_replica.cc:333] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.164207  7283 raft_consensus.cc:2243] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.164619  7283 raft_consensus.cc:2272] T c594d695e06b48c398968b370c298900 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.166728  7283 tablet_replica.cc:333] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.167272  7283 raft_consensus.cc:2243] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.167740  7283 raft_consensus.cc:2272] T d16e2ada8c464687b12a10e7721a35d6 P e2fddfc7789b46a08028bf85c3f99a00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.170377  7283 tablet_replica.cc:333] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.170881  7283 raft_consensus.cc:2243] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.171638  7283 raft_consensus.cc:2272] T d51af513a7ac41759dc6df639002bba1 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.174036  7283 tablet_replica.cc:333] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00: stopping tablet replica
I20260709 13:04:45.174557  7283 raft_consensus.cc:2243] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.175000  7283 raft_consensus.cc:2272] T 6c09d86d2e7b459f89c5b5ded871c216 P e2fddfc7789b46a08028bf85c3f99a00 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:45.176837 15211 consensus_peers.cc:597] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 -> Peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Couldn't send request to peer e2fddfc7789b46a08028bf85c3f99a00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.222572  7283 tablet_server.cc:196] TabletServer@127.7.28.194:0 shutdown complete.
I20260709 13:04:45.251771  7283 tablet_server.cc:179] TabletServer@127.7.28.195:0 shutting down...
W20260709 13:04:45.282200 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:45.284065 15211 consensus_peers.cc:597] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 -> Peer 06fdeaa2b6a4470faa45a334d44397fc (127.7.28.193:34303): Couldn't send request to peer 06fdeaa2b6a4470faa45a334d44397fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:45.295819 15211 consensus_peers.cc:597] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 -> Peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Couldn't send request to peer e2fddfc7789b46a08028bf85c3f99a00. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:41727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.301905  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:45.302798  7283 tablet_replica.cc:333] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.303581  7283 raft_consensus.cc:2243] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.304009  7283 raft_consensus.cc:2272] T 70afda3f9ac9405593c54f4edefb498d P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.306247  7283 tablet_replica.cc:333] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.306949  7283 raft_consensus.cc:2243] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.307400  7283 raft_consensus.cc:2272] T 714ba4c1394344b8a9537629229b1172 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.310173  7283 tablet_replica.cc:333] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.310895  7283 raft_consensus.cc:2243] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:04:45.311877 15211 consensus_peers.cc:597] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 -> Peer e2fddfc7789b46a08028bf85c3f99a00 (127.7.28.194:41727): Couldn't send request to peer e2fddfc7789b46a08028bf85c3f99a00. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:41727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.311931  7283 raft_consensus.cc:2272] T d16e2ada8c464687b12a10e7721a35d6 P 1838964b2aae45c28e801d9e5da69f01 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.315145  7283 tablet_replica.cc:333] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.315806  7283 raft_consensus.cc:2243] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.316237  7283 raft_consensus.cc:2272] T d51af513a7ac41759dc6df639002bba1 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.318315  7283 tablet_replica.cc:333] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.318856  7283 raft_consensus.cc:2243] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.319617  7283 raft_consensus.cc:2272] T 825a48f3e0104dac8c4da361de73ec52 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.321760  7283 tablet_replica.cc:333] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.322391  7283 raft_consensus.cc:2243] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.322837  7283 raft_consensus.cc:2272] T 0e55727326574cd3855d0279ebae337c P 1838964b2aae45c28e801d9e5da69f01 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.325448  7283 tablet_replica.cc:333] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.326220  7283 raft_consensus.cc:2243] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.327026  7283 raft_consensus.cc:2272] T 712262456e0a449f8fdd3bc68606c014 P 1838964b2aae45c28e801d9e5da69f01 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.329336  7283 tablet_replica.cc:333] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.329964  7283 raft_consensus.cc:2243] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.330744  7283 raft_consensus.cc:2272] T 6c09d86d2e7b459f89c5b5ded871c216 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.332623  7283 tablet_replica.cc:333] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.333206  7283 raft_consensus.cc:2243] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.334046  7283 raft_consensus.cc:2272] T 509899574a9e4fc3955ad3ee9c05e0ef P 1838964b2aae45c28e801d9e5da69f01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.336436  7283 tablet_replica.cc:333] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01: stopping tablet replica
I20260709 13:04:45.336892  7283 raft_consensus.cc:2243] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.337631  7283 raft_consensus.cc:2272] T c594d695e06b48c398968b370c298900 P 1838964b2aae45c28e801d9e5da69f01 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.371908  7283 tablet_server.cc:196] TabletServer@127.7.28.195:0 shutdown complete.
I20260709 13:04:45.397533  7283 master.cc:562] Master@127.7.28.254:34819 shutting down...
I20260709 13:04:45.424209  7283 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:45.424770  7283 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.425117  7283 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2b49d454095d4cb4ab8e1ed0136cdb16: stopping tablet replica
I20260709 13:04:45.462711  7283 master.cc:584] Master@127.7.28.254:34819 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14390 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:04:45.507529  7283 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.28.254:33359
I20260709 13:04:45.508677  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:45.514613 15584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.515121 15583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.515209 15586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.516191  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:45.517330  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:45.517520  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:45.517634  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602285517624 us; error 0 us; skew 500 ppm
I20260709 13:04:45.518194  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:45.520747  7283 webserver.cc:533] Webserver started at http://127.7.28.254:45881/ using document root <none> and password file <none>
I20260709 13:04:45.521186  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:45.521337  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:45.521564  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:45.522746  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/master-0-root/instance:
uuid: "dc260353cdb4459ca18c4160e5f8af46"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-ll1f"
I20260709 13:04:45.527580  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:04:45.530887 15591 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.531756  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:45.532156  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/master-0-root
uuid: "dc260353cdb4459ca18c4160e5f8af46"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-ll1f"
I20260709 13:04:45.532503  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:45.548846  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:45.550367  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:45.595129  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.254:33359
I20260709 13:04:45.595223 15642 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.254:33359 every 8 connection(s)
I20260709 13:04:45.599479 15643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.610954 15643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46: Bootstrap starting.
I20260709 13:04:45.615860 15643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:45.620286 15643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46: No bootstrap required, opened a new log
I20260709 13:04:45.622601 15643 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc260353cdb4459ca18c4160e5f8af46" member_type: VOTER }
I20260709 13:04:45.623013 15643 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:45.623189 15643 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc260353cdb4459ca18c4160e5f8af46, State: Initialized, Role: FOLLOWER
I20260709 13:04:45.623701 15643 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc260353cdb4459ca18c4160e5f8af46" member_type: VOTER }
I20260709 13:04:45.624114 15643 raft_consensus.cc:399] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:45.624313 15643 raft_consensus.cc:493] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:45.624522 15643 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:45.629305 15643 raft_consensus.cc:515] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc260353cdb4459ca18c4160e5f8af46" member_type: VOTER }
I20260709 13:04:45.629869 15643 leader_election.cc:304] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc260353cdb4459ca18c4160e5f8af46; no voters: 
I20260709 13:04:45.631039 15643 leader_election.cc:290] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:45.631471 15646 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:45.632946 15646 raft_consensus.cc:697] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 1 LEADER]: Becoming Leader. State: Replica: dc260353cdb4459ca18c4160e5f8af46, State: Running, Role: LEADER
I20260709 13:04:45.633625 15646 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc260353cdb4459ca18c4160e5f8af46" member_type: VOTER }
I20260709 13:04:45.634057 15643 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:45.638480 15648 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc260353cdb4459ca18c4160e5f8af46. Latest consensus state: current_term: 1 leader_uuid: "dc260353cdb4459ca18c4160e5f8af46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc260353cdb4459ca18c4160e5f8af46" member_type: VOTER } }
I20260709 13:04:45.638520 15647 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc260353cdb4459ca18c4160e5f8af46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc260353cdb4459ca18c4160e5f8af46" member_type: VOTER } }
I20260709 13:04:45.639263 15648 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:45.639516 15647 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:45.644233 15653 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:45.649637 15653 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:45.651304  7283 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:45.658838 15653 catalog_manager.cc:1383] Generated new cluster ID: a00098d4f4a24ee2bc88299ee14b6067
I20260709 13:04:45.659206 15653 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:45.672324 15653 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:45.673648 15653 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:45.695885 15653 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46: Generated new TSK 0
I20260709 13:04:45.696563 15653 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:45.718163  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:45.724325 15664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.725478 15665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.728483 15667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.728622  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:45.730050  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:45.730239  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:45.730361  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602285730350 us; error 0 us; skew 500 ppm
I20260709 13:04:45.730813  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:45.733218  7283 webserver.cc:533] Webserver started at http://127.7.28.193:37111/ using document root <none> and password file <none>
I20260709 13:04:45.733646  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:45.733963  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:45.734288  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:45.735455  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-0-root/instance:
uuid: "5035240f624f4b3085122da370fcb7a3"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-ll1f"
I20260709 13:04:45.739993  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:04:45.743808 15672 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.744684  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:45.745083  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "5035240f624f4b3085122da370fcb7a3"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-ll1f"
I20260709 13:04:45.745374  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:45.755715  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:45.757411  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:45.759171  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:45.761480  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:45.761667  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.762014  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:45.762176  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.803612  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:46751
I20260709 13:04:45.803725 15734 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:46751 every 8 connection(s)
I20260709 13:04:45.809170  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:45.816058 15739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.818039 15740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.820621  7283 server_base.cc:1061] running on GCE node
W20260709 13:04:45.820592 15742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.821487 15735 heartbeater.cc:344] Connected to a master server at 127.7.28.254:33359
I20260709 13:04:45.821990 15735 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:45.822279  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:45.822575  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:45.822757  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602285822742 us; error 0 us; skew 500 ppm
I20260709 13:04:45.822834 15735 heartbeater.cc:507] Master 127.7.28.254:33359 requested a full tablet report, sending...
I20260709 13:04:45.823405  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:45.825184 15608 ts_manager.cc:194] Registered new tserver with Master: 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751)
I20260709 13:04:45.826498  7283 webserver.cc:533] Webserver started at http://127.7.28.194:42161/ using document root <none> and password file <none>
I20260709 13:04:45.827061  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:45.827275  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:45.827250 15608 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44220
I20260709 13:04:45.827770  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:45.829011  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-1-root/instance:
uuid: "60442fcc11144632a8398e85aafd6194"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-ll1f"
I20260709 13:04:45.833371  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:45.837124 15747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.837949  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:45.838250  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-1-root
uuid: "60442fcc11144632a8398e85aafd6194"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-ll1f"
I20260709 13:04:45.838536  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:45.849612  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:45.850781  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:45.852210  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:45.854399  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:45.854627  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.854874  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:45.855050  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.895533  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.194:38895
I20260709 13:04:45.895655 15809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.194:38895 every 8 connection(s)
I20260709 13:04:45.900532  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:45.908058 15813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.909561 15814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.912277 15816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.912307  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:45.913156 15810 heartbeater.cc:344] Connected to a master server at 127.7.28.254:33359
I20260709 13:04:45.913542 15810 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:45.913601  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:45.913978  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:45.914172  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602285914157 us; error 0 us; skew 500 ppm
I20260709 13:04:45.914280 15810 heartbeater.cc:507] Master 127.7.28.254:33359 requested a full tablet report, sending...
I20260709 13:04:45.914832  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:45.916455 15608 ts_manager.cc:194] Registered new tserver with Master: 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
I20260709 13:04:45.917547  7283 webserver.cc:533] Webserver started at http://127.7.28.195:43557/ using document root <none> and password file <none>
I20260709 13:04:45.918221  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:45.918463  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:45.918380 15608 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44236
I20260709 13:04:45.918928  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:45.920112  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-2-root/instance:
uuid: "eb213d55b4044008b27bb097e8e6f404"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-ll1f"
I20260709 13:04:45.924520  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:04:45.927788 15821 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.928544  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:45.928834  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-2-root
uuid: "eb213d55b4044008b27bb097e8e6f404"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-ll1f"
I20260709 13:04:45.929133  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602049386691-7283-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:45.945998  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:45.947242  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:45.948684  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:45.950814  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:45.951031  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.951277  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:45.951457  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.993240  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.195:37577
I20260709 13:04:45.993373 15883 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.195:37577 every 8 connection(s)
I20260709 13:04:46.008317 15884 heartbeater.cc:344] Connected to a master server at 127.7.28.254:33359
I20260709 13:04:46.008874 15884 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:46.009719 15884 heartbeater.cc:507] Master 127.7.28.254:33359 requested a full tablet report, sending...
I20260709 13:04:46.011842 15608 ts_manager.cc:194] Registered new tserver with Master: eb213d55b4044008b27bb097e8e6f404 (127.7.28.195:37577)
I20260709 13:04:46.012146  7283 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014993737s
I20260709 13:04:46.014006 15608 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44250
I20260709 13:04:46.039283 15608 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44260:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:46.041476 15608 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:46.087293 15775 tablet_service.cc:1511] Processing CreateTablet for tablet 1384fd2aede04689a2f11fbefa850306 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=adc1231da576421abcd6865835e4b020]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:46.088904 15775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1384fd2aede04689a2f11fbefa850306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.092114 15849 tablet_service.cc:1511] Processing CreateTablet for tablet 1384fd2aede04689a2f11fbefa850306 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=adc1231da576421abcd6865835e4b020]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:46.093827 15849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1384fd2aede04689a2f11fbefa850306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.095132 15848 tablet_service.cc:1511] Processing CreateTablet for tablet 4dce4a3d96114270b73cef839b9fcbf0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=adc1231da576421abcd6865835e4b020]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:46.096505 15848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dce4a3d96114270b73cef839b9fcbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.096169 15774 tablet_service.cc:1511] Processing CreateTablet for tablet 4dce4a3d96114270b73cef839b9fcbf0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=adc1231da576421abcd6865835e4b020]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:46.098773 15774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dce4a3d96114270b73cef839b9fcbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.115638 15899 tablet_bootstrap.cc:492] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404: Bootstrap starting.
I20260709 13:04:46.120522 15700 tablet_service.cc:1511] Processing CreateTablet for tablet 1384fd2aede04689a2f11fbefa850306 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=adc1231da576421abcd6865835e4b020]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:46.122088 15700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1384fd2aede04689a2f11fbefa850306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.124164 15699 tablet_service.cc:1511] Processing CreateTablet for tablet 4dce4a3d96114270b73cef839b9fcbf0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=adc1231da576421abcd6865835e4b020]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:46.125730 15699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dce4a3d96114270b73cef839b9fcbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.124679 15899 tablet_bootstrap.cc:654] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.126062 15900 tablet_bootstrap.cc:492] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194: Bootstrap starting.
I20260709 13:04:46.134280 15900 tablet_bootstrap.cc:654] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.143208 15899 tablet_bootstrap.cc:492] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404: No bootstrap required, opened a new log
I20260709 13:04:46.143738 15899 ts_tablet_manager.cc:1403] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.018s
I20260709 13:04:46.145418 15903 tablet_bootstrap.cc:492] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3: Bootstrap starting.
I20260709 13:04:46.146922 15899 raft_consensus.cc:359] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.147760 15899 raft_consensus.cc:385] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.148010 15900 tablet_bootstrap.cc:492] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194: No bootstrap required, opened a new log
I20260709 13:04:46.148037 15899 raft_consensus.cc:740] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.148598 15900 ts_tablet_manager.cc:1403] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:04:46.149333 15899 consensus_queue.cc:260] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.152361 15884 heartbeater.cc:499] Master 127.7.28.254:33359 was elected leader, sending a full tablet report...
I20260709 13:04:46.152459 15899 ts_tablet_manager.cc:1434] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:04:46.154016 15903 tablet_bootstrap.cc:654] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.154125 15899 tablet_bootstrap.cc:492] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404: Bootstrap starting.
I20260709 13:04:46.155759 15900 raft_consensus.cc:359] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.156646 15900 raft_consensus.cc:385] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.156970 15900 raft_consensus.cc:740] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60442fcc11144632a8398e85aafd6194, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.158185 15900 consensus_queue.cc:260] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.163256 15899 tablet_bootstrap.cc:654] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.166859 15903 tablet_bootstrap.cc:492] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3: No bootstrap required, opened a new log
I20260709 13:04:46.167613 15903 ts_tablet_manager.cc:1403] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:04:46.171146 15903 raft_consensus.cc:359] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.171932 15903 raft_consensus.cc:385] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.172266 15903 raft_consensus.cc:740] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5035240f624f4b3085122da370fcb7a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.173167 15903 consensus_queue.cc:260] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.174988 15810 heartbeater.cc:499] Master 127.7.28.254:33359 was elected leader, sending a full tablet report...
I20260709 13:04:46.176023 15900 ts_tablet_manager.cc:1434] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.015s
I20260709 13:04:46.176458 15899 tablet_bootstrap.cc:492] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404: No bootstrap required, opened a new log
I20260709 13:04:46.177006 15899 ts_tablet_manager.cc:1403] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:04:46.177574 15900 tablet_bootstrap.cc:492] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194: Bootstrap starting.
I20260709 13:04:46.180083 15899 raft_consensus.cc:359] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.180891 15899 raft_consensus.cc:385] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.181211 15899 raft_consensus.cc:740] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.182207 15899 consensus_queue.cc:260] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.184226 15903 ts_tablet_manager.cc:1434] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.010s
I20260709 13:04:46.184783 15899 ts_tablet_manager.cc:1434] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:04:46.185045 15735 heartbeater.cc:499] Master 127.7.28.254:33359 was elected leader, sending a full tablet report...
I20260709 13:04:46.187690 15903 tablet_bootstrap.cc:492] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3: Bootstrap starting.
I20260709 13:04:46.189069 15900 tablet_bootstrap.cc:654] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.195785 15903 tablet_bootstrap.cc:654] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.201970 15900 tablet_bootstrap.cc:492] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194: No bootstrap required, opened a new log
I20260709 13:04:46.202746 15900 ts_tablet_manager.cc:1403] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.005s
I20260709 13:04:46.205871 15903 tablet_bootstrap.cc:492] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3: No bootstrap required, opened a new log
I20260709 13:04:46.205842 15900 raft_consensus.cc:359] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.206552 15903 ts_tablet_manager.cc:1403] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:04:46.206660 15900 raft_consensus.cc:385] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.207007 15900 raft_consensus.cc:740] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60442fcc11144632a8398e85aafd6194, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.207821 15900 consensus_queue.cc:260] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.210041 15900 ts_tablet_manager.cc:1434] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:46.209673 15903 raft_consensus.cc:359] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.210479 15903 raft_consensus.cc:385] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.210790 15903 raft_consensus.cc:740] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5035240f624f4b3085122da370fcb7a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.211469 15903 consensus_queue.cc:260] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.213124 15903 ts_tablet_manager.cc:1434] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:46.308692 15904 raft_consensus.cc:493] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.309365 15904 raft_consensus.cc:515] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.311394 15904 leader_election.cc:290] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
I20260709 13:04:46.322237 15710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3" is_pre_election: true
I20260709 13:04:46.323092 15710 raft_consensus.cc:2468] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 0.
I20260709 13:04:46.323549 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194" is_pre_election: true
I20260709 13:04:46.324323 15785 raft_consensus.cc:2468] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 0.
I20260709 13:04:46.324535 15824 leader_election.cc:304] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5035240f624f4b3085122da370fcb7a3, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:46.325436 15904 raft_consensus.cc:2804] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.325827 15904 raft_consensus.cc:493] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.326112 15904 raft_consensus.cc:3060] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.332110 15904 raft_consensus.cc:515] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.333876 15904 leader_election.cc:290] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 election: Requested vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
I20260709 13:04:46.334683 15710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3"
I20260709 13:04:46.335007 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194"
I20260709 13:04:46.335363 15710 raft_consensus.cc:3060] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.335600 15785 raft_consensus.cc:3060] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.341992 15785 raft_consensus.cc:2468] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 1.
I20260709 13:04:46.342010 15710 raft_consensus.cc:2468] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 1.
I20260709 13:04:46.343273 15823 leader_election.cc:304] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:46.344195 15904 raft_consensus.cc:2804] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.345330 15904 raft_consensus.cc:697] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Becoming Leader. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:46.346130 15904 consensus_queue.cc:237] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.353653 15606 catalog_manager.cc:5697] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb213d55b4044008b27bb097e8e6f404 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "eb213d55b4044008b27bb097e8e6f404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.412396 15904 raft_consensus.cc:493] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.412950 15904 raft_consensus.cc:515] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.414786 15904 leader_election.cc:290] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895), 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751)
I20260709 13:04:46.415946 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194" is_pre_election: true
I20260709 13:04:46.415946 15710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3" is_pre_election: true
I20260709 13:04:46.416895 15785 raft_consensus.cc:2468] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 0.
I20260709 13:04:46.416967 15710 raft_consensus.cc:2468] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 0.
I20260709 13:04:46.418138 15824 leader_election.cc:304] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5035240f624f4b3085122da370fcb7a3, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:46.418879 15904 raft_consensus.cc:2804] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.419242 15904 raft_consensus.cc:493] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.419533 15904 raft_consensus.cc:3060] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.424734 15904 raft_consensus.cc:515] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.426405 15904 leader_election.cc:290] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 election: Requested vote from peers 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895), 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751)
I20260709 13:04:46.427423 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194"
I20260709 13:04:46.427603 15710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3"
I20260709 13:04:46.428174 15785 raft_consensus.cc:3060] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.428248 15710 raft_consensus.cc:3060] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.433732 15785 raft_consensus.cc:2468] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 1.
I20260709 13:04:46.433722 15710 raft_consensus.cc:2468] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 1.
I20260709 13:04:46.435205 15824 leader_election.cc:304] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5035240f624f4b3085122da370fcb7a3, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:46.435913 15904 raft_consensus.cc:2804] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.436403 15904 raft_consensus.cc:697] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Becoming Leader. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:46.437058 15904 consensus_queue.cc:237] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:46.444938 15606 catalog_manager.cc:5697] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb213d55b4044008b27bb097e8e6f404 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "eb213d55b4044008b27bb097e8e6f404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.500078 15606 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44274:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:46.502411 15606 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:46.526775 15700 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa8e37763e14059a44920015b4a03d4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=de15a5b6094f4af0a2c5804b83677e8d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:46.528093 15700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa8e37763e14059a44920015b4a03d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.528052 15775 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa8e37763e14059a44920015b4a03d4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=de15a5b6094f4af0a2c5804b83677e8d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:46.529408 15775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa8e37763e14059a44920015b4a03d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.529206 15849 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa8e37763e14059a44920015b4a03d4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=de15a5b6094f4af0a2c5804b83677e8d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:46.530506 15849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa8e37763e14059a44920015b4a03d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.531562 15699 tablet_service.cc:1511] Processing CreateTablet for tablet 4334f7c5ce6c43768c419a4caeb8f0e2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=de15a5b6094f4af0a2c5804b83677e8d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:46.532773 15699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4334f7c5ce6c43768c419a4caeb8f0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.534157 15774 tablet_service.cc:1511] Processing CreateTablet for tablet 4334f7c5ce6c43768c419a4caeb8f0e2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=de15a5b6094f4af0a2c5804b83677e8d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:46.535460 15774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4334f7c5ce6c43768c419a4caeb8f0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.536161 15848 tablet_service.cc:1511] Processing CreateTablet for tablet 4334f7c5ce6c43768c419a4caeb8f0e2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=de15a5b6094f4af0a2c5804b83677e8d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:46.537421 15848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4334f7c5ce6c43768c419a4caeb8f0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.547255 15899 tablet_bootstrap.cc:492] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404: Bootstrap starting.
I20260709 13:04:46.553561 15899 tablet_bootstrap.cc:654] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.558039 15903 tablet_bootstrap.cc:492] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3: Bootstrap starting.
I20260709 13:04:46.567101 15900 tablet_bootstrap.cc:492] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194: Bootstrap starting.
I20260709 13:04:46.568651 15903 tablet_bootstrap.cc:654] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.573159 15899 tablet_bootstrap.cc:492] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404: No bootstrap required, opened a new log
I20260709 13:04:46.573668 15899 ts_tablet_manager.cc:1403] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.009s
I20260709 13:04:46.574211 15900 tablet_bootstrap.cc:654] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.576427 15899 raft_consensus.cc:359] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.576785 15903 tablet_bootstrap.cc:492] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3: No bootstrap required, opened a new log
I20260709 13:04:46.577142 15899 raft_consensus.cc:385] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.577510 15899 raft_consensus.cc:740] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.577562 15903 ts_tablet_manager.cc:1403] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 13:04:46.578436 15899 consensus_queue.cc:260] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.580507 15899 ts_tablet_manager.cc:1434] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:46.581740 15899 tablet_bootstrap.cc:492] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: Bootstrap starting.
I20260709 13:04:46.581976 15903 raft_consensus.cc:359] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.582791 15903 raft_consensus.cc:385] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.582814 15900 tablet_bootstrap.cc:492] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194: No bootstrap required, opened a new log
I20260709 13:04:46.583204 15903 raft_consensus.cc:740] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5035240f624f4b3085122da370fcb7a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.583513 15900 ts_tablet_manager.cc:1403] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.005s
I20260709 13:04:46.584129 15903 consensus_queue.cc:260] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.586658 15903 ts_tablet_manager.cc:1434] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:46.586803 15900 raft_consensus.cc:359] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.587771 15903 tablet_bootstrap.cc:492] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3: Bootstrap starting.
I20260709 13:04:46.589566 15899 tablet_bootstrap.cc:654] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.587610 15900 raft_consensus.cc:385] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.590257 15900 raft_consensus.cc:740] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60442fcc11144632a8398e85aafd6194, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.591229 15900 consensus_queue.cc:260] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.596616 15903 tablet_bootstrap.cc:654] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.599696 15900 ts_tablet_manager.cc:1434] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:46.600903 15900 tablet_bootstrap.cc:492] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194: Bootstrap starting.
I20260709 13:04:46.609246 15900 tablet_bootstrap.cc:654] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.615391 15899 tablet_bootstrap.cc:492] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: No bootstrap required, opened a new log
I20260709 13:04:46.616245 15899 ts_tablet_manager.cc:1403] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.020s
I20260709 13:04:46.620384 15899 raft_consensus.cc:359] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.620995 15900 tablet_bootstrap.cc:492] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194: No bootstrap required, opened a new log
I20260709 13:04:46.621392 15899 raft_consensus.cc:385] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.621731 15900 ts_tablet_manager.cc:1403] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.004s
I20260709 13:04:46.621873 15899 raft_consensus.cc:740] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.623042 15899 consensus_queue.cc:260] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.624389 15903 tablet_bootstrap.cc:492] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3: No bootstrap required, opened a new log
I20260709 13:04:46.624927 15903 ts_tablet_manager.cc:1403] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.023s
I20260709 13:04:46.624918 15900 raft_consensus.cc:359] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.626003 15900 raft_consensus.cc:385] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.626325 15900 raft_consensus.cc:740] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60442fcc11144632a8398e85aafd6194, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.626580 15899 ts_tablet_manager.cc:1434] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:46.627204 15900 consensus_queue.cc:260] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.627766 15904 raft_consensus.cc:493] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.628314 15904 raft_consensus.cc:515] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.628564 15903 raft_consensus.cc:359] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.629345 15903 raft_consensus.cc:385] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.629638 15903 raft_consensus.cc:740] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5035240f624f4b3085122da370fcb7a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.630403 15904 leader_election.cc:290] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
I20260709 13:04:46.630622 15903 consensus_queue.cc:260] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.631367 15900 ts_tablet_manager.cc:1434] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:46.632882 15710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa8e37763e14059a44920015b4a03d4" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3" is_pre_election: true
I20260709 13:04:46.632874 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa8e37763e14059a44920015b4a03d4" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194" is_pre_election: true
I20260709 13:04:46.634114 15785 raft_consensus.cc:2468] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 0.
I20260709 13:04:46.633702 15710 raft_consensus.cc:2468] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 0.
I20260709 13:04:46.635054 15903 ts_tablet_manager.cc:1434] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260709 13:04:46.635324 15823 leader_election.cc:304] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:46.636188 15904 raft_consensus.cc:2804] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.636554 15904 raft_consensus.cc:493] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.636896 15904 raft_consensus.cc:3060] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.645327 15904 raft_consensus.cc:515] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
W20260709 13:04:46.647318 15656 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:46.648557 15904 leader_election.cc:290] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 election: Requested vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
I20260709 13:04:46.648772 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa8e37763e14059a44920015b4a03d4" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194"
I20260709 13:04:46.648468 15710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa8e37763e14059a44920015b4a03d4" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3"
I20260709 13:04:46.649412 15785 raft_consensus.cc:3060] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.649685 15710 raft_consensus.cc:3060] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.655422 15785 raft_consensus.cc:2468] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 1.
I20260709 13:04:46.655833 15710 raft_consensus.cc:2468] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 1.
I20260709 13:04:46.656944 15823 leader_election.cc:304] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:46.658375 15904 raft_consensus.cc:2804] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.658970 15904 raft_consensus.cc:697] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Becoming Leader. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:46.659972 15904 consensus_queue.cc:237] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.668684 15607 catalog_manager.cc:5697] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb213d55b4044008b27bb097e8e6f404 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "eb213d55b4044008b27bb097e8e6f404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.945472 15904 raft_consensus.cc:493] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.946281 15904 raft_consensus.cc:515] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:46.955811 15904 leader_election.cc:290] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
I20260709 13:04:47.066154 15904 consensus_queue.cc:1048] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:47.332198 15904 consensus_queue.cc:1048] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.334673 15904 consensus_queue.cc:1048] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.342837 15904 consensus_queue.cc:1048] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.356375 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194" is_pre_election: true
I20260709 13:04:47.359557 15908 raft_consensus.cc:493] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.361196 15785 raft_consensus.cc:2468] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 0.
I20260709 13:04:47.361083 15908 raft_consensus.cc:515] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:47.388789 15908 leader_election.cc:290] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895), eb213d55b4044008b27bb097e8e6f404 (127.7.28.195:37577)
I20260709 13:04:47.915555 15935 consensus_queue.cc:1048] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:47.917131 15823 leader_election.cc:304] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:47.918810 15935 raft_consensus.cc:2804] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.919217 15935 raft_consensus.cc:493] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.919555 15935 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.257560 15936 consensus_queue.cc:1048] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.287799 15935 raft_consensus.cc:515] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
W20260709 13:04:48.310664 15823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:38895, user_credentials={real_user=slave}} blocked reactor thread for 392376us
I20260709 13:04:48.407506 15935 leader_election.cc:290] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 election: Requested vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
W20260709 13:04:48.510430 15823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:38895, user_credentials={real_user=slave}} blocked reactor thread for 198342us
I20260709 13:04:48.519179 15784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194"
I20260709 13:04:48.520848 15784 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.537562 15784 raft_consensus.cc:2468] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 1.
I20260709 13:04:48.544750 15823 leader_election.cc:304] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:48.548043 15938 raft_consensus.cc:2804] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.573549 15938 raft_consensus.cc:697] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Becoming Leader. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:48.575282 15938 consensus_queue.cc:237] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:48.574239 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194" is_pre_election: true
I20260709 13:04:48.577112 15939 raft_consensus.cc:493] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.577521 15785 raft_consensus.cc:2393] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5035240f624f4b3085122da370fcb7a3 in current term 1: Already voted for candidate eb213d55b4044008b27bb097e8e6f404 in this term.
I20260709 13:04:48.579154 15939 raft_consensus.cc:515] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:48.585996 15939 leader_election.cc:290] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), eb213d55b4044008b27bb097e8e6f404 (127.7.28.195:37577)
I20260709 13:04:48.603338 15946 raft_consensus.cc:493] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb213d55b4044008b27bb097e8e6f404)
I20260709 13:04:48.606499 15946 raft_consensus.cc:515] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:48.611750 15946 leader_election.cc:290] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895), eb213d55b4044008b27bb097e8e6f404 (127.7.28.195:37577)
I20260709 13:04:48.613251 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60442fcc11144632a8398e85aafd6194" is_pre_election: true
I20260709 13:04:47.360397 15709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3" is_pre_election: true
I20260709 13:04:48.615352 15709 raft_consensus.cc:2468] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 0.
W20260709 13:04:48.616508 15709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53238 (request call id 7) took 1596 ms (client timeout 1698 ms). Trace:
W20260709 13:04:48.617316 15709 rpcz_store.cc:269] 0709 13:04:47.020231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.358963 (+338732us) service_pool.cc:224] Handling call
0709 13:04:48.616329 (+1257366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:48.637290 15710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3"
I20260709 13:04:48.638299 15710 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.680856 15710 raft_consensus.cc:2468] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 1.
W20260709 13:04:48.711796 15656 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:48.728338 15709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0" candidate_uuid: "60442fcc11144632a8398e85aafd6194" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5035240f624f4b3085122da370fcb7a3" is_pre_election: true
I20260709 13:04:48.820226 15859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb213d55b4044008b27bb097e8e6f404" is_pre_election: true
I20260709 13:04:48.820210 15858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb213d55b4044008b27bb097e8e6f404" is_pre_election: true
I20260709 13:04:48.822559 15676 leader_election.cc:304] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5035240f624f4b3085122da370fcb7a3; no voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404
I20260709 13:04:48.823683 15961 raft_consensus.cc:2749] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.824167 15676 leader_election.cc:304] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5035240f624f4b3085122da370fcb7a3; no voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404
I20260709 13:04:48.825026 15961 raft_consensus.cc:2749] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:48.834430 15859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0" candidate_uuid: "60442fcc11144632a8398e85aafd6194" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb213d55b4044008b27bb097e8e6f404" is_pre_election: true
I20260709 13:04:48.836293 15751 leader_election.cc:304] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60442fcc11144632a8398e85aafd6194; no voters: 5035240f624f4b3085122da370fcb7a3, eb213d55b4044008b27bb097e8e6f404
I20260709 13:04:48.837415 15939 raft_consensus.cc:2749] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:48.863354 15607 catalog_manager.cc:5697] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb213d55b4044008b27bb097e8e6f404 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "eb213d55b4044008b27bb097e8e6f404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.936522 15859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306"
dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
mode: GRACEFUL
new_leader_uuid: "5035240f624f4b3085122da370fcb7a3"
 from {username='slave'} at 127.0.0.1:42730
I20260709 13:04:48.937171 15859 raft_consensus.cc:606] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Received request to transfer leadership to TS 5035240f624f4b3085122da370fcb7a3
I20260709 13:04:48.943346 15859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0"
dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
mode: GRACEFUL
new_leader_uuid: "60442fcc11144632a8398e85aafd6194"
 from {username='slave'} at 127.0.0.1:42730
I20260709 13:04:48.943909 15859 raft_consensus.cc:606] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Received request to transfer leadership to TS 60442fcc11144632a8398e85aafd6194
I20260709 13:04:48.950345 15859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa8e37763e14059a44920015b4a03d4"
dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
mode: GRACEFUL
new_leader_uuid: "5035240f624f4b3085122da370fcb7a3"
 from {username='slave'} at 127.0.0.1:42730
I20260709 13:04:48.950893 15859 raft_consensus.cc:606] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Received request to transfer leadership to TS 5035240f624f4b3085122da370fcb7a3
I20260709 13:04:48.956549 15859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2"
dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
mode: GRACEFUL
new_leader_uuid: "5035240f624f4b3085122da370fcb7a3"
 from {username='slave'} at 127.0.0.1:42730
I20260709 13:04:48.957095 15859 raft_consensus.cc:606] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Received request to transfer leadership to TS 5035240f624f4b3085122da370fcb7a3
I20260709 13:04:48.977447 15953 consensus_queue.cc:1048] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.995316 15935 consensus_queue.cc:1048] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:49.013245 15938 raft_consensus.cc:993] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: : Instructing follower 5035240f624f4b3085122da370fcb7a3 to start an election
I20260709 13:04:49.013715 15938 raft_consensus.cc:1081] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Signalling peer 5035240f624f4b3085122da370fcb7a3 to start an election
I20260709 13:04:49.015995 15706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2"
dest_uuid: "5035240f624f4b3085122da370fcb7a3"
 from {username='slave'} at 127.0.0.1:53238
I20260709 13:04:49.016825 15706 raft_consensus.cc:493] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.017300 15706 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.024672 15935 raft_consensus.cc:993] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404: : Instructing follower 5035240f624f4b3085122da370fcb7a3 to start an election
I20260709 13:04:49.025203 15935 raft_consensus.cc:1081] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Signalling peer 5035240f624f4b3085122da370fcb7a3 to start an election
I20260709 13:04:49.027300 15705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fa8e37763e14059a44920015b4a03d4"
dest_uuid: "5035240f624f4b3085122da370fcb7a3"
 from {username='slave'} at 127.0.0.1:53238
I20260709 13:04:49.027938 15705 raft_consensus.cc:493] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.028371 15705 raft_consensus.cc:3060] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.029356 15706 raft_consensus.cc:515] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.034801 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60442fcc11144632a8398e85aafd6194"
I20260709 13:04:49.035521 15785 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.037374 15705 raft_consensus.cc:515] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.040504 15705 leader_election.cc:290] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895), eb213d55b4044008b27bb097e8e6f404 (127.7.28.195:37577)
I20260709 13:04:49.040463 15784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa8e37763e14059a44920015b4a03d4" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60442fcc11144632a8398e85aafd6194"
I20260709 13:04:49.041536 15784 raft_consensus.cc:3060] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.040697 15859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa8e37763e14059a44920015b4a03d4" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
I20260709 13:04:49.046157 15859 raft_consensus.cc:3055] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.046528 15859 raft_consensus.cc:740] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:49.047585 15859 consensus_queue.cc:260] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.048995 15859 raft_consensus.cc:3060] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.051440 15784 raft_consensus.cc:2468] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5035240f624f4b3085122da370fcb7a3 in term 2.
I20260709 13:04:49.053136 15674 leader_election.cc:304] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5035240f624f4b3085122da370fcb7a3, 60442fcc11144632a8398e85aafd6194; no voters: 
I20260709 13:04:49.054318 15961 raft_consensus.cc:2804] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.054865 15961 raft_consensus.cc:697] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Becoming Leader. State: Replica: 5035240f624f4b3085122da370fcb7a3, State: Running, Role: LEADER
I20260709 13:04:49.055655 15785 raft_consensus.cc:2468] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5035240f624f4b3085122da370fcb7a3 in term 2.
I20260709 13:04:49.056092 15961 consensus_queue.cc:237] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.059100 15674 leader_election.cc:304] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5035240f624f4b3085122da370fcb7a3, 60442fcc11144632a8398e85aafd6194; no voters: 
I20260709 13:04:49.060377 15946 raft_consensus.cc:2804] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.065248 15946 raft_consensus.cc:697] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Becoming Leader. State: Replica: 5035240f624f4b3085122da370fcb7a3, State: Running, Role: LEADER
I20260709 13:04:49.067133 15706 leader_election.cc:290] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895), eb213d55b4044008b27bb097e8e6f404 (127.7.28.195:37577)
I20260709 13:04:49.068552 15858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
I20260709 13:04:49.069347 15858 raft_consensus.cc:3055] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.069689 15858 raft_consensus.cc:740] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:49.066591 15946 consensus_queue.cc:237] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.070760 15858 consensus_queue.cc:260] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.074106 15858 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.078176 15859 raft_consensus.cc:2468] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5035240f624f4b3085122da370fcb7a3 in term 2.
I20260709 13:04:49.078477 15607 catalog_manager.cc:5697] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 reported cstate change: term changed from 1 to 2, leader changed from eb213d55b4044008b27bb097e8e6f404 (127.7.28.195) to 5035240f624f4b3085122da370fcb7a3 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "5035240f624f4b3085122da370fcb7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.084075 15858 raft_consensus.cc:2468] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5035240f624f4b3085122da370fcb7a3 in term 2.
I20260709 13:04:49.094400 15603 catalog_manager.cc:5697] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 reported cstate change: term changed from 1 to 2, leader changed from eb213d55b4044008b27bb097e8e6f404 (127.7.28.195) to 5035240f624f4b3085122da370fcb7a3 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "5035240f624f4b3085122da370fcb7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.109176 15938 raft_consensus.cc:993] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404: : Instructing follower 60442fcc11144632a8398e85aafd6194 to start an election
I20260709 13:04:49.109666 15938 raft_consensus.cc:1081] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Signalling peer 60442fcc11144632a8398e85aafd6194 to start an election
I20260709 13:04:49.111753 15785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0"
dest_uuid: "60442fcc11144632a8398e85aafd6194"
 from {username='slave'} at 127.0.0.1:55604
I20260709 13:04:49.112295 15785 raft_consensus.cc:493] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.112643 15785 raft_consensus.cc:3060] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.117769 15785 raft_consensus.cc:515] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.119570 15785 leader_election.cc:290] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [CANDIDATE]: Term 2 election: Requested vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), eb213d55b4044008b27bb097e8e6f404 (127.7.28.195:37577)
I20260709 13:04:49.120553 15706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0" candidate_uuid: "60442fcc11144632a8398e85aafd6194" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5035240f624f4b3085122da370fcb7a3"
I20260709 13:04:49.120748 15858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dce4a3d96114270b73cef839b9fcbf0" candidate_uuid: "60442fcc11144632a8398e85aafd6194" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
I20260709 13:04:49.121316 15706 raft_consensus.cc:3060] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.121402 15858 raft_consensus.cc:3055] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.121991 15858 raft_consensus.cc:740] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:49.122972 15858 consensus_queue.cc:260] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.124320 15858 raft_consensus.cc:3060] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.130265 15858 raft_consensus.cc:2468] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60442fcc11144632a8398e85aafd6194 in term 2.
I20260709 13:04:49.131582 15751 leader_election.cc:304] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:49.132239 15706 raft_consensus.cc:2468] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60442fcc11144632a8398e85aafd6194 in term 2.
I20260709 13:04:49.132520 15939 raft_consensus.cc:2804] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.133198 15939 raft_consensus.cc:697] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 2 LEADER]: Becoming Leader. State: Replica: 60442fcc11144632a8398e85aafd6194, State: Running, Role: LEADER
I20260709 13:04:49.134295 15939 consensus_queue.cc:237] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.143604 15605 catalog_manager.cc:5697] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 reported cstate change: term changed from 1 to 2, leader changed from eb213d55b4044008b27bb097e8e6f404 (127.7.28.195) to 60442fcc11144632a8398e85aafd6194 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "60442fcc11144632a8398e85aafd6194" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.259690 15938 raft_consensus.cc:993] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404: : Instructing follower 5035240f624f4b3085122da370fcb7a3 to start an election
I20260709 13:04:49.260196 15953 raft_consensus.cc:1081] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Signalling peer 5035240f624f4b3085122da370fcb7a3 to start an election
I20260709 13:04:49.261656 15706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306"
dest_uuid: "5035240f624f4b3085122da370fcb7a3"
 from {username='slave'} at 127.0.0.1:53238
I20260709 13:04:49.262203 15706 raft_consensus.cc:493] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.262475 15706 raft_consensus.cc:3060] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.267671 15706 raft_consensus.cc:515] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:49.269397 15706 leader_election.cc:290] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895), eb213d55b4044008b27bb097e8e6f404 (127.7.28.195:37577)
I20260709 13:04:49.270450 15785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60442fcc11144632a8398e85aafd6194"
I20260709 13:04:49.270687 15858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1384fd2aede04689a2f11fbefa850306" candidate_uuid: "5035240f624f4b3085122da370fcb7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
I20260709 13:04:49.271040 15785 raft_consensus.cc:3060] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.271404 15858 raft_consensus.cc:3055] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.271736 15858 raft_consensus.cc:740] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:49.272668 15858 consensus_queue.cc:260] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:49.274060 15858 raft_consensus.cc:3060] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.277619 15785 raft_consensus.cc:2468] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5035240f624f4b3085122da370fcb7a3 in term 2.
I20260709 13:04:49.278771 15674 leader_election.cc:304] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5035240f624f4b3085122da370fcb7a3, 60442fcc11144632a8398e85aafd6194; no voters: 
I20260709 13:04:49.279520 15961 raft_consensus.cc:2804] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.279966 15961 raft_consensus.cc:697] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Becoming Leader. State: Replica: 5035240f624f4b3085122da370fcb7a3, State: Running, Role: LEADER
I20260709 13:04:49.280925 15961 consensus_queue.cc:237] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
I20260709 13:04:49.281886 15858 raft_consensus.cc:2468] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5035240f624f4b3085122da370fcb7a3 in term 2.
I20260709 13:04:49.288790 15603 catalog_manager.cc:5697] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 reported cstate change: term changed from 1 to 2, leader changed from eb213d55b4044008b27bb097e8e6f404 (127.7.28.195) to 5035240f624f4b3085122da370fcb7a3 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "5035240f624f4b3085122da370fcb7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.448079  7283 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:04:49.449883  7283 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:04:49.450312  7283 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:04:49.462855 15706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2"
dest_uuid: "5035240f624f4b3085122da370fcb7a3"
mode: GRACEFUL
new_leader_uuid: "eb213d55b4044008b27bb097e8e6f404"
 from {username='slave'} at 127.0.0.1:53252
I20260709 13:04:49.463454 15706 raft_consensus.cc:606] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Received request to transfer leadership to TS eb213d55b4044008b27bb097e8e6f404
I20260709 13:04:49.464653  7283 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:04:49.490940 15785 raft_consensus.cc:1275] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Refusing update from remote peer 5035240f624f4b3085122da370fcb7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.492223 15961 consensus_queue.cc:1048] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.497720 15784 raft_consensus.cc:1275] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Refusing update from remote peer 5035240f624f4b3085122da370fcb7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.499465 15961 consensus_queue.cc:1048] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.505187 15858 raft_consensus.cc:1275] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Refusing update from remote peer 5035240f624f4b3085122da370fcb7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.506954 15946 consensus_queue.cc:1048] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.512615 15859 raft_consensus.cc:1275] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Refusing update from remote peer 5035240f624f4b3085122da370fcb7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.517963 15971 consensus_queue.cc:1048] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:49.523991 15857 raft_consensus.cc:1275] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Refusing update from remote peer 60442fcc11144632a8398e85aafd6194: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.525838 15939 consensus_queue.cc:1048] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.529681 15946 raft_consensus.cc:993] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3: : Instructing follower eb213d55b4044008b27bb097e8e6f404 to start an election
I20260709 13:04:49.530334 15946 raft_consensus.cc:1081] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Signalling peer eb213d55b4044008b27bb097e8e6f404 to start an election
I20260709 13:04:49.539460 15706 raft_consensus.cc:1275] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Refusing update from remote peer 60442fcc11144632a8398e85aafd6194: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.541029 15958 consensus_queue.cc:1048] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:49.541404 15857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2"
dest_uuid: "eb213d55b4044008b27bb097e8e6f404"
 from {username='slave'} at 127.0.0.1:42722
I20260709 13:04:49.542125 15857 raft_consensus.cc:493] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.542543 15857 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.551777 15857 raft_consensus.cc:515] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.554131 15857 leader_election.cc:290] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 election: Requested vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
I20260709 13:04:49.555313 15706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5035240f624f4b3085122da370fcb7a3"
I20260709 13:04:49.555589 15784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4334f7c5ce6c43768c419a4caeb8f0e2" candidate_uuid: "eb213d55b4044008b27bb097e8e6f404" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60442fcc11144632a8398e85aafd6194"
I20260709 13:04:49.556030 15706 raft_consensus.cc:3055] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:49.556272 15784 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.556402 15706 raft_consensus.cc:740] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5035240f624f4b3085122da370fcb7a3, State: Running, Role: LEADER
I20260709 13:04:49.557415 15706 consensus_queue.cc:260] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.558780 15706 raft_consensus.cc:3060] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.563791 15784 raft_consensus.cc:2468] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 3.
I20260709 13:04:49.565241 15823 leader_election.cc:304] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60442fcc11144632a8398e85aafd6194, eb213d55b4044008b27bb097e8e6f404; no voters: 
I20260709 13:04:49.566340 15953 raft_consensus.cc:2804] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:49.566704 15706 raft_consensus.cc:2468] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb213d55b4044008b27bb097e8e6f404 in term 3.
I20260709 13:04:49.566820 15953 raft_consensus.cc:697] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 3 LEADER]: Becoming Leader. State: Replica: eb213d55b4044008b27bb097e8e6f404, State: Running, Role: LEADER
I20260709 13:04:49.568172 15953 consensus_queue.cc:237] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:49.575309 15603 catalog_manager.cc:5697] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 reported cstate change: term changed from 2 to 3, leader changed from 5035240f624f4b3085122da370fcb7a3 (127.7.28.193) to eb213d55b4044008b27bb097e8e6f404 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "eb213d55b4044008b27bb097e8e6f404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.601186  7283 tablet_server.cc:179] TabletServer@127.7.28.193:0 shutting down...
I20260709 13:04:49.625533  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:49.626459  7283 tablet_replica.cc:333] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3: stopping tablet replica
I20260709 13:04:49.627179  7283 raft_consensus.cc:2243] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:49.627650  7283 raft_consensus.cc:2272] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 5035240f624f4b3085122da370fcb7a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:49.630712  7283 tablet_replica.cc:333] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3: stopping tablet replica
I20260709 13:04:49.631299  7283 raft_consensus.cc:2243] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:49.632100  7283 raft_consensus.cc:2272] T 2fa8e37763e14059a44920015b4a03d4 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:49.636466  7283 tablet_replica.cc:333] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3: stopping tablet replica
I20260709 13:04:49.637043  7283 raft_consensus.cc:2243] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:49.637693  7283 pending_rounds.cc:70] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3: Trying to abort 1 pending ops.
I20260709 13:04:49.637974  7283 pending_rounds.cc:77] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634976905924608 op_type: NO_OP noop_request { }
I20260709 13:04:49.638511  7283 raft_consensus.cc:2889] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:49.638840  7283 raft_consensus.cc:2272] T 1384fd2aede04689a2f11fbefa850306 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:49.641495  7283 tablet_replica.cc:333] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3: stopping tablet replica
I20260709 13:04:49.642133  7283 raft_consensus.cc:2243] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:49.642596  7283 raft_consensus.cc:2272] T 4dce4a3d96114270b73cef839b9fcbf0 P 5035240f624f4b3085122da370fcb7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:49.667907  7283 tablet_server.cc:196] TabletServer@127.7.28.193:0 shutdown complete.
I20260709 13:04:49.684903  7283 tablet_server.cc:179] TabletServer@127.7.28.194:0 shutting down...
I20260709 13:04:49.706799  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:49.707497  7283 tablet_replica.cc:333] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194: stopping tablet replica
I20260709 13:04:49.708200  7283 raft_consensus.cc:2243] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:49.708673  7283 raft_consensus.cc:2272] T 4334f7c5ce6c43768c419a4caeb8f0e2 P 60442fcc11144632a8398e85aafd6194 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:49.711454  7283 tablet_replica.cc:333] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194: stopping tablet replica
I20260709 13:04:49.712023  7283 raft_consensus.cc:2243] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:49.712500  7283 raft_consensus.cc:2272] T 2fa8e37763e14059a44920015b4a03d4 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:49.715267  7283 tablet_replica.cc:333] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194: stopping tablet replica
I20260709 13:04:49.715827  7283 raft_consensus.cc:2243] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:49.716604  7283 raft_consensus.cc:2272] T 4dce4a3d96114270b73cef839b9fcbf0 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:49.719519  7283 tablet_replica.cc:333] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194: stopping tablet replica
I20260709 13:04:49.720085  7283 raft_consensus.cc:2243] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:49.720607  7283 raft_consensus.cc:2272] T 1384fd2aede04689a2f11fbefa850306 P 60442fcc11144632a8398e85aafd6194 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:49.804865 15880 debug-util.cc:398] Leaking SignalData structure 0x7b08001919e0 after lost signal to thread 7286
W20260709 13:04:49.806051 15880 debug-util.cc:398] Leaking SignalData structure 0x7b08001bcc40 after lost signal to thread 15642
W20260709 13:04:49.807230 15880 debug-util.cc:398] Leaking SignalData structure 0x7b0800155060 after lost signal to thread 15734
W20260709 13:04:49.837381 15806 debug-util.cc:398] Leaking SignalData structure 0x7b08003889c0 after lost signal to thread 7286
W20260709 13:04:49.838687 15806 debug-util.cc:398] Leaking SignalData structure 0x7b08002481e0 after lost signal to thread 15642
W20260709 13:04:49.841624 15806 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4380 after lost signal to thread 15884
W20260709 13:04:50.066200 15824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.28.193:46751: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260709 13:04:50.076741 15824 consensus_peers.cc:597] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 -> Peer 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751): Couldn't send request to peer 5035240f624f4b3085122da370fcb7a3. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:46751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.155108 15823 consensus_peers.cc:597] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 -> Peer 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895): Couldn't send request to peer 60442fcc11144632a8398e85aafd6194. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:38895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.733186  7283 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15806)
I20260709 13:04:51.024148 15953 raft_consensus.cc:493] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5035240f624f4b3085122da370fcb7a3)
I20260709 13:04:51.024960 15953 raft_consensus.cc:515] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:51.027732 15953 leader_election.cc:290] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
W20260709 13:04:51.034762 15824 leader_election.cc:336] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751): Network error: Client connection negotiation failed: client connection to 127.7.28.193:46751: connect: Connection refused (error 111)
W20260709 13:04:51.043069 15823 leader_election.cc:336] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895): Network error: Client connection negotiation failed: client connection to 127.7.28.194:38895: connect: Connection refused (error 111)
I20260709 13:04:51.043723 15823 leader_election.cc:304] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb213d55b4044008b27bb097e8e6f404; no voters: 5035240f624f4b3085122da370fcb7a3, 60442fcc11144632a8398e85aafd6194
I20260709 13:04:51.051571 15981 raft_consensus.cc:493] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60442fcc11144632a8398e85aafd6194)
I20260709 13:04:51.052987 15981 raft_consensus.cc:515] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:51.054016 15953 raft_consensus.cc:2749] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:51.061081 15824 leader_election.cc:336] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751): Network error: Client connection negotiation failed: client connection to 127.7.28.193:46751: connect: Connection refused (error 111)
I20260709 13:04:51.062666 15981 leader_election.cc:290] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
W20260709 13:04:51.068768 15823 leader_election.cc:336] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895): Network error: Client connection negotiation failed: client connection to 127.7.28.194:38895: connect: Connection refused (error 111)
I20260709 13:04:51.069331 15823 leader_election.cc:304] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb213d55b4044008b27bb097e8e6f404; no voters: 5035240f624f4b3085122da370fcb7a3, 60442fcc11144632a8398e85aafd6194
I20260709 13:04:51.070276 15981 raft_consensus.cc:2749] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.102902 15981 raft_consensus.cc:493] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.103546 15981 raft_consensus.cc:515] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } } peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } }
W20260709 13:04:51.112011 15823 leader_election.cc:336] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895): Network error: Client connection negotiation failed: client connection to 127.7.28.194:38895: connect: Connection refused (error 111)
W20260709 13:04:51.112815 15824 leader_election.cc:336] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751): Network error: Client connection negotiation failed: client connection to 127.7.28.193:46751: connect: Connection refused (error 111)
I20260709 13:04:51.113111 15981 leader_election.cc:290] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895), 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751)
I20260709 13:04:51.113497 15824 leader_election.cc:304] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb213d55b4044008b27bb097e8e6f404; no voters: 5035240f624f4b3085122da370fcb7a3, 60442fcc11144632a8398e85aafd6194
I20260709 13:04:51.114493 15981 raft_consensus.cc:2749] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:51.736925  7283 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15806)
W20260709 13:04:52.401883 15824 consensus_peers.cc:597] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 -> Peer 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751): Couldn't send request to peer 5035240f624f4b3085122da370fcb7a3. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:46751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:52.665946 15823 consensus_peers.cc:597] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 -> Peer 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895): Couldn't send request to peer 60442fcc11144632a8398e85aafd6194. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:38895: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:52.737577  7283 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15806)
I20260709 13:04:52.941118  7283 tablet_server.cc:196] TabletServer@127.7.28.194:0 shutdown complete.
I20260709 13:04:52.962158  7283 tablet_server.cc:179] TabletServer@127.7.28.195:0 shutting down...
I20260709 13:04:52.975564 15981 raft_consensus.cc:493] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60442fcc11144632a8398e85aafd6194)
I20260709 13:04:52.976140 15981 raft_consensus.cc:515] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5035240f624f4b3085122da370fcb7a3" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 46751 } } peers { permanent_uuid: "60442fcc11144632a8398e85aafd6194" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 38895 } } peers { permanent_uuid: "eb213d55b4044008b27bb097e8e6f404" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 37577 } }
I20260709 13:04:52.978155 15981 leader_election.cc:290] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751), 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895)
W20260709 13:04:52.985194 15824 leader_election.cc:336] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5035240f624f4b3085122da370fcb7a3 (127.7.28.193:46751): Network error: Client connection negotiation failed: client connection to 127.7.28.193:46751: connect: Connection refused (error 111)
W20260709 13:04:52.987658 15823 leader_election.cc:336] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60442fcc11144632a8398e85aafd6194 (127.7.28.194:38895): Network error: Client connection negotiation failed: client connection to 127.7.28.194:38895: connect: Connection refused (error 111)
I20260709 13:04:52.988225 15823 leader_election.cc:304] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb213d55b4044008b27bb097e8e6f404; no voters: 5035240f624f4b3085122da370fcb7a3, 60442fcc11144632a8398e85aafd6194
I20260709 13:04:52.989087 15981 raft_consensus.cc:2749] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.998886  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:52.999871  7283 tablet_replica.cc:333] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: stopping tablet replica
I20260709 13:04:53.000633  7283 raft_consensus.cc:2243] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:53.001443  7283 pending_rounds.cc:70] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: Trying to abort 1 pending ops.
I20260709 13:04:53.001643  7283 pending_rounds.cc:77] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634978081243136 op_type: NO_OP noop_request { }
I20260709 13:04:53.002023  7283 raft_consensus.cc:2889] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:53.002318  7283 raft_consensus.cc:2272] T 4334f7c5ce6c43768c419a4caeb8f0e2 P eb213d55b4044008b27bb097e8e6f404 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.004658  7283 tablet_replica.cc:333] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404: stopping tablet replica
I20260709 13:04:53.005298  7283 raft_consensus.cc:2243] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.005772  7283 raft_consensus.cc:2272] T 2fa8e37763e14059a44920015b4a03d4 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.008308  7283 tablet_replica.cc:333] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404: stopping tablet replica
I20260709 13:04:53.008886  7283 raft_consensus.cc:2243] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.009315  7283 raft_consensus.cc:2272] T 4dce4a3d96114270b73cef839b9fcbf0 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.011766  7283 tablet_replica.cc:333] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404: stopping tablet replica
I20260709 13:04:53.012296  7283 raft_consensus.cc:2243] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.012698  7283 raft_consensus.cc:2272] T 1384fd2aede04689a2f11fbefa850306 P eb213d55b4044008b27bb097e8e6f404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.885668  7283 tablet_server.cc:196] TabletServer@127.7.28.195:0 shutdown complete.
I20260709 13:04:53.903967  7283 master.cc:562] Master@127.7.28.254:33359 shutting down...
I20260709 13:04:53.926448  7283 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:53.927130  7283 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.927503  7283 tablet_replica.cc:333] T 00000000000000000000000000000000 P dc260353cdb4459ca18c4160e5f8af46: stopping tablet replica
I20260709 13:04:53.948683  7283 master.cc:584] Master@127.7.28.254:33359 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (8480 ms)
[----------] 6 tests from LeaderRebalancerTest (244436 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:04:53.988266  7283 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.28.254:35923
I20260709 13:04:53.989373  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.995255 15983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.995333 15984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.996091 15986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.997166  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:53.998067  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:53.998274  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.998459  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602293998440 us; error 0 us; skew 500 ppm
I20260709 13:04:53.998967  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:54.002142  7283 webserver.cc:533] Webserver started at http://127.7.28.254:43937/ using document root <none> and password file <none>
I20260709 13:04:54.002647  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:54.002846  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:54.003113  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:54.004272  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/master-0-root/instance:
uuid: "f82d8fc081de4064a52ec325fcfebe82"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-ll1f"
I20260709 13:04:54.008695  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:04:54.012244 15991 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.013168  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:04:54.013438  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/master-0-root
uuid: "f82d8fc081de4064a52ec325fcfebe82"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-ll1f"
I20260709 13:04:54.013680  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:54.023010  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:54.024184  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:54.062914  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.254:35923
I20260709 13:04:54.063083 16042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.254:35923 every 8 connection(s)
I20260709 13:04:54.067020 16043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.078682 16043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82: Bootstrap starting.
I20260709 13:04:54.083791 16043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.088295 16043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82: No bootstrap required, opened a new log
I20260709 13:04:54.090471 16043 raft_consensus.cc:359] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f82d8fc081de4064a52ec325fcfebe82" member_type: VOTER }
I20260709 13:04:54.090849 16043 raft_consensus.cc:385] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.091030 16043 raft_consensus.cc:740] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82d8fc081de4064a52ec325fcfebe82, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.091517 16043 consensus_queue.cc:260] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f82d8fc081de4064a52ec325fcfebe82" member_type: VOTER }
I20260709 13:04:54.091950 16043 raft_consensus.cc:399] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:54.092137 16043 raft_consensus.cc:493] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:54.092348 16043 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.097213 16043 raft_consensus.cc:515] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f82d8fc081de4064a52ec325fcfebe82" member_type: VOTER }
I20260709 13:04:54.097713 16043 leader_election.cc:304] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f82d8fc081de4064a52ec325fcfebe82; no voters: 
I20260709 13:04:54.098832 16043 leader_election.cc:290] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:54.099249 16046 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.100657 16046 raft_consensus.cc:697] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 1 LEADER]: Becoming Leader. State: Replica: f82d8fc081de4064a52ec325fcfebe82, State: Running, Role: LEADER
I20260709 13:04:54.101331 16046 consensus_queue.cc:237] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f82d8fc081de4064a52ec325fcfebe82" member_type: VOTER }
I20260709 13:04:54.102015 16043 sys_catalog.cc:565] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:54.105610 16047 sys_catalog.cc:455] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f82d8fc081de4064a52ec325fcfebe82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f82d8fc081de4064a52ec325fcfebe82" member_type: VOTER } }
I20260709 13:04:54.106428 16047 sys_catalog.cc:458] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:54.106367 16048 sys_catalog.cc:455] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f82d8fc081de4064a52ec325fcfebe82. Latest consensus state: current_term: 1 leader_uuid: "f82d8fc081de4064a52ec325fcfebe82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f82d8fc081de4064a52ec325fcfebe82" member_type: VOTER } }
I20260709 13:04:54.107264 16048 sys_catalog.cc:458] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:54.109903 16053 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:54.118247 16053 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:54.119292  7283 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:54.127619 16053 catalog_manager.cc:1383] Generated new cluster ID: 73584344ee4b411ca42f4be791126c80
I20260709 13:04:54.127934 16053 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:54.145576 16053 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:54.146938 16053 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:54.167732 16053 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82: Generated new TSK 0
I20260709 13:04:54.168381 16053 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:54.186823  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:54.192960 16064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.194269 16065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.196277 16067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.198961  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:54.200017  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:54.200264  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:54.200434  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602294200414 us; error 0 us; skew 500 ppm
I20260709 13:04:54.200971  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:54.203567  7283 webserver.cc:533] Webserver started at http://127.7.28.193:42149/ using document root <none> and password file <none>
I20260709 13:04:54.204114  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:54.204320  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:54.204598  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:54.205771  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-0-root/instance:
uuid: "e86ef4d3d63c483d975d4022f3093da0"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-ll1f"
I20260709 13:04:54.210429  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:04:54.214210 16072 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.215287  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:04:54.215626  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "e86ef4d3d63c483d975d4022f3093da0"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-ll1f"
I20260709 13:04:54.216041  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:54.241894  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:54.243309  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:54.244956  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:54.247648  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:54.247921  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.248198  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:54.248412  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.293169  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:37577
I20260709 13:04:54.293304 16134 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:37577 every 8 connection(s)
I20260709 13:04:54.298698  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:54.306354 16139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.308715 16140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.312296  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:54.312841 16135 heartbeater.cc:344] Connected to a master server at 127.7.28.254:35923
I20260709 13:04:54.313282 16135 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:54.313952 16142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.314105 16135 heartbeater.cc:507] Master 127.7.28.254:35923 requested a full tablet report, sending...
I20260709 13:04:54.315059  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:54.315325  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:54.315552  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602294315529 us; error 0 us; skew 500 ppm
I20260709 13:04:54.316223  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:54.316551 16008 ts_manager.cc:194] Registered new tserver with Master: e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577)
I20260709 13:04:54.318758 16008 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47646
I20260709 13:04:54.319283  7283 webserver.cc:533] Webserver started at http://127.7.28.194:41911/ using document root <none> and password file <none>
I20260709 13:04:54.319964  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:54.320220  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:54.320551  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:54.322093  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-1-root/instance:
uuid: "c6459ab11719439fa9b7baf76983e832"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-ll1f"
I20260709 13:04:54.326598  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:54.330122 16147 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.330881  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:54.331214  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-1-root
uuid: "c6459ab11719439fa9b7baf76983e832"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-ll1f"
I20260709 13:04:54.331487  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:54.344061  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:54.345362  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:54.347019  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:54.349438  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:54.350203  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
I20260709 13:04:54.350508  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:54.350687  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.394573  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.194:46241
I20260709 13:04:54.394699 16209 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.194:46241 every 8 connection(s)
I20260709 13:04:54.399587  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:54.408627 16213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.409240 16214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.410775 16216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.413408  7283 server_base.cc:1061] running on GCE node
I20260709 13:04:54.414587  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:54.414633 16210 heartbeater.cc:344] Connected to a master server at 127.7.28.254:35923
W20260709 13:04:54.414924  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:54.415099 16210 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:54.415148  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602294415128 us; error 0 us; skew 500 ppm
I20260709 13:04:54.416136  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:54.416199 16210 heartbeater.cc:507] Master 127.7.28.254:35923 requested a full tablet report, sending...
I20260709 13:04:54.418949 16008 ts_manager.cc:194] Registered new tserver with Master: c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:54.419207  7283 webserver.cc:533] Webserver started at http://127.7.28.195:44297/ using document root <none> and password file <none>
I20260709 13:04:54.419910  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:54.420152  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:54.420476  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:54.420923 16008 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47660
I20260709 13:04:54.422120  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-2-root/instance:
uuid: "406177939488436e998d9cc938163a91"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-ll1f"
I20260709 13:04:54.427222  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:54.430794 16221 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.431607  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:54.431908  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-2-root
uuid: "406177939488436e998d9cc938163a91"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-ll1f"
I20260709 13:04:54.432156  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602049386691-7283-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:54.449529  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:54.451004  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:54.452525  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:54.454919  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:54.455114  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.455411  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:54.455560  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.498406  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.195:40277
I20260709 13:04:54.498543 16283 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.195:40277 every 8 connection(s)
I20260709 13:04:54.513155 16284 heartbeater.cc:344] Connected to a master server at 127.7.28.254:35923
I20260709 13:04:54.513603 16284 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:54.514320 16284 heartbeater.cc:507] Master 127.7.28.254:35923 requested a full tablet report, sending...
I20260709 13:04:54.516206 16008 ts_manager.cc:194] Registered new tserver with Master: 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:54.516350  7283 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014819617s
I20260709 13:04:54.517630 16008 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47666
I20260709 13:04:54.543267 16008 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47678:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:54.546093 16008 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:54.616851 16100 tablet_service.cc:1511] Processing CreateTablet for tablet 396c2802a4c145e0897bf51d63bf8b73 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.617487 16099 tablet_service.cc:1511] Processing CreateTablet for tablet 822b4008c46a46f2b10fa35f37f29256 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.618400 16100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396c2802a4c145e0897bf51d63bf8b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.619202 16099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822b4008c46a46f2b10fa35f37f29256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.621068 16175 tablet_service.cc:1511] Processing CreateTablet for tablet 396c2802a4c145e0897bf51d63bf8b73 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.622582 16175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396c2802a4c145e0897bf51d63bf8b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.626962 16174 tablet_service.cc:1511] Processing CreateTablet for tablet 822b4008c46a46f2b10fa35f37f29256 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.628463 16174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822b4008c46a46f2b10fa35f37f29256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.630982 16098 tablet_service.cc:1511] Processing CreateTablet for tablet bc54ca9c964a44a8ae7125556f8c691f (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.632505 16098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc54ca9c964a44a8ae7125556f8c691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.633482 16249 tablet_service.cc:1511] Processing CreateTablet for tablet 396c2802a4c145e0897bf51d63bf8b73 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.635113 16173 tablet_service.cc:1511] Processing CreateTablet for tablet bc54ca9c964a44a8ae7125556f8c691f (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.636618 16248 tablet_service.cc:1511] Processing CreateTablet for tablet 822b4008c46a46f2b10fa35f37f29256 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.637379 16097 tablet_service.cc:1511] Processing CreateTablet for tablet e3031d485f54441888e8e6ef1a325929 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.638796 16097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3031d485f54441888e8e6ef1a325929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.639920 16247 tablet_service.cc:1511] Processing CreateTablet for tablet bc54ca9c964a44a8ae7125556f8c691f (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.635197 16249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396c2802a4c145e0897bf51d63bf8b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.642580 16248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822b4008c46a46f2b10fa35f37f29256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.642292 16172 tablet_service.cc:1511] Processing CreateTablet for tablet e3031d485f54441888e8e6ef1a325929 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.645143 16246 tablet_service.cc:1511] Processing CreateTablet for tablet e3031d485f54441888e8e6ef1a325929 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.646976 16246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3031d485f54441888e8e6ef1a325929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.647439 16096 tablet_service.cc:1511] Processing CreateTablet for tablet b95cdbc4f9e14650ad38752ea1bf411d (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.648813 16096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95cdbc4f9e14650ad38752ea1bf411d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.651974 16171 tablet_service.cc:1511] Processing CreateTablet for tablet b95cdbc4f9e14650ad38752ea1bf411d (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.654197 16247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc54ca9c964a44a8ae7125556f8c691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.658476 16173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc54ca9c964a44a8ae7125556f8c691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.655274 16245 tablet_service.cc:1511] Processing CreateTablet for tablet b95cdbc4f9e14650ad38752ea1bf411d (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.662068 16245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95cdbc4f9e14650ad38752ea1bf411d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.664211 16171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95cdbc4f9e14650ad38752ea1bf411d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.675864 16172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3031d485f54441888e8e6ef1a325929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.681181 16095 tablet_service.cc:1511] Processing CreateTablet for tablet 35dba36e7f6148fbba14032657943e9d (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.682782 16095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dba36e7f6148fbba14032657943e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.684660 16170 tablet_service.cc:1511] Processing CreateTablet for tablet 35dba36e7f6148fbba14032657943e9d (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.686446 16170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dba36e7f6148fbba14032657943e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.687009 16244 tablet_service.cc:1511] Processing CreateTablet for tablet 35dba36e7f6148fbba14032657943e9d (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.688988 16244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dba36e7f6148fbba14032657943e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.689339 16094 tablet_service.cc:1511] Processing CreateTablet for tablet cef1e9dd6c8847b787659ed9f87af311 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.690855 16094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef1e9dd6c8847b787659ed9f87af311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.705672 16169 tablet_service.cc:1511] Processing CreateTablet for tablet cef1e9dd6c8847b787659ed9f87af311 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.707235 16169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef1e9dd6c8847b787659ed9f87af311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.718544 16243 tablet_service.cc:1511] Processing CreateTablet for tablet cef1e9dd6c8847b787659ed9f87af311 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.720100 16243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef1e9dd6c8847b787659ed9f87af311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.740083 16168 tablet_service.cc:1511] Processing CreateTablet for tablet dc2f2d3b8a18442fa49b08cd6609ec92 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.741600 16168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2f2d3b8a18442fa49b08cd6609ec92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.743465 16093 tablet_service.cc:1511] Processing CreateTablet for tablet dc2f2d3b8a18442fa49b08cd6609ec92 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.748539 16093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2f2d3b8a18442fa49b08cd6609ec92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.754917 16246 tablet_service.cc:1511] Processing CreateTablet for tablet dc2f2d3b8a18442fa49b08cd6609ec92 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.757057 16246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2f2d3b8a18442fa49b08cd6609ec92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.771556 16099 tablet_service.cc:1511] Processing CreateTablet for tablet 10699b1acff542b48fe24849b5154054 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.773118 16099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10699b1acff542b48fe24849b5154054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.789399 16300 tablet_bootstrap.cc:492] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:54.796953 16167 tablet_service.cc:1511] Processing CreateTablet for tablet 10699b1acff542b48fe24849b5154054 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.798386 16167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10699b1acff542b48fe24849b5154054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.799503 16299 tablet_bootstrap.cc:492] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:54.803001 16300 tablet_bootstrap.cc:654] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.809424 16247 tablet_service.cc:1511] Processing CreateTablet for tablet 10699b1acff542b48fe24849b5154054 (DEFAULT_TABLE table=test-workload [id=a393b388826045ae8ef28b8c1d22a82a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.811480 16247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10699b1acff542b48fe24849b5154054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.829250 16301 tablet_bootstrap.cc:492] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:54.841140 16301 tablet_bootstrap.cc:654] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.843480 16299 tablet_bootstrap.cc:654] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.849352 16300 tablet_bootstrap.cc:492] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:54.849975 16300 ts_tablet_manager.cc:1403] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.061s	user 0.031s	sys 0.012s
I20260709 13:04:54.852099 16301 tablet_bootstrap.cc:492] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:54.852751 16301 ts_tablet_manager.cc:1403] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.002s
I20260709 13:04:54.853209 16299 tablet_bootstrap.cc:492] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:54.853111 16300 raft_consensus.cc:359] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.853834 16299 ts_tablet_manager.cc:1403] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.000s
I20260709 13:04:54.854103 16300 raft_consensus.cc:385] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.854461 16300 raft_consensus.cc:740] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.855306 16300 consensus_queue.cc:260] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.856308 16301 raft_consensus.cc:359] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.857143 16301 raft_consensus.cc:385] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.857548 16301 raft_consensus.cc:740] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.858389 16284 heartbeater.cc:499] Master 127.7.28.254:35923 was elected leader, sending a full tablet report...
I20260709 13:04:54.858897 16300 ts_tablet_manager.cc:1434] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:04:54.858568 16301 consensus_queue.cc:260] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.860018 16300 tablet_bootstrap.cc:492] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:54.861071 16210 heartbeater.cc:499] Master 127.7.28.254:35923 was elected leader, sending a full tablet report...
I20260709 13:04:54.861598 16301 ts_tablet_manager.cc:1434] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 13:04:54.857180 16299 raft_consensus.cc:359] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.862473 16299 raft_consensus.cc:385] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.862640 16301 tablet_bootstrap.cc:492] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:54.862865 16299 raft_consensus.cc:740] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.864034 16299 consensus_queue.cc:260] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.867641 16300 tablet_bootstrap.cc:654] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.869902 16301 tablet_bootstrap.cc:654] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.874176 16135 heartbeater.cc:499] Master 127.7.28.254:35923 was elected leader, sending a full tablet report...
I20260709 13:04:54.875175 16299 ts_tablet_manager.cc:1434] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.007s
I20260709 13:04:54.876724 16299 tablet_bootstrap.cc:492] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:54.886656 16299 tablet_bootstrap.cc:654] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.889156 16301 tablet_bootstrap.cc:492] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:54.889835 16301 ts_tablet_manager.cc:1403] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.001s
I20260709 13:04:54.896104 16300 tablet_bootstrap.cc:492] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:54.896212 16301 raft_consensus.cc:359] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.896960 16300 ts_tablet_manager.cc:1403] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.020s
I20260709 13:04:54.897210 16301 raft_consensus.cc:385] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.897567 16301 raft_consensus.cc:740] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.898509 16301 consensus_queue.cc:260] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.900866 16301 ts_tablet_manager.cc:1434] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:54.900460 16300 raft_consensus.cc:359] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.901311 16300 raft_consensus.cc:385] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.901644 16300 raft_consensus.cc:740] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.902099 16301 tablet_bootstrap.cc:492] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:54.902567 16300 consensus_queue.cc:260] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.905851 16299 tablet_bootstrap.cc:492] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:54.906739 16299 ts_tablet_manager.cc:1403] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 13:04:54.910059 16301 tablet_bootstrap.cc:654] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.910012 16299 raft_consensus.cc:359] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.910912 16299 raft_consensus.cc:385] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.911258 16299 raft_consensus.cc:740] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.912303 16299 consensus_queue.cc:260] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.915782 16300 ts_tablet_manager.cc:1434] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:54.917238 16300 tablet_bootstrap.cc:492] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:54.920102 16299 ts_tablet_manager.cc:1434] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:54.921607 16299 tablet_bootstrap.cc:492] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:54.925598 16301 tablet_bootstrap.cc:492] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:54.926308 16301 ts_tablet_manager.cc:1403] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.013s
I20260709 13:04:54.928882 16299 tablet_bootstrap.cc:654] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.929486 16300 tablet_bootstrap.cc:654] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.929548 16301 raft_consensus.cc:359] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.930605 16301 raft_consensus.cc:385] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.930948 16301 raft_consensus.cc:740] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.931914 16301 consensus_queue.cc:260] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.940335 16301 ts_tablet_manager.cc:1434] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:54.941293 16299 tablet_bootstrap.cc:492] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:54.941715 16301 tablet_bootstrap.cc:492] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:54.941817 16300 tablet_bootstrap.cc:492] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:54.941996 16299 ts_tablet_manager.cc:1403] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.015s
I20260709 13:04:54.942700 16300 ts_tablet_manager.cc:1403] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 13:04:54.945623 16299 raft_consensus.cc:359] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.945901 16300 raft_consensus.cc:359] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.946542 16299 raft_consensus.cc:385] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.946729 16300 raft_consensus.cc:385] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.946954 16299 raft_consensus.cc:740] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.947131 16300 raft_consensus.cc:740] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.947969 16299 consensus_queue.cc:260] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.948112 16300 consensus_queue.cc:260] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.950382 16299 ts_tablet_manager.cc:1434] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:54.951519 16299 tablet_bootstrap.cc:492] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:54.952332 16300 ts_tablet_manager.cc:1434] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:04:54.953541 16300 tablet_bootstrap.cc:492] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:54.955932 16301 tablet_bootstrap.cc:654] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.958369 16299 tablet_bootstrap.cc:654] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.960433 16300 tablet_bootstrap.cc:654] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.968582 16301 tablet_bootstrap.cc:492] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:54.969240 16301 ts_tablet_manager.cc:1403] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 13:04:54.969491 16299 tablet_bootstrap.cc:492] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:54.970248 16299 ts_tablet_manager.cc:1403] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:04:54.971374 16306 raft_consensus.cc:493] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.971909 16306 raft_consensus.cc:515] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.972394 16301 raft_consensus.cc:359] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.973189 16301 raft_consensus.cc:385] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.973520 16301 raft_consensus.cc:740] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.973253 16299 raft_consensus.cc:359] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.974165 16299 raft_consensus.cc:385] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.974496 16299 raft_consensus.cc:740] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.976187 16299 consensus_queue.cc:260] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.977903 16306 leader_election.cc:290] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:54.978956 16300 tablet_bootstrap.cc:492] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:54.979526 16300 ts_tablet_manager.cc:1403] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
I20260709 13:04:54.980664 16299 ts_tablet_manager.cc:1434] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:54.981851 16299 tablet_bootstrap.cc:492] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:54.981729 16301 consensus_queue.cc:260] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.982558 16300 raft_consensus.cc:359] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.988243 16300 raft_consensus.cc:385] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.988698 16300 raft_consensus.cc:740] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.990159 16301 ts_tablet_manager.cc:1434] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:04:54.989775 16300 consensus_queue.cc:260] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:54.992851 16301 tablet_bootstrap.cc:492] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:54.993538 16299 tablet_bootstrap.cc:654] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.999394 16300 ts_tablet_manager.cc:1434] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:04:55.000659 16300 tablet_bootstrap.cc:492] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:55.008754 16301 tablet_bootstrap.cc:654] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.012619 16300 tablet_bootstrap.cc:654] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.015363 16299 tablet_bootstrap.cc:492] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:55.015908 16299 ts_tablet_manager.cc:1403] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:04:55.014187 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.018858 16299 raft_consensus.cc:359] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
W20260709 13:04:55.019207 16148 leader_election.cc:343] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 406177939488436e998d9cc938163a91 (127.7.28.195:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.019711 16299 raft_consensus.cc:385] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.020089 16299 raft_consensus.cc:740] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.020835 16299 consensus_queue.cc:260] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.023123 16299 ts_tablet_manager.cc:1434] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:55.024279 16299 tablet_bootstrap.cc:492] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:55.026666 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:55.027757 16110 raft_consensus.cc:2468] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 0.
I20260709 13:04:55.029836 16151 leader_election.cc:304] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 406177939488436e998d9cc938163a91
I20260709 13:04:55.031522 16306 raft_consensus.cc:2804] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.031991 16306 raft_consensus.cc:493] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.032336 16306 raft_consensus.cc:3060] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.033656 16307 raft_consensus.cc:493] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.034251 16307 raft_consensus.cc:515] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.037078 16307 leader_election.cc:290] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.031491 16299 tablet_bootstrap.cc:654] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.042642 16306 raft_consensus.cc:515] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.055120 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:55.056589 16306 leader_election.cc:290] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.056636 16110 raft_consensus.cc:3060] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.058771 16300 tablet_bootstrap.cc:492] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:55.059201 16301 tablet_bootstrap.cc:492] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:55.059537 16300 ts_tablet_manager.cc:1403] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.014s
I20260709 13:04:55.059492 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.059801 16301 ts_tablet_manager.cc:1403] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.009s
W20260709 13:04:55.061182 16148 leader_election.cc:343] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 406177939488436e998d9cc938163a91 (127.7.28.195:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.061959 16307 raft_consensus.cc:493] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.062397 16307 raft_consensus.cc:515] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.063127 16300 raft_consensus.cc:359] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.063934 16300 raft_consensus.cc:385] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.064014 16307 leader_election.cc:290] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.064254 16300 raft_consensus.cc:740] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.065075 16300 consensus_queue.cc:260] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.065909 16301 raft_consensus.cc:359] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.066691 16301 raft_consensus.cc:385] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.066993 16301 raft_consensus.cc:740] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.067414 16300 ts_tablet_manager.cc:1434] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:55.068147 16110 raft_consensus.cc:2468] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 1.
I20260709 13:04:55.067889 16301 consensus_queue.cc:260] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.068526 16300 tablet_bootstrap.cc:492] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:55.069518 16151 leader_election.cc:304] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 406177939488436e998d9cc938163a91
I20260709 13:04:55.070577 16306 raft_consensus.cc:2804] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.071020 16306 raft_consensus.cc:697] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:04:55.071864 16306 consensus_queue.cc:237] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.058889 16323 raft_consensus.cc:493] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.073734 16323 raft_consensus.cc:515] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.076996 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:55.077930 16300 tablet_bootstrap.cc:654] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:55.078619 16151 leader_election.cc:343] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.085568 16299 tablet_bootstrap.cc:492] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:55.086125 16299 ts_tablet_manager.cc:1403] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.003s
I20260709 13:04:55.088984 16323 leader_election.cc:290] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.089856 16299 raft_consensus.cc:359] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.090718 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.090714 16299 raft_consensus.cc:385] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.091473 16259 raft_consensus.cc:2468] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 0.
I20260709 13:04:55.091780 16299 raft_consensus.cc:740] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.092635 16299 consensus_queue.cc:260] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.093042 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.094278 16307 raft_consensus.cc:493] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.094743 16307 raft_consensus.cc:515] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.092648 16301 ts_tablet_manager.cc:1434] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.032s	user 0.000s	sys 0.014s
I20260709 13:04:55.096926 16307 leader_election.cc:290] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.098058 16301 tablet_bootstrap.cc:492] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:55.098441 16300 tablet_bootstrap.cc:492] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:55.098950 16300 ts_tablet_manager.cc:1403] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.005s
I20260709 13:04:55.098929 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef1e9dd6c8847b787659ed9f87af311" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.101076 16148 leader_election.cc:304] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.102530 16327 raft_consensus.cc:2804] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.102432 16300 raft_consensus.cc:359] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.103144 16327 raft_consensus.cc:493] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.103426 16300 raft_consensus.cc:385] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.103653 16327 raft_consensus.cc:3060] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.103899 16300 raft_consensus.cc:740] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.104755 16300 consensus_queue.cc:260] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.106304 16301 tablet_bootstrap.cc:654] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.107172 16300 ts_tablet_manager.cc:1434] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:04:55.108311 16300 tablet_bootstrap.cc:492] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:55.111364 16185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.125248 16300 tablet_bootstrap.cc:654] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.125356 16185 raft_consensus.cc:2468] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:55.111955 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef1e9dd6c8847b787659ed9f87af311" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.127199 16184 raft_consensus.cc:2468] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
W20260709 13:04:55.115136 16056 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:55.120059 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031d485f54441888e8e6ef1a325929" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.119333 16005 catalog_manager.cc:5697] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:55.115654 16073 leader_election.cc:343] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 406177939488436e998d9cc938163a91 (127.7.28.195:40277): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:55.131846 16073 leader_election.cc:343] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 406177939488436e998d9cc938163a91 (127.7.28.195:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.095070 16299 ts_tablet_manager.cc:1434] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 13:04:55.132987 16073 leader_election.cc:304] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 406177939488436e998d9cc938163a91
I20260709 13:04:55.135124 16328 raft_consensus.cc:2804] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.135742 16328 raft_consensus.cc:493] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.136198 16328 raft_consensus.cc:3060] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.134164 16299 tablet_bootstrap.cc:492] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:55.142972 16073 leader_election.cc:304] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 406177939488436e998d9cc938163a91
I20260709 13:04:55.136670 16327 raft_consensus.cc:515] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.124449 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031d485f54441888e8e6ef1a325929" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.146826 16259 raft_consensus.cc:2468] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:55.149518 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:55.150367 16307 raft_consensus.cc:2804] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.151048 16307 raft_consensus.cc:493] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.151568 16307 raft_consensus.cc:3060] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:55.151070 16151 leader_election.cc:343] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.154397 16301 tablet_bootstrap.cc:492] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:55.155026 16301 ts_tablet_manager.cc:1403] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.030s
I20260709 13:04:55.155135 16300 tablet_bootstrap.cc:492] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:55.155694 16300 ts_tablet_manager.cc:1403] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.032s
I20260709 13:04:55.156154 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.156848 16258 raft_consensus.cc:3060] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:55.158514 16073 leader_election.cc:343] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.161959 16327 leader_election.cc:290] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.162108 16307 raft_consensus.cc:515] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.163543 16299 tablet_bootstrap.cc:654] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.163807 16258 raft_consensus.cc:2468] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 1.
I20260709 13:04:55.164868 16307 leader_election.cc:290] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.165170 16148 leader_election.cc:304] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.166523 16327 raft_consensus.cc:2804] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.167973 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef1e9dd6c8847b787659ed9f87af311" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:55.168617 16183 raft_consensus.cc:3060] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.168738 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef1e9dd6c8847b787659ed9f87af311" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.169572 16328 raft_consensus.cc:515] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.158640 16301 raft_consensus.cc:359] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.170573 16301 raft_consensus.cc:385] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.158877 16300 raft_consensus.cc:359] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.169965 16073 leader_election.cc:304] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: c6459ab11719439fa9b7baf76983e832
I20260709 13:04:55.171528 16300 raft_consensus.cc:385] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.171913 16300 raft_consensus.cc:740] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.172029 16307 raft_consensus.cc:2804] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.171172 16301 raft_consensus.cc:740] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.172804 16307 raft_consensus.cc:493] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.172909 16300 consensus_queue.cc:260] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.172068 16328 leader_election.cc:290] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.175341 16307 raft_consensus.cc:3060] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.173415 16301 consensus_queue.cc:260] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.174196 16259 raft_consensus.cc:3060] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.175673 16300 ts_tablet_manager.cc:1434] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 13:04:55.177649 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:55.173550 16327 raft_consensus.cc:697] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:04:55.179008 16257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.180377 16184 raft_consensus.cc:3060] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.181885 16301 ts_tablet_manager.cc:1434] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:04:55.181012 16300 tablet_bootstrap.cc:492] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:55.191206 16301 tablet_bootstrap.cc:492] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:55.182723 16327 consensus_queue.cc:237] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.180119 16183 raft_consensus.cc:2468] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.197108 16328 raft_consensus.cc:493] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.198671 16328 raft_consensus.cc:515] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.200601 16073 leader_election.cc:304] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:55.205598 16328 leader_election.cc:290] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.206986 16300 tablet_bootstrap.cc:654] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.216586 16299 tablet_bootstrap.cc:492] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:55.216391 16307 raft_consensus.cc:515] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.217216 16299 ts_tablet_manager.cc:1403] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.083s	user 0.026s	sys 0.010s
I20260709 13:04:55.218609 16307 leader_election.cc:290] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.207899 16301 tablet_bootstrap.cc:654] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.210372 16184 raft_consensus.cc:2468] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.211947 16335 raft_consensus.cc:2804] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.214392 16259 raft_consensus.cc:2468] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
W20260709 13:04:55.212707 16073 leader_election.cc:343] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 406177939488436e998d9cc938163a91 (127.7.28.195:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.227641 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dba36e7f6148fbba14032657943e9d" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.228085 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dba36e7f6148fbba14032657943e9d" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.228726 16184 raft_consensus.cc:2468] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:55.229036 16258 raft_consensus.cc:2468] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:55.230626 16335 raft_consensus.cc:697] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:55.231647 16335 consensus_queue.cc:237] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.232173 16299 raft_consensus.cc:359] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.232963 16299 raft_consensus.cc:385] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.233258 16299 raft_consensus.cc:740] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.234114 16299 consensus_queue.cc:260] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.235252 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031d485f54441888e8e6ef1a325929" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:55.235935 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031d485f54441888e8e6ef1a325929" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.236574 16258 raft_consensus.cc:3060] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.237423 16299 ts_tablet_manager.cc:1434] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.004s
I20260709 13:04:55.238579 16299 tablet_bootstrap.cc:492] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:55.244379 16258 raft_consensus.cc:2468] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.244621 16300 tablet_bootstrap.cc:492] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:55.245216 16300 ts_tablet_manager.cc:1403] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.011s
I20260709 13:04:55.247892 16301 tablet_bootstrap.cc:492] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:55.248430 16300 raft_consensus.cc:359] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.249297 16300 raft_consensus.cc:385] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.249580 16300 raft_consensus.cc:740] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.249745 16073 leader_election.cc:304] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 406177939488436e998d9cc938163a91
I20260709 13:04:55.248507 16301 ts_tablet_manager.cc:1403] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.018s
I20260709 13:04:55.251261 16300 consensus_queue.cc:260] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.252053 16299 tablet_bootstrap.cc:654] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.253757 16300 ts_tablet_manager.cc:1434] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:04:55.254895 16300 tablet_bootstrap.cc:492] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:55.260887 16307 raft_consensus.cc:2804] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.263284 16307 raft_consensus.cc:697] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:55.264608 16307 consensus_queue.cc:237] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.266723 16300 tablet_bootstrap.cc:654] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.267140 16299 tablet_bootstrap.cc:492] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:55.267933 16299 ts_tablet_manager.cc:1403] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 13:04:55.269719 16073 leader_election.cc:304] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:55.271042 16299 raft_consensus.cc:359] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.272765 16328 raft_consensus.cc:2804] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.273422 16328 raft_consensus.cc:493] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:55.273921 16073 leader_election.cc:343] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.274129 16328 raft_consensus.cc:3060] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.275926 16073 leader_election.cc:304] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: c6459ab11719439fa9b7baf76983e832
I20260709 13:04:55.277460 16301 raft_consensus.cc:359] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.278328 16301 raft_consensus.cc:385] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.278664 16301 raft_consensus.cc:740] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.279716 16307 raft_consensus.cc:2804] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.280272 16307 raft_consensus.cc:697] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:55.281034 16300 tablet_bootstrap.cc:492] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:55.281625 16300 ts_tablet_manager.cc:1403] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.006s
I20260709 13:04:55.281155 16307 consensus_queue.cc:237] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.280467 16301 consensus_queue.cc:260] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.287585 16006 catalog_manager.cc:5697] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.289675 16328 raft_consensus.cc:515] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.290380 16301 ts_tablet_manager.cc:1434] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.005s
I20260709 13:04:55.292317 16328 leader_election.cc:290] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.273234 16299 raft_consensus.cc:385] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.293395 16299 raft_consensus.cc:740] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.293927 16300 raft_consensus.cc:359] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.294713 16300 raft_consensus.cc:385] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.294858 16299 consensus_queue.cc:260] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.298027 16299 ts_tablet_manager.cc:1434] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:04:55.298961 16299 tablet_bootstrap.cc:492] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:55.300148 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dba36e7f6148fbba14032657943e9d" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:55.300868 16184 raft_consensus.cc:3060] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.295773 16301 tablet_bootstrap.cc:492] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:55.306061 16299 tablet_bootstrap.cc:654] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.309955 16301 tablet_bootstrap.cc:654] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.295001 16300 raft_consensus.cc:740] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.314055 16307 raft_consensus.cc:493] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.313733 16005 catalog_manager.cc:5697] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.314405 16300 consensus_queue.cc:260] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.314666 16307 raft_consensus.cc:515] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.317867 16305 raft_consensus.cc:493] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.318825 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dba36e7f6148fbba14032657943e9d" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.319572 16259 raft_consensus.cc:3060] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.323387 16328 raft_consensus.cc:493] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.324200 16328 raft_consensus.cc:515] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.329300 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.334435 16184 raft_consensus.cc:2468] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.336289 16328 leader_election.cc:290] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.337885 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.338362 16300 ts_tablet_manager.cc:1434] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.006s
I20260709 13:04:55.348141 16073 leader_election.cc:304] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:55.350195 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.350605 16259 raft_consensus.cc:2468] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.351127 16258 raft_consensus.cc:2468] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:55.353169 16307 leader_election.cc:290] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.318372 16305 raft_consensus.cc:515] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.345454 16335 raft_consensus.cc:493] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.354736 16328 raft_consensus.cc:2804] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.360199 16073 leader_election.cc:304] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
W20260709 13:04:55.361202 16073 leader_election.cc:343] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.361451 16305 leader_election.cc:290] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:55.361686 16349 raft_consensus.cc:493] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.362115 16305 raft_consensus.cc:493] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.362223 16349 raft_consensus.cc:515] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.362578 16305 raft_consensus.cc:515] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.358804 16335 raft_consensus.cc:515] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.364530 16349 leader_election.cc:290] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:55.364748 16305 leader_election.cc:290] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:55.365231 16335 leader_election.cc:290] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.366657 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.367452 16258 raft_consensus.cc:2393] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e86ef4d3d63c483d975d4022f3093da0 in current term 1: Already voted for candidate c6459ab11719439fa9b7baf76983e832 in this term.
I20260709 13:04:55.368206 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.368597 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.368904 16259 raft_consensus.cc:2468] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:55.369237 16183 raft_consensus.cc:2468] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:55.370199 16328 raft_consensus.cc:697] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:55.371156 16328 consensus_queue.cc:237] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.371670 16335 raft_consensus.cc:2804] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.372093 16335 raft_consensus.cc:493] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.372476 16335 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.382311 16073 leader_election.cc:304] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:55.383661 16307 raft_consensus.cc:2804] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.384150 16307 raft_consensus.cc:493] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.384575 16307 raft_consensus.cc:3060] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.386027 16301 tablet_bootstrap.cc:492] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:55.386839 16301 ts_tablet_manager.cc:1403] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.015s
I20260709 13:04:55.390404 16073 leader_election.cc:304] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e86ef4d3d63c483d975d4022f3093da0; no voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832
I20260709 13:04:55.391368 16301 raft_consensus.cc:359] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.392642 16301 raft_consensus.cc:385] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.393050 16301 raft_consensus.cc:740] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.395767 16301 consensus_queue.cc:260] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.393651 16348 raft_consensus.cc:493] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.400668 16348 raft_consensus.cc:515] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.402987 16299 tablet_bootstrap.cc:492] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:55.403896 16299 ts_tablet_manager.cc:1403] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.105s	user 0.019s	sys 0.017s
I20260709 13:04:55.404284 16348 leader_election.cc:290] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:55.406392 16301 ts_tablet_manager.cc:1434] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:04:55.411207 16301 tablet_bootstrap.cc:492] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:55.422919 16301 tablet_bootstrap.cc:654] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.421754 16299 raft_consensus.cc:359] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.423527 16299 raft_consensus.cc:385] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.423745 16299 raft_consensus.cc:740] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.422554 16335 raft_consensus.cc:515] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.427161 16299 consensus_queue.cc:260] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.429179 16335 leader_election.cc:290] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.429679 16299 ts_tablet_manager.cc:1434] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:04:55.426015 16328 raft_consensus.cc:3060] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.433025 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:55.433558 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.434310 16259 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.424423 16307 raft_consensus.cc:515] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.435752 16301 tablet_bootstrap.cc:492] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:55.433741 16183 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.439246 16307 leader_election.cc:290] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.436702 16301 ts_tablet_manager.cc:1403] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.001s
I20260709 13:04:55.442749 16328 raft_consensus.cc:2749] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.449002 16259 raft_consensus.cc:2468] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.452191 16073 leader_election.cc:304] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:55.452325 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:55.453001 16184 raft_consensus.cc:3060] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.454003 16005 catalog_manager.cc:5697] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.456568 16185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.449007 16183 raft_consensus.cc:2468] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.462247 16185 raft_consensus.cc:2393] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 406177939488436e998d9cc938163a91 in current term 1: Already voted for candidate e86ef4d3d63c483d975d4022f3093da0 in this term.
I20260709 13:04:55.463028 16005 catalog_manager.cc:5697] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.464190 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:55.464872 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:55.465651 16108 raft_consensus.cc:2393] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 406177939488436e998d9cc938163a91 in current term 1: Already voted for candidate e86ef4d3d63c483d975d4022f3093da0 in this term.
I20260709 13:04:55.466444 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:55.457365 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.468463 16182 raft_consensus.cc:2393] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 406177939488436e998d9cc938163a91 in current term 1: Already voted for candidate e86ef4d3d63c483d975d4022f3093da0 in this term.
I20260709 13:04:55.469827 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10699b1acff542b48fe24849b5154054" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:55.457845 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.470549 16110 raft_consensus.cc:2468] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 0.
I20260709 13:04:55.470620 16259 raft_consensus.cc:3060] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.470697 16225 leader_election.cc:304] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 406177939488436e998d9cc938163a91; no voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.471979 16348 raft_consensus.cc:3060] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.472463 16225 leader_election.cc:304] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:55.473537 16347 raft_consensus.cc:2804] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.473995 16347 raft_consensus.cc:493] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.474364 16347 raft_consensus.cc:3060] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.457520 16301 raft_consensus.cc:359] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.458518 16328 raft_consensus.cc:2804] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.459280 16181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.480322 16259 raft_consensus.cc:2468] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.460726 16184 raft_consensus.cc:2468] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:55.480322 16348 raft_consensus.cc:2749] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.461012 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10699b1acff542b48fe24849b5154054" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.482261 16222 leader_election.cc:304] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 406177939488436e998d9cc938163a91; no voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.482683 16328 raft_consensus.cc:697] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:55.483316 16348 raft_consensus.cc:2749] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.483575 16328 consensus_queue.cc:237] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.484604 16347 raft_consensus.cc:515] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.487567 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10699b1acff542b48fe24849b5154054" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:55.487737 16347 leader_election.cc:290] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:55.488006 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10699b1acff542b48fe24849b5154054" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:55.488209 16110 raft_consensus.cc:3060] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.488461 16073 leader_election.cc:304] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:55.489313 16335 raft_consensus.cc:2804] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.489822 16335 raft_consensus.cc:697] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:55.490651 16301 raft_consensus.cc:385] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.490950 16301 raft_consensus.cc:740] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.490832 16335 consensus_queue.cc:237] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.491914 16301 consensus_queue.cc:260] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.492738 16180 raft_consensus.cc:2468] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 0.
I20260709 13:04:55.494251 16301 ts_tablet_manager.cc:1434] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:04:55.505678 16110 raft_consensus.cc:2468] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 1.
I20260709 13:04:55.506400 16225 leader_election.cc:304] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 406177939488436e998d9cc938163a91; no voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.507995 16225 leader_election.cc:304] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: c6459ab11719439fa9b7baf76983e832
I20260709 13:04:55.508795 16348 raft_consensus.cc:2749] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.509155 16347 raft_consensus.cc:2804] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.509723 16347 raft_consensus.cc:697] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:04:55.510641 16347 consensus_queue.cc:237] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.513581 16007 catalog_manager.cc:5697] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.517261 16007 catalog_manager.cc:5697] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.527711 16005 catalog_manager.cc:5697] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.534240 16259 raft_consensus.cc:3060] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.535534 16007 catalog_manager.cc:5697] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.542598 16347 raft_consensus.cc:493] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.543218 16347 raft_consensus.cc:515] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.543720 16327 consensus_queue.cc:1048] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.549352 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:55.550168 16110 raft_consensus.cc:2468] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 1.
I20260709 13:04:55.551235 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:55.551523 16225 leader_election.cc:304] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:55.552407 16348 raft_consensus.cc:2804] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.552721 16348 raft_consensus.cc:493] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6459ab11719439fa9b7baf76983e832)
I20260709 13:04:55.552961 16347 leader_election.cc:290] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:55.553288 16348 raft_consensus.cc:3060] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.560248 16323 consensus_queue.cc:1048] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.561688 16348 raft_consensus.cc:515] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.564185 16259 raft_consensus.cc:1240] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Rejecting Update request from peer c6459ab11719439fa9b7baf76983e832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:55.565342 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:55.566386 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:55.566524 16348 leader_election.cc:290] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:55.568198 16225 leader_election.cc:304] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 406177939488436e998d9cc938163a91; no voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.568368 16306 consensus_queue.cc:1059] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.569448 16348 raft_consensus.cc:2749] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.569906 16306 raft_consensus.cc:3055] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:55.570482 16306 raft_consensus.cc:740] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:04:55.571693 16306 consensus_queue.cc:260] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.572876 16306 raft_consensus.cc:3060] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.588800 16306 consensus_queue.cc:1048] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.601428 16327 consensus_queue.cc:1048] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.612871 16327 raft_consensus.cc:493] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.613404 16327 raft_consensus.cc:515] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.616158 16327 leader_election.cc:290] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.616539 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031d485f54441888e8e6ef1a325929" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:55.617177 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031d485f54441888e8e6ef1a325929" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:55.618062 16259 raft_consensus.cc:2393] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6459ab11719439fa9b7baf76983e832 in current term 1: Already voted for candidate e86ef4d3d63c483d975d4022f3093da0 in this term.
I20260709 13:04:55.618965 16148 leader_election.cc:304] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6459ab11719439fa9b7baf76983e832; no voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.619639 16327 raft_consensus.cc:3060] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.624959 16327 raft_consensus.cc:2749] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.675493 16335 consensus_queue.cc:1048] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.687692 16307 consensus_queue.cc:1048] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.688532 16335 consensus_queue.cc:1048] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.703388 16307 consensus_queue.cc:1048] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.753454 16307 consensus_queue.cc:1048] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.767572 16328 consensus_queue.cc:1048] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.780790 16180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
mode: GRACEFUL
new_leader_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:42218
I20260709 13:04:55.781512 16180 raft_consensus.cc:606] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Received request to transfer leadership to TS e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.791963 16180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
mode: GRACEFUL
new_leader_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:42218
I20260709 13:04:55.792472 16180 raft_consensus.cc:606] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Received request to transfer leadership to TS e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:55.792718 16180 raft_consensus.cc:614] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:55.801856 16307 consensus_queue.cc:1048] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.815681 16335 consensus_queue.cc:1048] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.819305 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:04:55.819973 16110 raft_consensus.cc:606] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS c6459ab11719439fa9b7baf76983e832
I20260709 13:04:55.826917 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35dba36e7f6148fbba14032657943e9d"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:04:55.827514 16110 raft_consensus.cc:606] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS c6459ab11719439fa9b7baf76983e832
I20260709 13:04:55.828680 16328 raft_consensus.cc:993] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:04:55.829178 16328 raft_consensus.cc:1081] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:04:55.832799 16180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35dba36e7f6148fbba14032657943e9d"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42208
I20260709 13:04:55.833415 16180 raft_consensus.cc:493] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:55.833379 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cef1e9dd6c8847b787659ed9f87af311"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:04:55.834151 16180 raft_consensus.cc:3060] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.834296 16110 raft_consensus.cc:606] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS c6459ab11719439fa9b7baf76983e832
I20260709 13:04:55.840137 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:04:55.840685 16110 raft_consensus.cc:606] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS c6459ab11719439fa9b7baf76983e832
I20260709 13:04:55.842239 16180 raft_consensus.cc:515] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.844846 16180 leader_election.cc:290] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.845477 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dba36e7f6148fbba14032657943e9d" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.846189 16259 raft_consensus.cc:3060] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.846055 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dba36e7f6148fbba14032657943e9d" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:55.846851 16110 raft_consensus.cc:3055] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:55.847183 16110 raft_consensus.cc:740] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:55.848001 16110 consensus_queue.cc:260] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.849308 16110 raft_consensus.cc:3060] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.854107 16259 raft_consensus.cc:2468] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:04:55.855509 16148 leader_election.cc:304] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: 
I20260709 13:04:55.856400 16327 raft_consensus.cc:2804] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:55.856660 16110 raft_consensus.cc:2468] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:04:55.856921 16327 raft_consensus.cc:697] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:04:55.858090 16327 consensus_queue.cc:237] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.865919 16007 catalog_manager.cc:5697] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.936314 16335 consensus_queue.cc:1048] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.948189 16353 consensus_queue.cc:1048] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.951197 16353 consensus_queue.cc:1048] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.964244 16307 consensus_queue.cc:1048] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.969926 16348 consensus_queue.cc:1048] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.975327 16335 raft_consensus.cc:993] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:04:55.975878 16307 raft_consensus.cc:1081] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:04:55.978094 16180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42208
I20260709 13:04:55.978725 16180 raft_consensus.cc:493] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:55.979104 16180 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.985152 16184 raft_consensus.cc:3060] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.991979 16180 raft_consensus.cc:515] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:55.994481 16180 leader_election.cc:290] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:55.995442 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:55.996345 16347 consensus_queue.cc:1048] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.996505 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:55.997778 16258 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.996737 16110 raft_consensus.cc:3055] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.006583 16258 raft_consensus.cc:2468] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:04:56.003412 16110 raft_consensus.cc:740] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:56.007761 16148 leader_election.cc:304] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: 
I20260709 13:04:56.008708 16327 raft_consensus.cc:2804] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.008396 16110 consensus_queue.cc:260] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.009227 16327 raft_consensus.cc:697] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:04:56.009990 16110 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.010113 16327 consensus_queue.cc:237] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.014413 16323 raft_consensus.cc:993] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832: : Instructing follower e86ef4d3d63c483d975d4022f3093da0 to start an election
I20260709 13:04:56.014906 16327 raft_consensus.cc:1081] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Signalling peer e86ef4d3d63c483d975d4022f3093da0 to start an election
I20260709 13:04:56.016758 16109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:42686
I20260709 13:04:56.017295 16109 raft_consensus.cc:493] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.017572 16109 raft_consensus.cc:3060] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.019816 16007 catalog_manager.cc:5697] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.020987 16110 raft_consensus.cc:2468] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:04:56.026537 16109 raft_consensus.cc:515] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.028872 16109 leader_election.cc:290] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:56.029594 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:56.030102 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396c2802a4c145e0897bf51d63bf8b73" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:56.030282 16180 raft_consensus.cc:3055] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.030686 16180 raft_consensus.cc:740] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:04:56.030725 16258 raft_consensus.cc:3060] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.031675 16180 consensus_queue.cc:260] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.032954 16180 raft_consensus.cc:3060] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.038480 16258 raft_consensus.cc:2468] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:04:56.039939 16073 leader_election.cc:304] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:56.040292 16180 raft_consensus.cc:2468] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:04:56.040884 16335 raft_consensus.cc:2804] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.041488 16335 raft_consensus.cc:697] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:56.042343 16335 consensus_queue.cc:237] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.049727 16007 catalog_manager.cc:5697] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 1 to 2, leader changed from c6459ab11719439fa9b7baf76983e832 (127.7.28.194) to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.124271 16335 raft_consensus.cc:993] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:04:56.124802 16328 raft_consensus.cc:1081] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:04:56.126396 16180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cef1e9dd6c8847b787659ed9f87af311"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42208
I20260709 13:04:56.126911 16180 raft_consensus.cc:493] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.127246 16180 raft_consensus.cc:3060] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.134850 16180 raft_consensus.cc:515] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.137107 16180 leader_election.cc:290] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:56.138139 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef1e9dd6c8847b787659ed9f87af311" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:56.138185 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef1e9dd6c8847b787659ed9f87af311" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:56.138917 16109 raft_consensus.cc:3055] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.139032 16258 raft_consensus.cc:3060] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.139344 16109 raft_consensus.cc:740] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:56.140225 16109 consensus_queue.cc:260] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.141248 16109 raft_consensus.cc:3060] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.146448 16109 raft_consensus.cc:2468] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:04:56.146713 16258 raft_consensus.cc:2468] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:04:56.147675 16151 leader_election.cc:304] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:56.148483 16327 raft_consensus.cc:2804] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.149065 16327 raft_consensus.cc:697] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:04:56.149940 16327 consensus_queue.cc:237] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.156921 16007 catalog_manager.cc:5697] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.338637 16335 raft_consensus.cc:993] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:04:56.339140 16335 raft_consensus.cc:1081] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:04:56.340684 16180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42208
I20260709 13:04:56.341188 16180 raft_consensus.cc:493] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.341459 16180 raft_consensus.cc:3060] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.346607 16180 raft_consensus.cc:515] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.348467 16180 leader_election.cc:290] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:56.349431 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:56.349615 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f2d3b8a18442fa49b08cd6609ec92" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:56.350173 16109 raft_consensus.cc:3055] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.350395 16258 raft_consensus.cc:3060] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.350519 16109 raft_consensus.cc:740] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:56.351442 16109 consensus_queue.cc:260] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.352489 16109 raft_consensus.cc:3060] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.356482 16258 raft_consensus.cc:2468] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:04:56.357919 16109 raft_consensus.cc:2468] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:04:56.357873 16148 leader_election.cc:304] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: 
I20260709 13:04:56.359006 16327 raft_consensus.cc:2804] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.359490 16327 raft_consensus.cc:697] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:04:56.360222 16327 consensus_queue.cc:237] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.367105 16007 catalog_manager.cc:5697] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.455387 16109 raft_consensus.cc:1275] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.456700 16327 consensus_queue.cc:1048] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.467154 16258 raft_consensus.cc:1275] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.468715 16327 consensus_queue.cc:1048] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.475659 16259 raft_consensus.cc:1275] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.478140 16306 consensus_queue.cc:1048] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.483479 16109 raft_consensus.cc:1275] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.485118 16327 consensus_queue.cc:1048] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.546449 16180 raft_consensus.cc:1275] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.547860 16307 consensus_queue.cc:1048] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.556140 16259 raft_consensus.cc:1275] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.558406 16335 consensus_queue.cc:1048] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.574879 16259 raft_consensus.cc:1275] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.576216 16381 consensus_queue.cc:1048] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.584220 16110 raft_consensus.cc:1275] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.586154 16306 consensus_queue.cc:1048] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.739454 16306 raft_consensus.cc:493] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.740012 16306 raft_consensus.cc:515] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:56.741863 16306 leader_election.cc:290] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:56.742729 16110 raft_consensus.cc:1275] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.742719 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:56.743017 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:56.744458 16306 consensus_queue.cc:1048] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.744580 16151 leader_election.cc:304] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6459ab11719439fa9b7baf76983e832; no voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:56.745343 16381 raft_consensus.cc:2749] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:56.752130 16259 raft_consensus.cc:1275] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.754892 16306 consensus_queue.cc:1048] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.066219 16382 raft_consensus.cc:493] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6459ab11719439fa9b7baf76983e832)
I20260709 13:04:57.066725 16382 raft_consensus.cc:515] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:57.068646 16382 leader_election.cc:290] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:57.069231 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:57.069670 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:57.069895 16180 raft_consensus.cc:2468] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:04:57.070454 16259 raft_consensus.cc:2393] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e86ef4d3d63c483d975d4022f3093da0 in current term 2: Already voted for candidate 406177939488436e998d9cc938163a91 in this term.
I20260709 13:04:57.071146 16073 leader_election.cc:304] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:57.072300 16335 raft_consensus.cc:2804] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:57.072734 16335 raft_consensus.cc:493] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6459ab11719439fa9b7baf76983e832)
I20260709 13:04:57.073264 16335 raft_consensus.cc:3060] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.080771 16335 raft_consensus.cc:515] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:57.082690 16335 leader_election.cc:290] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:57.083372 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:57.083762 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc54ca9c964a44a8ae7125556f8c691f" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:57.084451 16258 raft_consensus.cc:2393] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e86ef4d3d63c483d975d4022f3093da0 in current term 2: Already voted for candidate 406177939488436e998d9cc938163a91 in this term.
I20260709 13:04:57.088654 16180 raft_consensus.cc:2468] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:04:57.089742 16073 leader_election.cc:304] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 406177939488436e998d9cc938163a91
I20260709 13:04:57.090777 16335 raft_consensus.cc:2804] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.091356 16335 raft_consensus.cc:697] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:57.092151 16335 consensus_queue.cc:237] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:57.099404 16007 catalog_manager.cc:5697] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 1 to 2, leader changed from c6459ab11719439fa9b7baf76983e832 (127.7.28.194) to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.475337 16180 raft_consensus.cc:1275] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.477144 16335 consensus_queue.cc:1048] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.488873 16258 raft_consensus.cc:1275] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.490341 16335 consensus_queue.cc:1048] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.886777 16007 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47688:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:58.890236 16007 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:58.950958 16099 tablet_service.cc:1511] Processing CreateTablet for tablet 596e922d333c4540ba156d83e5513375 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:58.952936 16099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596e922d333c4540ba156d83e5513375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.954061 16167 tablet_service.cc:1511] Processing CreateTablet for tablet 596e922d333c4540ba156d83e5513375 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:58.955807 16167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596e922d333c4540ba156d83e5513375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.956089 16247 tablet_service.cc:1511] Processing CreateTablet for tablet 596e922d333c4540ba156d83e5513375 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:58.957544 16100 tablet_service.cc:1511] Processing CreateTablet for tablet b131207223334bb6adfad5b7db7a0bee (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:58.959596 16100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b131207223334bb6adfad5b7db7a0bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.961457 16246 tablet_service.cc:1511] Processing CreateTablet for tablet b131207223334bb6adfad5b7db7a0bee (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:58.963276 16247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596e922d333c4540ba156d83e5513375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.964850 16095 tablet_service.cc:1511] Processing CreateTablet for tablet 00ad438e03a44b0fb583e38f7a535d84 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:58.959143 16171 tablet_service.cc:1511] Processing CreateTablet for tablet b131207223334bb6adfad5b7db7a0bee (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:58.965899 16246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b131207223334bb6adfad5b7db7a0bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.965775 16172 tablet_service.cc:1511] Processing CreateTablet for tablet 00ad438e03a44b0fb583e38f7a535d84 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:58.966594 16095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ad438e03a44b0fb583e38f7a535d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.967533 16172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ad438e03a44b0fb583e38f7a535d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.969897 16171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b131207223334bb6adfad5b7db7a0bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.974968 16243 tablet_service.cc:1511] Processing CreateTablet for tablet 00ad438e03a44b0fb583e38f7a535d84 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:58.976841 16243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ad438e03a44b0fb583e38f7a535d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.981951 16096 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9bf56b22b746788b18d6750841cd81 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:58.983646 16096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9bf56b22b746788b18d6750841cd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.987315 16097 tablet_service.cc:1511] Processing CreateTablet for tablet cb4bfd85ccb1458395776eafcaec1333 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:58.988873 16097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4bfd85ccb1458395776eafcaec1333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.989354 16168 tablet_service.cc:1511] Processing CreateTablet for tablet cb4bfd85ccb1458395776eafcaec1333 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:58.990001 16249 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9bf56b22b746788b18d6750841cd81 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:58.991123 16168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4bfd85ccb1458395776eafcaec1333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.991434 16249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9bf56b22b746788b18d6750841cd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.995527 16170 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9bf56b22b746788b18d6750841cd81 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:58.997138 16170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9bf56b22b746788b18d6750841cd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.006990 16244 tablet_service.cc:1511] Processing CreateTablet for tablet cb4bfd85ccb1458395776eafcaec1333 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:59.008497 16244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4bfd85ccb1458395776eafcaec1333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.029105 16174 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0ded4eff6448e6bb79d1ecaedd1cee (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:59.032358 16174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0ded4eff6448e6bb79d1ecaedd1cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.029204 16093 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0ded4eff6448e6bb79d1ecaedd1cee (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:59.034437 16093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0ded4eff6448e6bb79d1ecaedd1cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.045020 16248 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0ded4eff6448e6bb79d1ecaedd1cee (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 13:04:59.046306 16151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.193:37577, user_credentials={real_user=slave}} blocked reactor thread for 61634.8us
I20260709 13:04:59.046272 16096 tablet_service.cc:1511] Processing CreateTablet for tablet 6e233a5c40a5424e9fe943bc265d93aa (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:59.046921 16248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0ded4eff6448e6bb79d1ecaedd1cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.048198 16096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e233a5c40a5424e9fe943bc265d93aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.051522 16169 tablet_service.cc:1511] Processing CreateTablet for tablet 6e233a5c40a5424e9fe943bc265d93aa (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:59.053301 16169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e233a5c40a5424e9fe943bc265d93aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.026495 16406 tablet_bootstrap.cc:492] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.055524 16094 tablet_service.cc:1511] Processing CreateTablet for tablet eb3ac40d0756433d9f4f4468575fc2fb (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:59.057350 16094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3ac40d0756433d9f4f4468575fc2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.060034 16245 tablet_service.cc:1511] Processing CreateTablet for tablet 6e233a5c40a5424e9fe943bc265d93aa (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:59.061707 16245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e233a5c40a5424e9fe943bc265d93aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.097030 16175 tablet_service.cc:1511] Processing CreateTablet for tablet eb3ac40d0756433d9f4f4468575fc2fb (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:59.098516 16175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3ac40d0756433d9f4f4468575fc2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.104571 16247 tablet_service.cc:1511] Processing CreateTablet for tablet eb3ac40d0756433d9f4f4468575fc2fb (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:59.106052 16247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3ac40d0756433d9f4f4468575fc2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.105842 16097 tablet_service.cc:1511] Processing CreateTablet for tablet e35520108063427787b5af977ac1abe4 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:59.107306 16097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35520108063427787b5af977ac1abe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.113086 16406 tablet_bootstrap.cc:654] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.121390 16407 tablet_bootstrap.cc:492] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:59.127810 16244 tablet_service.cc:1511] Processing CreateTablet for tablet e35520108063427787b5af977ac1abe4 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:59.129523 16167 tablet_service.cc:1511] Processing CreateTablet for tablet e35520108063427787b5af977ac1abe4 (DEFAULT_TABLE table=soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:59.138785 16167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35520108063427787b5af977ac1abe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.151825 16408 tablet_bootstrap.cc:492] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.158411 16244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35520108063427787b5af977ac1abe4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:59.171141 16056 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:59.180001 16408 tablet_bootstrap.cc:654] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.181949 16407 tablet_bootstrap.cc:654] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.192303 16406 tablet_bootstrap.cc:492] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:59.192833 16406 ts_tablet_manager.cc:1403] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.167s	user 0.010s	sys 0.010s
I20260709 13:04:59.194988 16407 tablet_bootstrap.cc:492] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.195962 16407 ts_tablet_manager.cc:1403] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.000s
I20260709 13:04:59.196125 16406 raft_consensus.cc:359] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.197158 16406 raft_consensus.cc:385] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.197481 16406 raft_consensus.cc:740] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.198398 16406 consensus_queue.cc:260] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.202884 16407 raft_consensus.cc:359] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.204000 16407 raft_consensus.cc:385] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.204388 16407 raft_consensus.cc:740] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.210280 16406 ts_tablet_manager.cc:1434] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:04:59.211396 16406 tablet_bootstrap.cc:492] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.211002 16407 consensus_queue.cc:260] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.215626 16407 ts_tablet_manager.cc:1434] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:04:59.217160 16407 tablet_bootstrap.cc:492] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:59.226631 16407 tablet_bootstrap.cc:654] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.235443 16406 tablet_bootstrap.cc:654] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.235658 16407 tablet_bootstrap.cc:492] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.236477 16407 ts_tablet_manager.cc:1403] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:04:59.240273 16407 raft_consensus.cc:359] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.241061 16407 raft_consensus.cc:385] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.241351 16407 raft_consensus.cc:740] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.241626 16408 tablet_bootstrap.cc:492] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.241899 16406 tablet_bootstrap.cc:492] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:59.242237 16408 ts_tablet_manager.cc:1403] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.091s	user 0.037s	sys 0.024s
I20260709 13:04:59.242547 16406 ts_tablet_manager.cc:1403] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:04:59.242313 16407 consensus_queue.cc:260] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.245129 16407 ts_tablet_manager.cc:1434] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:59.245747 16408 raft_consensus.cc:359] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.246462 16407 tablet_bootstrap.cc:492] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:59.246585 16408 raft_consensus.cc:385] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.246274 16406 raft_consensus.cc:359] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.247015 16408 raft_consensus.cc:740] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.247207 16406 raft_consensus.cc:385] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.247606 16406 raft_consensus.cc:740] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.247879 16408 consensus_queue.cc:260] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.248432 16406 consensus_queue.cc:260] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.251359 16406 ts_tablet_manager.cc:1434] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:04:59.252549 16406 tablet_bootstrap.cc:492] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.255255 16407 tablet_bootstrap.cc:654] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.255478 16408 ts_tablet_manager.cc:1434] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:04:59.256628 16408 tablet_bootstrap.cc:492] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.260412 16406 tablet_bootstrap.cc:654] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.265141 16408 tablet_bootstrap.cc:654] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.267365 16407 tablet_bootstrap.cc:492] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.267964 16407 ts_tablet_manager.cc:1403] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:04:59.271333 16406 tablet_bootstrap.cc:492] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:59.271955 16406 ts_tablet_manager.cc:1403] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260709 13:04:59.273000 16407 raft_consensus.cc:359] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.274109 16407 raft_consensus.cc:385] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.274483 16407 raft_consensus.cc:740] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.275581 16406 raft_consensus.cc:359] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.275520 16407 consensus_queue.cc:260] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.276539 16406 raft_consensus.cc:385] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.276947 16406 raft_consensus.cc:740] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.277763 16406 consensus_queue.cc:260] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.279160 16407 ts_tablet_manager.cc:1434] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:04:59.280342 16406 ts_tablet_manager.cc:1434] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:04:59.280675 16407 tablet_bootstrap.cc:492] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:59.281461 16406 tablet_bootstrap.cc:492] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.284535 16408 tablet_bootstrap.cc:492] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.285126 16408 ts_tablet_manager.cc:1403] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.019s
I20260709 13:04:59.288440 16408 raft_consensus.cc:359] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.289179 16408 raft_consensus.cc:385] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.289367 16406 tablet_bootstrap.cc:654] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.289476 16407 tablet_bootstrap.cc:654] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.289525 16408 raft_consensus.cc:740] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.290778 16408 consensus_queue.cc:260] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.293726 16408 ts_tablet_manager.cc:1434] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:59.295112 16408 tablet_bootstrap.cc:492] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.302671 16406 tablet_bootstrap.cc:492] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:59.302709 16407 tablet_bootstrap.cc:492] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.303515 16408 tablet_bootstrap.cc:654] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.303524 16406 ts_tablet_manager.cc:1403] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:04:59.303614 16407 ts_tablet_manager.cc:1403] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:04:59.307628 16407 raft_consensus.cc:359] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.308709 16407 raft_consensus.cc:385] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.309111 16407 raft_consensus.cc:740] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.310352 16407 consensus_queue.cc:260] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.314623 16347 raft_consensus.cc:493] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.315052 16407 ts_tablet_manager.cc:1434] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:59.315155 16347 raft_consensus.cc:515] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.317000 16407 tablet_bootstrap.cc:492] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:59.320817 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:59.321990 16110 raft_consensus.cc:2468] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 0.
I20260709 13:04:59.325680 16225 leader_election.cc:304] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.330937 16347 leader_election.cc:290] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:59.331868 16347 raft_consensus.cc:2804] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.332948 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
W20260709 13:04:59.339404 16222 leader_election.cc:343] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.348529 16406 raft_consensus.cc:359] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.349614 16406 raft_consensus.cc:385] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.349990 16406 raft_consensus.cc:740] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.350965 16406 consensus_queue.cc:260] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.333655 16347 raft_consensus.cc:493] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.353884 16347 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.354766 16406 ts_tablet_manager.cc:1434] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.001s
I20260709 13:04:59.356068 16406 tablet_bootstrap.cc:492] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.354254 16407 tablet_bootstrap.cc:654] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.374274 16406 tablet_bootstrap.cc:654] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.475811 16347 raft_consensus.cc:515] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.478394 16347 leader_election.cc:290] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:59.480825 16408 tablet_bootstrap.cc:492] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.481458 16408 ts_tablet_manager.cc:1403] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.187s	user 0.017s	sys 0.011s
I20260709 13:04:59.482462 16393 raft_consensus.cc:493] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.483049 16393 raft_consensus.cc:515] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.484877 16408 raft_consensus.cc:359] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.485373 16407 tablet_bootstrap.cc:492] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.485680 16408 raft_consensus.cc:385] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.486132 16408 raft_consensus.cc:740] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.486246 16407 ts_tablet_manager.cc:1403] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.170s	user 0.016s	sys 0.018s
I20260709 13:04:59.487367 16406 tablet_bootstrap.cc:492] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:59.486946 16408 consensus_queue.cc:260] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.487974 16406 ts_tablet_manager.cc:1403] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.001s
I20260709 13:04:59.489535 16408 ts_tablet_manager.cc:1434] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:59.485329 16393 leader_election.cc:290] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.490685 16408 tablet_bootstrap.cc:492] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.490126 16407 raft_consensus.cc:359] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.491144 16407 raft_consensus.cc:385] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.491559 16407 raft_consensus.cc:740] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.492400 16407 consensus_queue.cc:260] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.495659 16393 raft_consensus.cc:493] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.496232 16393 raft_consensus.cc:515] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.496338 16406 raft_consensus.cc:359] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.497208 16406 raft_consensus.cc:385] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.497535 16406 raft_consensus.cc:740] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.497638 16408 tablet_bootstrap.cc:654] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.498615 16393 leader_election.cc:290] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.500378 16407 ts_tablet_manager.cc:1434] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:59.501827 16407 tablet_bootstrap.cc:492] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:59.501928 16406 consensus_queue.cc:260] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.504561 16406 ts_tablet_manager.cc:1434] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:04:59.505623 16406 tablet_bootstrap.cc:492] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.512687 16407 tablet_bootstrap.cc:654] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.516266 16408 tablet_bootstrap.cc:492] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.516966 16408 ts_tablet_manager.cc:1403] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 13:04:59.521188 16408 raft_consensus.cc:359] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.522248 16408 raft_consensus.cc:385] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.522651 16408 raft_consensus.cc:740] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.523660 16408 consensus_queue.cc:260] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.512750 16406 tablet_bootstrap.cc:654] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.528869 16408 ts_tablet_manager.cc:1434] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:04:59.529072 16407 tablet_bootstrap.cc:492] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.530042 16408 tablet_bootstrap.cc:492] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.530083 16407 ts_tablet_manager.cc:1403] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.007s
I20260709 13:04:59.535506 16407 raft_consensus.cc:359] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.536706 16407 raft_consensus.cc:385] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.537194 16407 raft_consensus.cc:740] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.538534 16407 consensus_queue.cc:260] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.538707 16408 tablet_bootstrap.cc:654] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.543640 16407 ts_tablet_manager.cc:1434] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:04:59.545082 16407 tablet_bootstrap.cc:492] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:59.549819 16406 tablet_bootstrap.cc:492] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:59.550606 16406 ts_tablet_manager.cc:1403] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.013s
I20260709 13:04:59.551107 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9bf56b22b746788b18d6750841cd81" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:59.551891 16259 raft_consensus.cc:2468] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:59.553407 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e233a5c40a5424e9fe943bc265d93aa" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:59.554142 16258 raft_consensus.cc:2468] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:59.554044 16406 raft_consensus.cc:359] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.554955 16406 raft_consensus.cc:385] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.555281 16406 raft_consensus.cc:740] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.555732 16407 tablet_bootstrap.cc:654] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.556277 16406 consensus_queue.cc:260] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.559578 16073 leader_election.cc:304] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.560525 16406 ts_tablet_manager.cc:1434] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:04:59.561714 16406 tablet_bootstrap.cc:492] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.560552 16073 leader_election.cc:304] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.570842 16428 raft_consensus.cc:2804] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.571168 16428 raft_consensus.cc:493] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.571525 16428 raft_consensus.cc:3060] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.579625 16428 raft_consensus.cc:515] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.581894 16428 leader_election.cc:290] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.585140 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e233a5c40a5424e9fe943bc265d93aa" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:59.585860 16258 raft_consensus.cc:3060] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.589715 16430 raft_consensus.cc:493] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.590720 16430 raft_consensus.cc:515] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.593389 16258 raft_consensus.cc:2468] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:59.593842 16430 leader_election.cc:290] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.595046 16073 leader_election.cc:304] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.595786 16393 raft_consensus.cc:2804] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.596235 16393 raft_consensus.cc:697] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:59.596621 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9bf56b22b746788b18d6750841cd81" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:59.597421 16393 consensus_queue.cc:237] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.598284 16407 tablet_bootstrap.cc:492] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.598845 16407 ts_tablet_manager.cc:1403] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.019s
I20260709 13:04:59.600868 16428 raft_consensus.cc:493] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.601415 16428 raft_consensus.cc:515] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.603209 16407 raft_consensus.cc:359] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.604008 16407 raft_consensus.cc:385] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.604302 16407 raft_consensus.cc:740] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.605047 16407 consensus_queue.cc:260] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.607031 16407 ts_tablet_manager.cc:1434] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:59.608083 16407 tablet_bootstrap.cc:492] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91: Bootstrap starting.
W20260709 13:04:59.608349 16225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.193:37577, user_credentials={real_user=slave}} blocked reactor thread for 283014us
I20260709 13:04:59.611919 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4bfd85ccb1458395776eafcaec1333" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:59.612700 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:59.612844 16258 raft_consensus.cc:2468] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:59.613505 16109 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.613680 16408 tablet_bootstrap.cc:492] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.614065 16428 leader_election.cc:290] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.614326 16408 ts_tablet_manager.cc:1403] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.005s
I20260709 13:04:59.614959 16407 tablet_bootstrap.cc:654] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.615439 16073 leader_election.cc:304] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.616528 16428 raft_consensus.cc:2804] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.616971 16428 raft_consensus.cc:493] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.617655 16408 raft_consensus.cc:359] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.619297 16408 raft_consensus.cc:385] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.619601 16408 raft_consensus.cc:740] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.620424 16408 consensus_queue.cc:260] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.623150 16408 ts_tablet_manager.cc:1434] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:59.624209 16408 tablet_bootstrap.cc:492] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.629439 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9bf56b22b746788b18d6750841cd81" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:59.630271 16180 raft_consensus.cc:2468] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:59.631361 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e233a5c40a5424e9fe943bc265d93aa" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:59.636425 16257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9bf56b22b746788b18d6750841cd81" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:59.637223 16257 raft_consensus.cc:2468] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 0.
I20260709 13:04:59.637759 16408 tablet_bootstrap.cc:654] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.643989 16406 tablet_bootstrap.cc:654] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.646095 16109 raft_consensus.cc:2468] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 1.
I20260709 13:04:59.617450 16428 raft_consensus.cc:3060] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.654110 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4bfd85ccb1458395776eafcaec1333" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:59.655000 16180 raft_consensus.cc:2468] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:59.658219 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e233a5c40a5424e9fe943bc265d93aa" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:59.561707 16409 raft_consensus.cc:2804] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.659705 16409 raft_consensus.cc:493] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.660104 16409 raft_consensus.cc:3060] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.660251 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:59.660996 16183 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.661343 16428 raft_consensus.cc:515] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.662945 16225 leader_election.cc:304] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.664636 16428 leader_election.cc:290] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.670845 16347 raft_consensus.cc:2804] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.671537 16347 raft_consensus.cc:697] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:04:59.672631 16347 consensus_queue.cc:237] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.674669 16421 raft_consensus.cc:493] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.675282 16421 raft_consensus.cc:515] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.680611 16405 raft_consensus.cc:493] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.686008 16407 tablet_bootstrap.cc:492] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.686802 16407 ts_tablet_manager.cc:1403] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.041s
I20260709 13:04:59.681282 16405 raft_consensus.cc:515] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.690179 16407 raft_consensus.cc:359] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.691095 16407 raft_consensus.cc:385] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:59.677430 16073 leader_election.cc:343] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.691514 16407 raft_consensus.cc:740] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.698009 16407 consensus_queue.cc:260] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.702222 16435 raft_consensus.cc:493] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.703011 16435 raft_consensus.cc:515] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.708518 16406 tablet_bootstrap.cc:492] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:59.709465 16406 ts_tablet_manager.cc:1403] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.009s
I20260709 13:04:59.689877 16409 raft_consensus.cc:515] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.714486 16405 leader_election.cc:290] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.716300 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:59.717340 16109 raft_consensus.cc:2468] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 0.
I20260709 13:04:59.728814 16151 leader_election.cc:304] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.731174 16409 leader_election.cc:290] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.731324 16405 raft_consensus.cc:2804] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.731930 16405 raft_consensus.cc:493] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.732347 16405 raft_consensus.cc:3060] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.734071 16421 leader_election.cc:290] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:59.737596 16110 raft_consensus.cc:2393] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6459ab11719439fa9b7baf76983e832 in current term 1: Already voted for candidate e86ef4d3d63c483d975d4022f3093da0 in this term.
I20260709 13:04:59.743057 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9bf56b22b746788b18d6750841cd81" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:59.743124 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4bfd85ccb1458395776eafcaec1333" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:59.745671 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:59.746155 16258 raft_consensus.cc:3060] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.746475 16109 raft_consensus.cc:2468] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 0.
I20260709 13:04:59.748108 16225 leader_election.cc:304] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.749166 16421 raft_consensus.cc:2804] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.749560 16421 raft_consensus.cc:493] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.749835 16259 raft_consensus.cc:3060] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.749929 16421 raft_consensus.cc:3060] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.759524 16407 ts_tablet_manager.cc:1434] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.072s	user 0.012s	sys 0.000s
I20260709 13:04:59.761348 16407 tablet_bootstrap.cc:492] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91: Bootstrap starting.
I20260709 13:04:59.768517 16259 raft_consensus.cc:2468] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:59.770097 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b131207223334bb6adfad5b7db7a0bee" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:04:59.771414 16435 leader_election.cc:290] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
W20260709 13:04:59.771899 16225 leader_election.cc:343] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.768502 16408 tablet_bootstrap.cc:492] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.774385 16408 ts_tablet_manager.cc:1403] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.150s	user 0.048s	sys 0.041s
I20260709 13:04:59.775452 16073 leader_election.cc:304] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.776384 16409 raft_consensus.cc:2804] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.776866 16409 raft_consensus.cc:697] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:59.777712 16409 consensus_queue.cc:237] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.778278 16421 raft_consensus.cc:515] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.774302 16183 raft_consensus.cc:2468] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 1.
I20260709 13:04:59.781818 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:59.782485 16109 raft_consensus.cc:3060] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.782193 16405 raft_consensus.cc:515] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
W20260709 13:04:59.782374 16148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:40277, user_credentials={real_user=slave}} blocked reactor thread for 78019us
I20260709 13:04:59.785768 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:59.789654 16407 tablet_bootstrap.cc:654] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.786408 16405 leader_election.cc:290] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.792089 16421 leader_election.cc:290] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:59.793438 16408 raft_consensus.cc:359] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.794217 16408 raft_consensus.cc:385] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.794586 16408 raft_consensus.cc:740] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.795614 16408 consensus_queue.cc:260] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.798497 16408 ts_tablet_manager.cc:1434] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:59.799615 16408 tablet_bootstrap.cc:492] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.791905 16406 raft_consensus.cc:359] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.782768 16258 raft_consensus.cc:2468] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:59.804004 16406 raft_consensus.cc:385] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.800592 16005 catalog_manager.cc:5697] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.805531 16406 raft_consensus.cc:740] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.807489 16073 leader_election.cc:304] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.809124 16406 consensus_queue.cc:260] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.809463 16409 raft_consensus.cc:2804] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.813535 16409 raft_consensus.cc:697] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:04:59.814860 16409 consensus_queue.cc:237] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.805362 16148 leader_election.cc:304] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:59.818864 16405 raft_consensus.cc:2804] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.818066 16006 catalog_manager.cc:5697] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.819255 16405 raft_consensus.cc:493] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.819631 16405 raft_consensus.cc:3060] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.824568 16421 raft_consensus.cc:493] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.825160 16421 raft_consensus.cc:515] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.825177 16406 ts_tablet_manager.cc:1434] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.000s
I20260709 13:04:59.826993 16406 tablet_bootstrap.cc:492] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.827572 16421 leader_election.cc:290] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:59.829922 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
W20260709 13:04:59.831573 16225 leader_election.cc:343] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.831455 16405 raft_consensus.cc:515] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.836097 16408 tablet_bootstrap.cc:654] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.837714 16109 raft_consensus.cc:2468] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 1.
I20260709 13:04:59.840679 16225 leader_election.cc:304] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.841558 16421 raft_consensus.cc:2804] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.842058 16421 raft_consensus.cc:697] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:04:59.842893 16421 consensus_queue.cc:237] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
W20260709 13:04:59.849025 16073 leader_election.cc:343] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.843269 16407 tablet_bootstrap.cc:492] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91: No bootstrap required, opened a new log
I20260709 13:04:59.850999 16407 ts_tablet_manager.cc:1403] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91: Time spent bootstrapping tablet: real 0.091s	user 0.028s	sys 0.001s
I20260709 13:04:59.855144 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:59.858557 16406 tablet_bootstrap.cc:654] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.862212 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:59.870401 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4bfd85ccb1458395776eafcaec1333" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:59.871040 16183 raft_consensus.cc:3060] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.872553 16405 leader_election.cc:290] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.874382 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9bf56b22b746788b18d6750841cd81" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:59.888391 16406 tablet_bootstrap.cc:492] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:04:59.889286 16406 ts_tablet_manager.cc:1403] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.006s
I20260709 13:04:59.889341 16183 raft_consensus.cc:2468] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:59.890585 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9bf56b22b746788b18d6750841cd81" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:59.891352 16184 raft_consensus.cc:2393] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e86ef4d3d63c483d975d4022f3093da0 in current term 1: Already voted for candidate c6459ab11719439fa9b7baf76983e832 in this term.
I20260709 13:04:59.893767 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b131207223334bb6adfad5b7db7a0bee" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:59.894515 16180 raft_consensus.cc:2468] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 0.
I20260709 13:04:59.894166 16406 raft_consensus.cc:359] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.894977 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9bf56b22b746788b18d6750841cd81" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:59.895328 16406 raft_consensus.cc:385] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.895787 16259 raft_consensus.cc:2393] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6459ab11719439fa9b7baf76983e832 in current term 1: Already voted for candidate e86ef4d3d63c483d975d4022f3093da0 in this term.
I20260709 13:04:59.896556 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:59.896384 16407 raft_consensus.cc:359] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.897182 16407 raft_consensus.cc:385] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.897504 16407 raft_consensus.cc:740] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.898223 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:59.899008 16183 raft_consensus.cc:2393] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 406177939488436e998d9cc938163a91 in current term 1: Already voted for candidate c6459ab11719439fa9b7baf76983e832 in this term.
I20260709 13:04:59.895815 16185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:59.900076 16185 raft_consensus.cc:2393] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 406177939488436e998d9cc938163a91 in current term 1: Already voted for candidate c6459ab11719439fa9b7baf76983e832 in this term.
I20260709 13:04:59.898418 16407 consensus_queue.cc:260] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.903110 16407 ts_tablet_manager.cc:1434] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.004s
I20260709 13:04:59.903698 16408 tablet_bootstrap.cc:492] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.895790 16406 raft_consensus.cc:740] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.904455 16408 ts_tablet_manager.cc:1403] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.105s	user 0.020s	sys 0.036s
I20260709 13:04:59.905079 16406 consensus_queue.cc:260] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.908154 16408 raft_consensus.cc:359] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.909067 16408 raft_consensus.cc:385] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.909202 16148 leader_election.cc:304] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6459ab11719439fa9b7baf76983e832; no voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:59.910585 16436 raft_consensus.cc:2749] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.911243 16406 ts_tablet_manager.cc:1434] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:04:59.912065 16148 leader_election.cc:304] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6459ab11719439fa9b7baf76983e832; no voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:59.913094 16436 raft_consensus.cc:2749] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.912349 16406 tablet_bootstrap.cc:492] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0: Bootstrap starting.
I20260709 13:04:59.909446 16408 raft_consensus.cc:740] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.914475 16408 consensus_queue.cc:260] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.915414 16222 leader_election.cc:304] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:59.916833 16421 raft_consensus.cc:2804] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.917022 16408 ts_tablet_manager.cc:1434] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:59.917291 16421 raft_consensus.cc:493] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.917778 16421 raft_consensus.cc:3060] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.918419 16408 tablet_bootstrap.cc:492] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.921022 16406 tablet_bootstrap.cc:654] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.922292 16409 raft_consensus.cc:493] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.922892 16409 raft_consensus.cc:515] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.925082 16409 leader_election.cc:290] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.925665 16408 tablet_bootstrap.cc:654] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.934612 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35520108063427787b5af977ac1abe4" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:59.935425 16259 raft_consensus.cc:2468] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:59.936823 16073 leader_election.cc:304] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.935391 16008 catalog_manager.cc:5697] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.937811 16409 raft_consensus.cc:2804] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.938380 16409 raft_consensus.cc:493] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.938843 16409 raft_consensus.cc:3060] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.940255 16421 raft_consensus.cc:515] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.938634 16008 catalog_manager.cc:5697] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.942967 16408 tablet_bootstrap.cc:492] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.943569 16408 ts_tablet_manager.cc:1403] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.001s
I20260709 13:04:59.943661 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b131207223334bb6adfad5b7db7a0bee" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:04:59.944406 16109 raft_consensus.cc:3060] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.946774 16408 raft_consensus.cc:359] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.947240 16185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35520108063427787b5af977ac1abe4" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:59.947710 16408 raft_consensus.cc:385] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.948050 16408 raft_consensus.cc:740] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.948808 16408 consensus_queue.cc:260] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
W20260709 13:04:59.949126 16073 leader_election.cc:343] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.949087 16409 raft_consensus.cc:515] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
W20260709 13:04:59.950201 16222 leader_election.cc:343] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.950804 16222 leader_election.cc:304] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 406177939488436e998d9cc938163a91; no voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:04:59.951496 16408 ts_tablet_manager.cc:1434] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:59.952560 16408 tablet_bootstrap.cc:492] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832: Bootstrap starting.
I20260709 13:04:59.952903 16185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35520108063427787b5af977ac1abe4" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:59.953341 16435 raft_consensus.cc:2749] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:59.954203 16073 leader_election.cc:343] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.956493 16409 leader_election.cc:290] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.956610 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35520108063427787b5af977ac1abe4" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:59.957345 16259 raft_consensus.cc:3060] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.958900 16409 raft_consensus.cc:493] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.959709 16408 tablet_bootstrap.cc:654] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.959432 16409 raft_consensus.cc:515] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.962394 16185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0ded4eff6448e6bb79d1ecaedd1cee" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832" is_pre_election: true
I20260709 13:04:59.963050 16185 raft_consensus.cc:2468] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:59.964136 16073 leader_election.cc:304] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.964982 16428 raft_consensus.cc:2804] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.965242 16259 raft_consensus.cc:2468] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:04:59.974339 16185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b131207223334bb6adfad5b7db7a0bee" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:59.965878 16006 catalog_manager.cc:5697] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.965358 16428 raft_consensus.cc:493] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.969317 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0ded4eff6448e6bb79d1ecaedd1cee" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:04:59.982209 16428 raft_consensus.cc:3060] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.982470 16258 raft_consensus.cc:2468] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 0.
I20260709 13:04:59.967123 16109 raft_consensus.cc:2468] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 1.
I20260709 13:04:59.985253 16225 leader_election.cc:304] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:04:59.986712 16435 raft_consensus.cc:2804] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.987323 16435 raft_consensus.cc:697] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:04:59.988350 16435 consensus_queue.cc:237] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.976667 16421 leader_election.cc:290] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:04:59.990146 16428 raft_consensus.cc:515] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.978708 16073 leader_election.cc:304] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: c6459ab11719439fa9b7baf76983e832
I20260709 13:04:59.981305 16408 tablet_bootstrap.cc:492] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832: No bootstrap required, opened a new log
I20260709 13:04:59.991483 16393 raft_consensus.cc:2804] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.991597 16408 ts_tablet_manager.cc:1403] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.021s
I20260709 13:04:59.994781 16408 raft_consensus.cc:359] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:04:59.996862 16408 raft_consensus.cc:385] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.997764 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0ded4eff6448e6bb79d1ecaedd1cee" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:04:59.969808 16409 leader_election.cc:290] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:04:59.998529 16183 raft_consensus.cc:3060] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.998757 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0ded4eff6448e6bb79d1ecaedd1cee" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:04:59.998097 16408 raft_consensus.cc:740] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.999660 16258 raft_consensus.cc:3060] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.999279 16428 leader_election.cc:290] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.000941 16408 consensus_queue.cc:260] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.003602 16408 ts_tablet_manager.cc:1434] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:00.005493 16185 raft_consensus.cc:3060] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.008450 16258 raft_consensus.cc:2468] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:05:00.008450 16183 raft_consensus.cc:2468] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 1.
I20260709 13:05:00.010100 16073 leader_election.cc:304] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:00.011222 16428 raft_consensus.cc:2804] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.012049 16428 raft_consensus.cc:697] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.013000 16428 consensus_queue.cc:237] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.025354 16406 tablet_bootstrap.cc:492] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0: No bootstrap required, opened a new log
I20260709 13:05:00.026175 16406 ts_tablet_manager.cc:1403] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.013s
I20260709 13:05:00.027381 16008 catalog_manager.cc:5697] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 1 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.029433 16393 raft_consensus.cc:697] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.033978 16393 consensus_queue.cc:237] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.035161 16406 raft_consensus.cc:359] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.035916 16406 raft_consensus.cc:385] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.036194 16406 raft_consensus.cc:740] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.036852 16406 consensus_queue.cc:260] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.038938 16406 ts_tablet_manager.cc:1434] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:00.040946 16185 raft_consensus.cc:2468] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 1.
I20260709 13:05:00.055006 16006 catalog_manager.cc:5697] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.071587 16008 catalog_manager.cc:5697] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.074611 16393 consensus_queue.cc:1048] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.087828 16185 raft_consensus.cc:3060] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.105612 16393 consensus_queue.cc:1048] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.119886 16436 raft_consensus.cc:493] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.120498 16436 raft_consensus.cc:515] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.122766 16436 leader_election.cc:290] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.124450 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:05:00.125721 16109 raft_consensus.cc:2468] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 0.
I20260709 13:05:00.126129 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:05:00.126803 16258 raft_consensus.cc:2468] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 0.
I20260709 13:05:00.129140 16151 leader_election.cc:304] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:00.130041 16436 raft_consensus.cc:2804] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.130445 16436 raft_consensus.cc:493] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.130751 16436 raft_consensus.cc:3060] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.140247 16436 raft_consensus.cc:515] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.143255 16436 leader_election.cc:290] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.143991 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:00.144694 16109 raft_consensus.cc:3060] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.145045 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:05:00.145686 16258 raft_consensus.cc:3060] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.154714 16258 raft_consensus.cc:2468] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 1.
I20260709 13:05:00.155974 16148 leader_election.cc:304] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: 
I20260709 13:05:00.156961 16109 raft_consensus.cc:2468] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 1.
I20260709 13:05:00.157956 16436 raft_consensus.cc:2804] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.158567 16436 raft_consensus.cc:697] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:05:00.159502 16436 consensus_queue.cc:237] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.172333 16435 consensus_queue.cc:1048] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.172777 16006 catalog_manager.cc:5697] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 1 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:00.183702 16056 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:00.196312 16451 consensus_queue.cc:1048] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.202989 16347 consensus_queue.cc:1048] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.223136 16409 consensus_queue.cc:1048] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.233206 16436 raft_consensus.cc:493] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.234372 16436 raft_consensus.cc:515] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.236797 16436 leader_election.cc:290] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.238265 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35520108063427787b5af977ac1abe4" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406177939488436e998d9cc938163a91" is_pre_election: true
I20260709 13:05:00.239138 16258 raft_consensus.cc:2393] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6459ab11719439fa9b7baf76983e832 in current term 1: Already voted for candidate e86ef4d3d63c483d975d4022f3093da0 in this term.
I20260709 13:05:00.239112 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35520108063427787b5af977ac1abe4" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e86ef4d3d63c483d975d4022f3093da0" is_pre_election: true
I20260709 13:05:00.244712 16151 leader_election.cc:304] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6459ab11719439fa9b7baf76983e832; no voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0
I20260709 13:05:00.245466 16436 raft_consensus.cc:3060] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.255532 16436 raft_consensus.cc:2749] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.264813 16259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "596e922d333c4540ba156d83e5513375"
dest_uuid: "406177939488436e998d9cc938163a91"
mode: GRACEFUL
new_leader_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:05:00.265532 16259 raft_consensus.cc:606] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Received request to transfer leadership to TS e86ef4d3d63c483d975d4022f3093da0
I20260709 13:05:00.271049 16259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b131207223334bb6adfad5b7db7a0bee"
dest_uuid: "406177939488436e998d9cc938163a91"
mode: GRACEFUL
new_leader_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:05:00.271628 16259 raft_consensus.cc:606] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Received request to transfer leadership to TS e86ef4d3d63c483d975d4022f3093da0
I20260709 13:05:00.276916 16259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84"
dest_uuid: "406177939488436e998d9cc938163a91"
mode: GRACEFUL
new_leader_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:05:00.277431 16259 raft_consensus.cc:606] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Received request to transfer leadership to TS e86ef4d3d63c483d975d4022f3093da0
I20260709 13:05:00.285971 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb4bfd85ccb1458395776eafcaec1333"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:05:00.286525 16110 raft_consensus.cc:606] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS c6459ab11719439fa9b7baf76983e832
I20260709 13:05:00.292063 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d0ded4eff6448e6bb79d1ecaedd1cee"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:05:00.292762 16110 raft_consensus.cc:606] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS c6459ab11719439fa9b7baf76983e832
I20260709 13:05:00.298287 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e233a5c40a5424e9fe943bc265d93aa"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:05:00.298902 16110 raft_consensus.cc:606] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS c6459ab11719439fa9b7baf76983e832
I20260709 13:05:00.307747 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35520108063427787b5af977ac1abe4"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:42712
I20260709 13:05:00.308357 16110 raft_consensus.cc:606] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS 406177939488436e998d9cc938163a91
I20260709 13:05:00.360918 16393 consensus_queue.cc:1048] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.365025 16435 consensus_queue.cc:1048] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.368793 16428 raft_consensus.cc:993] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:05:00.369274 16428 raft_consensus.cc:1081] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:05:00.372294 16183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb4bfd85ccb1458395776eafcaec1333"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42208
I20260709 13:05:00.376571 16435 consensus_queue.cc:1048] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.377236 16183 raft_consensus.cc:493] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.378930 16183 raft_consensus.cc:3060] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.377998 16428 consensus_queue.cc:1048] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.390697 16347 raft_consensus.cc:993] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91: : Instructing follower e86ef4d3d63c483d975d4022f3093da0 to start an election
I20260709 13:05:00.391186 16347 raft_consensus.cc:1081] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Signalling peer e86ef4d3d63c483d975d4022f3093da0 to start an election
I20260709 13:05:00.390805 16183 raft_consensus.cc:515] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.391979 16185 raft_consensus.cc:1240] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Rejecting Update request from peer e86ef4d3d63c483d975d4022f3093da0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:00.393359 16109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "596e922d333c4540ba156d83e5513375"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:42700
I20260709 13:05:00.394027 16109 raft_consensus.cc:493] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.394413 16109 raft_consensus.cc:3060] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.397076 16428 consensus_queue.cc:1059] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.397984 16428 raft_consensus.cc:3055] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.398304 16428 raft_consensus.cc:740] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.402050 16428 consensus_queue.cc:260] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.405848 16428 raft_consensus.cc:3060] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.405429 16109 raft_consensus.cc:515] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.406736 16110 raft_consensus.cc:1240] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Rejecting Update request from peer 406177939488436e998d9cc938163a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:00.408999 16421 consensus_queue.cc:1059] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.409099 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:05:00.411345 16259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4bfd85ccb1458395776eafcaec1333" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:05:00.410113 16421 raft_consensus.cc:3055] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.411116 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4bfd85ccb1458395776eafcaec1333" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:00.411955 16259 raft_consensus.cc:3060] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.411948 16421 raft_consensus.cc:740] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:05:00.413501 16451 consensus_queue.cc:1048] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.413345 16421 consensus_queue.cc:260] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.414683 16184 raft_consensus.cc:3060] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.415324 16421 raft_consensus.cc:3060] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.418905 16259 raft_consensus.cc:2468] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:05:00.419184 16183 leader_election.cc:290] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.420063 16148 leader_election.cc:304] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: 
I20260709 13:05:00.420935 16436 raft_consensus.cc:2804] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.421445 16436 raft_consensus.cc:697] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:05:00.422308 16436 consensus_queue.cc:237] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.426996 16108 raft_consensus.cc:2468] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:05:00.428946 16184 raft_consensus.cc:2468] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:05:00.430146 16073 leader_election.cc:304] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:00.431011 16428 raft_consensus.cc:2804] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.432255 16428 raft_consensus.cc:697] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.433003 16008 catalog_manager.cc:5697] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.434207 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e922d333c4540ba156d83e5513375" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:05:00.433081 16109 leader_election.cc:290] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.433127 16428 consensus_queue.cc:237] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.440652 16393 consensus_queue.cc:1048] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.448078 16258 raft_consensus.cc:2468] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:05:00.451838 16006 catalog_manager.cc:5697] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 1 to 2, leader changed from 406177939488436e998d9cc938163a91 (127.7.28.195) to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.453541 16393 raft_consensus.cc:993] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:05:00.454089 16428 raft_consensus.cc:1081] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:05:00.455602 16183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d0ded4eff6448e6bb79d1ecaedd1cee"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42208
I20260709 13:05:00.456107 16183 raft_consensus.cc:493] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.456471 16183 raft_consensus.cc:3060] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.463474 16183 raft_consensus.cc:515] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.467198 16183 leader_election.cc:290] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.468053 16428 consensus_queue.cc:1048] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.467202 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0ded4eff6448e6bb79d1ecaedd1cee" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:00.470031 16109 raft_consensus.cc:3055] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.470489 16109 raft_consensus.cc:740] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.471478 16109 consensus_queue.cc:260] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.473201 16109 raft_consensus.cc:3060] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.477937 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0ded4eff6448e6bb79d1ecaedd1cee" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:05:00.478588 16258 raft_consensus.cc:3060] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.482079 16109 raft_consensus.cc:2468] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:05:00.485566 16393 consensus_queue.cc:1048] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.487686 16258 raft_consensus.cc:2468] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:05:00.489065 16148 leader_election.cc:304] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: 
I20260709 13:05:00.490006 16405 raft_consensus.cc:2804] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.490494 16405 raft_consensus.cc:697] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:05:00.491343 16405 consensus_queue.cc:237] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.500801 16428 raft_consensus.cc:993] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:00.501309 16393 raft_consensus.cc:1081] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:00.501885 16007 catalog_manager.cc:5697] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.502921 16258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35520108063427787b5af977ac1abe4"
dest_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:54190
I20260709 13:05:00.503489 16258 raft_consensus.cc:493] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.503806 16258 raft_consensus.cc:3060] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.510542 16258 raft_consensus.cc:515] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.512315 16258 leader_election.cc:290] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:05:00.513131 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35520108063427787b5af977ac1abe4" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:00.513760 16108 raft_consensus.cc:3055] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.514129 16108 raft_consensus.cc:740] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.513967 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35520108063427787b5af977ac1abe4" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:05:00.514822 16183 raft_consensus.cc:3060] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.515089 16108 consensus_queue.cc:260] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.516234 16108 raft_consensus.cc:3060] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.521551 16183 raft_consensus.cc:2468] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 2.
I20260709 13:05:00.522136 16108 raft_consensus.cc:2468] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 2.
I20260709 13:05:00.523260 16225 leader_election.cc:304] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:00.524104 16435 raft_consensus.cc:2804] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.524560 16435 raft_consensus.cc:697] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 2 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:05:00.525364 16435 consensus_queue.cc:237] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.531720 16006 catalog_manager.cc:5697] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:00.563553 16280 debug-util.cc:398] Leaking SignalData structure 0x7b0800118200 after lost signal to thread 7286
I20260709 13:05:00.563861 16428 raft_consensus.cc:993] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower c6459ab11719439fa9b7baf76983e832 to start an election
I20260709 13:05:00.564435 16428 raft_consensus.cc:1081] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer c6459ab11719439fa9b7baf76983e832 to start an election
W20260709 13:05:00.564796 16280 debug-util.cc:398] Leaking SignalData structure 0x7b0800054d20 after lost signal to thread 16042
W20260709 13:05:00.566073 16280 debug-util.cc:398] Leaking SignalData structure 0x7b080020e040 after lost signal to thread 16134
I20260709 13:05:00.565961 16183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e233a5c40a5424e9fe943bc265d93aa"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
 from {username='slave'} at 127.0.0.1:42208
I20260709 13:05:00.566592 16183 raft_consensus.cc:493] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.566982 16183 raft_consensus.cc:3060] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:00.567129 16280 debug-util.cc:398] Leaking SignalData structure 0x7b0800035800 after lost signal to thread 16209
I20260709 13:05:00.572808 16183 raft_consensus.cc:515] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.574653 16183 leader_election.cc:290] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.575757 16258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e233a5c40a5424e9fe943bc265d93aa" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:05:00.576390 16258 raft_consensus.cc:3060] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.574682 16435 consensus_queue.cc:1048] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:00.583431 16405 consensus_queue.cc:1048] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.585762 16347 consensus_queue.cc:1048] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.586560 16258 raft_consensus.cc:2468] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:05:00.588560 16148 leader_election.cc:304] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: 
I20260709 13:05:00.590265 16405 raft_consensus.cc:2804] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.590870 16405 raft_consensus.cc:697] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Becoming Leader. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:05:00.591593 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e233a5c40a5424e9fe943bc265d93aa" candidate_uuid: "c6459ab11719439fa9b7baf76983e832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:00.592270 16108 raft_consensus.cc:3055] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.591866 16405 consensus_queue.cc:237] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.593922 16108 raft_consensus.cc:740] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.594866 16108 consensus_queue.cc:260] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.596153 16108 raft_consensus.cc:3060] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.605643 16347 raft_consensus.cc:993] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91: : Instructing follower e86ef4d3d63c483d975d4022f3093da0 to start an election
I20260709 13:05:00.606251 16347 raft_consensus.cc:1081] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Signalling peer e86ef4d3d63c483d975d4022f3093da0 to start an election
I20260709 13:05:00.609411 16107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b131207223334bb6adfad5b7db7a0bee"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:42700
I20260709 13:05:00.610090 16107 raft_consensus.cc:493] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.610531 16107 raft_consensus.cc:3060] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.612396 16108 raft_consensus.cc:2468] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6459ab11719439fa9b7baf76983e832 in term 2.
I20260709 13:05:00.616691 16430 consensus_queue.cc:1048] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.624882 16006 catalog_manager.cc:5697] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to c6459ab11719439fa9b7baf76983e832 (127.7.28.194). New cstate: current_term: 2 leader_uuid: "c6459ab11719439fa9b7baf76983e832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.627884 16107 raft_consensus.cc:515] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.629144 16110 raft_consensus.cc:1240] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Rejecting Update request from peer 406177939488436e998d9cc938163a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:00.634354 16107 leader_election.cc:290] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.635075 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b131207223334bb6adfad5b7db7a0bee" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:05:00.635756 16183 raft_consensus.cc:3060] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.633424 16435 consensus_queue.cc:1059] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:00.639355 16257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b131207223334bb6adfad5b7db7a0bee" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:05:00.640054 16435 raft_consensus.cc:3055] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.640441 16435 raft_consensus.cc:740] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:05:00.641294 16435 consensus_queue.cc:260] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.642653 16435 raft_consensus.cc:3060] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.647985 16183 raft_consensus.cc:2468] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:05:00.649212 16073 leader_election.cc:304] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:00.650033 16428 raft_consensus.cc:2804] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.650523 16428 raft_consensus.cc:697] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.651333 16428 consensus_queue.cc:237] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.654270 16347 raft_consensus.cc:993] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91: : Instructing follower e86ef4d3d63c483d975d4022f3093da0 to start an election
I20260709 13:05:00.654845 16347 raft_consensus.cc:1081] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Signalling peer e86ef4d3d63c483d975d4022f3093da0 to start an election
I20260709 13:05:00.657019 16107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
 from {username='slave'} at 127.0.0.1:42700
I20260709 13:05:00.658058 16107 raft_consensus.cc:493] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.658717 16107 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.669303 16107 raft_consensus.cc:515] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.670253 16007 catalog_manager.cc:5697] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 1 to 2, leader changed from 406177939488436e998d9cc938163a91 (127.7.28.195) to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.681881 16257 raft_consensus.cc:2468] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:05:00.683171 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:05:00.683910 16183 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.686997 16257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84" candidate_uuid: "e86ef4d3d63c483d975d4022f3093da0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406177939488436e998d9cc938163a91"
I20260709 13:05:00.688199 16257 raft_consensus.cc:3055] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.688603 16257 raft_consensus.cc:740] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:05:00.687614 16107 leader_election.cc:290] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Requested vote from peers c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241), 406177939488436e998d9cc938163a91 (127.7.28.195:40277)
I20260709 13:05:00.691000 16257 consensus_queue.cc:260] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.692533 16257 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.692915 16183 raft_consensus.cc:2468] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:05:00.694697 16073 leader_election.cc:304] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6459ab11719439fa9b7baf76983e832, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:00.697301 16393 raft_consensus.cc:2804] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.697847 16393 raft_consensus.cc:697] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Becoming Leader. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:00.698722 16393 consensus_queue.cc:237] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:00.701062 16257 raft_consensus.cc:2468] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e86ef4d3d63c483d975d4022f3093da0 in term 2.
I20260709 13:05:00.706626 16007 catalog_manager.cc:5697] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 reported cstate change: term changed from 1 to 2, leader changed from 406177939488436e998d9cc938163a91 (127.7.28.195) to e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "e86ef4d3d63c483d975d4022f3093da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.826428 16107 raft_consensus.cc:1275] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.827775 16430 consensus_queue.cc:1048] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.840911 16257 raft_consensus.cc:1275] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.842427 16436 consensus_queue.cc:1048] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.881438 16107 raft_consensus.cc:1275] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.883347 16436 consensus_queue.cc:1048] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.902161 16183 raft_consensus.cc:1275] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.904575 16257 raft_consensus.cc:1275] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.905174 16393 consensus_queue.cc:1048] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.906389 16479 consensus_queue.cc:1048] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:00.922799 16257 raft_consensus.cc:1275] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.926779 16409 consensus_queue.cc:1048] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.028471 16183 raft_consensus.cc:1275] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.029911 16435 consensus_queue.cc:1048] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.039827 16107 raft_consensus.cc:1275] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.041745 16435 consensus_queue.cc:1048] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:01.068634 16257 raft_consensus.cc:1275] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.069936 16479 consensus_queue.cc:1048] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.079185 16107 raft_consensus.cc:1275] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer c6459ab11719439fa9b7baf76983e832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.082007 16405 consensus_queue.cc:1048] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.083647 16258 raft_consensus.cc:1275] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.088665 16409 consensus_queue.cc:1048] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.107208 16183 raft_consensus.cc:1275] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.110092 16428 consensus_queue.cc:1048] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.139539 16258 raft_consensus.cc:1275] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.140875 16409 consensus_queue.cc:1048] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.150568 16183 raft_consensus.cc:1275] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Refusing update from remote peer e86ef4d3d63c483d975d4022f3093da0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.152977 16451 consensus_queue.cc:1048] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.312352 16008 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47688:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:03.335530 16008 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47688:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:03.377483  7283 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:03.466774 16521 tablet.cc:1724] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.526841 16528 tablet.cc:1724] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.507746 16520 tablet.cc:1724] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:03.544848 16285 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:cb4bfd85ccb1458395776eafcaec1333)
W20260709 13:05:03.557294 16285 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:cb4bfd85ccb1458395776eafcaec1333)
W20260709 13:05:03.562470 16285 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:cb4bfd85ccb1458395776eafcaec1333)
I20260709 13:05:03.588852 16532 tablet.cc:1724] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.621332 16537 tablet.cc:1724] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.632210 16536 tablet.cc:1724] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.671088 16539 tablet.cc:1724] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.700012 16521 tablet.cc:1724] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.707392 16538 tablet.cc:1724] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.694533 16109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:42718
I20260709 13:05:03.709993 16109 raft_consensus.cc:606] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Received request to transfer leadership to TS 406177939488436e998d9cc938163a91
W20260709 13:05:03.712236 16073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:46241, user_credentials={real_user=slave}} blocked reactor thread for 164154us
I20260709 13:05:03.718400 16540 tablet.cc:1724] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.732384 16534 raft_consensus.cc:993] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:03.733217 16534 raft_consensus.cc:1081] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Signalling peer 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:03.764092 16550 tablet.cc:1724] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.780756 16545 tablet.cc:1724] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.795990 16528 tablet.cc:1724] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.797971 16253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84"
dest_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:54190
I20260709 13:05:03.798703 16253 raft_consensus.cc:493] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.799106 16253 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.800207 16537 tablet.cc:1724] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.781684 16538 tablet.cc:1724] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.817700 16532 tablet.cc:1724] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.846235 16547 tablet.cc:1724] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:03.867226 16544 log.cc:927] Time spent T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:05:03.801592 16520 tablet.cc:1724] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.883497 16540 tablet.cc:1724] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.892961 16550 tablet.cc:1724] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.904832 16550 tablet.cc:1724] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.921623 16545 tablet.cc:1724] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.867130 16539 tablet.cc:1724] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.927978 16540 tablet.cc:1724] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.958596 16539 tablet.cc:1724] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.943277 16253 raft_consensus.cc:515] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
W20260709 13:05:03.959761 16549 log.cc:927] Time spent T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:03.991945 16528 tablet.cc:1724] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.993618 16253 leader_election.cc:290] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 3 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:05:03.995277 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:03.995998 16107 raft_consensus.cc:3055] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.996332 16107 raft_consensus.cc:740] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:03.998783 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ad438e03a44b0fb583e38f7a535d84" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:05:03.999480 16183 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.997220 16107 consensus_queue.cc:260] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.002383 16107 raft_consensus.cc:3060] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.012794 16180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
mode: GRACEFUL
new_leader_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:05:04.013554 16180 raft_consensus.cc:606] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Received request to transfer leadership to TS 406177939488436e998d9cc938163a91
I20260709 13:05:04.013811 16183 raft_consensus.cc:2468] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 3.
I20260709 13:05:04.015506  7283 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:05:04.008941 16520 tablet.cc:1724] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:04.016300  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:04.021409 16222 leader_election.cc:304] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, c6459ab11719439fa9b7baf76983e832; no voters: 
I20260709 13:05:04.022683 16523 raft_consensus.cc:2804] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.023277 16523 raft_consensus.cc:697] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 3 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:05:04.024129 16523 consensus_queue.cc:237] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.032078 16109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256"
dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
mode: GRACEFUL
new_leader_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:42718
I20260709 13:05:04.032788 16109 raft_consensus.cc:606] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Received request to transfer leadership to TS 406177939488436e998d9cc938163a91
I20260709 13:05:04.037300 16107 raft_consensus.cc:2468] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 3.
I20260709 13:05:04.046028 16183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d"
dest_uuid: "c6459ab11719439fa9b7baf76983e832"
mode: GRACEFUL
new_leader_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:05:04.050189 16183 raft_consensus.cc:606] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Received request to transfer leadership to TS 406177939488436e998d9cc938163a91
I20260709 13:05:04.051831  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:04.052575  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:04.062614 16008 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82: soft_deleted_table [id=f079b9ff417c4078927a70a5baff76d7] alter complete (version 1)
I20260709 13:05:04.076042 16006 catalog_manager.cc:5697] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 2 to 3, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.290154 16525 raft_consensus.cc:993] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832: : Instructing follower 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:04.290722 16525 raft_consensus.cc:1081] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Signalling peer 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:04.292472 16253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d"
dest_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:54186
I20260709 13:05:04.293175 16253 raft_consensus.cc:493] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.293584 16253 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.300376 16253 raft_consensus.cc:515] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.303309 16253 leader_election.cc:290] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 3 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:05:04.303227 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:05:04.304309 16183 raft_consensus.cc:3055] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:04.304623 16183 raft_consensus.cc:740] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:05:04.305331 16183 consensus_queue.cc:260] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.306282 16183 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.303198 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95cdbc4f9e14650ad38752ea1bf411d" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:04.308079 16107 raft_consensus.cc:3060] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.316993 16107 raft_consensus.cc:2468] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 3.
I20260709 13:05:04.318415 16225 leader_election.cc:304] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:04.318851 16183 raft_consensus.cc:2468] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 3.
I20260709 13:05:04.319430 16523 raft_consensus.cc:2804] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.319989 16523 raft_consensus.cc:697] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 3 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:05:04.320397 16534 raft_consensus.cc:993] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0: : Instructing follower 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:04.320922 16534 raft_consensus.cc:1081] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Signalling peer 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:04.320950 16523 consensus_queue.cc:237] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.322813 16253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256"
dest_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:54190
I20260709 13:05:04.323400 16253 raft_consensus.cc:493] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.323832 16253 raft_consensus.cc:3060] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.330410 16006 catalog_manager.cc:5697] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 2 to 3, leader changed from c6459ab11719439fa9b7baf76983e832 (127.7.28.194) to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 3 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.332733 16253 raft_consensus.cc:515] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.335170 16527 raft_consensus.cc:993] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832: : Instructing follower 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:04.335690 16527 raft_consensus.cc:1081] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Signalling peer 406177939488436e998d9cc938163a91 to start an election
I20260709 13:05:04.335971 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:04.336237 16253 leader_election.cc:290] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:05:04.336723 16107 raft_consensus.cc:3055] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:04.337098 16107 raft_consensus.cc:740] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e86ef4d3d63c483d975d4022f3093da0, State: Running, Role: LEADER
I20260709 13:05:04.338017 16107 consensus_queue.cc:260] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.339037 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822b4008c46a46f2b10fa35f37f29256" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:05:04.339464 16107 raft_consensus.cc:3060] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.339668 16183 raft_consensus.cc:3060] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.342126 16253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb"
dest_uuid: "406177939488436e998d9cc938163a91"
 from {username='slave'} at 127.0.0.1:54186
I20260709 13:05:04.342911 16253 raft_consensus.cc:493] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.343318 16253 raft_consensus.cc:3060] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.347735 16107 raft_consensus.cc:2468] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 2.
I20260709 13:05:04.349618 16225 leader_election.cc:304] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:04.350611 16523 raft_consensus.cc:2804] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.351126 16523 raft_consensus.cc:697] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 2 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:05:04.352111 16523 consensus_queue.cc:237] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.354343 16183 raft_consensus.cc:2468] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 2.
I20260709 13:05:04.358999 16253 raft_consensus.cc:515] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.361965 16253 leader_election.cc:290] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 election: Requested vote from peers e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577), c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241)
I20260709 13:05:04.364384 16180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c6459ab11719439fa9b7baf76983e832"
I20260709 13:05:04.363739 16006 catalog_manager.cc:5697] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 1 to 2, leader changed from e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193) to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.365135 16180 raft_consensus.cc:3055] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:04.365200 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3ac40d0756433d9f4f4468575fc2fb" candidate_uuid: "406177939488436e998d9cc938163a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e86ef4d3d63c483d975d4022f3093da0"
I20260709 13:05:04.365592 16180 raft_consensus.cc:740] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6459ab11719439fa9b7baf76983e832, State: Running, Role: LEADER
I20260709 13:05:04.366111 16107 raft_consensus.cc:3060] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.366554 16180 consensus_queue.cc:260] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.367980 16180 raft_consensus.cc:3060] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.374598 16107 raft_consensus.cc:2468] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 2.
I20260709 13:05:04.376423 16225 leader_election.cc:304] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406177939488436e998d9cc938163a91, e86ef4d3d63c483d975d4022f3093da0; no voters: 
I20260709 13:05:04.377731 16180 raft_consensus.cc:2468] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406177939488436e998d9cc938163a91 in term 2.
I20260709 13:05:04.378438 16523 raft_consensus.cc:2804] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.379741 16523 raft_consensus.cc:697] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 2 LEADER]: Becoming Leader. State: Replica: 406177939488436e998d9cc938163a91, State: Running, Role: LEADER
I20260709 13:05:04.380625 16523 consensus_queue.cc:237] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } }
I20260709 13:05:04.388056 16006 catalog_manager.cc:5697] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 reported cstate change: term changed from 1 to 2, leader changed from c6459ab11719439fa9b7baf76983e832 (127.7.28.194) to 406177939488436e998d9cc938163a91 (127.7.28.195). New cstate: current_term: 2 leader_uuid: "406177939488436e998d9cc938163a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406177939488436e998d9cc938163a91" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 40277 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.551800 16180 raft_consensus.cc:1275] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 3 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:04.553215 16523 consensus_queue.cc:1048] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.566675 16107 raft_consensus.cc:1275] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 3 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:04.568336 16435 consensus_queue.cc:1048] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.743603 16109 raft_consensus.cc:1275] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.745134 16561 consensus_queue.cc:1048] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.758311 16180 raft_consensus.cc:1275] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.764106 16565 consensus_queue.cc:1048] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:04.802030 16180 raft_consensus.cc:1275] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:04.803586 16565 consensus_queue.cc:1048] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:04.811682 16109 raft_consensus.cc:1275] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:04.815052 16523 consensus_queue.cc:1048] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.831115 16180 raft_consensus.cc:1275] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 3 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.835723 16435 consensus_queue.cc:1048] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6459ab11719439fa9b7baf76983e832" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.850732 16109 raft_consensus.cc:1275] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 3 FOLLOWER]: Refusing update from remote peer 406177939488436e998d9cc938163a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.852458 16435 consensus_queue.cc:1048] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e86ef4d3d63c483d975d4022f3093da0" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.125869  7283 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:05.135423  7283 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:05:05.136080  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:05.144884  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:05:05.145540  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:06.179651  7283 tablet_server.cc:179] TabletServer@127.7.28.193:0 shutting down...
W20260709 13:05:06.197744 16225 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 20 similar messages]
W20260709 13:05:06.201431 16225 consensus_peers.cc:597] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 -> Peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Couldn't send request to peer e86ef4d3d63c483d975d4022f3093da0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.210704 16225 consensus_peers.cc:597] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 -> Peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Couldn't send request to peer e86ef4d3d63c483d975d4022f3093da0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.212785  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:06.213610  7283 tablet_replica.cc:333] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.214354  7283 raft_consensus.cc:2243] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.214857  7283 raft_consensus.cc:2272] T eb3ac40d0756433d9f4f4468575fc2fb P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.216965  7283 tablet_replica.cc:333] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.217705  7283 raft_consensus.cc:2243] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.218693  7283 raft_consensus.cc:2272] T b131207223334bb6adfad5b7db7a0bee P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.220808  7283 tablet_replica.cc:333] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.221315  7283 raft_consensus.cc:2243] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.221702  7283 raft_consensus.cc:2272] T e35520108063427787b5af977ac1abe4 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.223652  7283 tablet_replica.cc:333] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.224255  7283 raft_consensus.cc:2243] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.224633  7283 raft_consensus.cc:2272] T 3d0ded4eff6448e6bb79d1ecaedd1cee P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.226435  7283 tablet_replica.cc:333] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.226943  7283 raft_consensus.cc:2243] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.227720  7283 raft_consensus.cc:2272] T 596e922d333c4540ba156d83e5513375 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.229444  7283 tablet_replica.cc:333] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.229995  7283 raft_consensus.cc:2243] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.230365  7283 raft_consensus.cc:2272] T cb4bfd85ccb1458395776eafcaec1333 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.232096  7283 tablet_replica.cc:333] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.232604  7283 raft_consensus.cc:2243] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.233002  7283 raft_consensus.cc:2272] T 6e233a5c40a5424e9fe943bc265d93aa P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.234925  7283 tablet_replica.cc:333] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.235457  7283 raft_consensus.cc:2243] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.236162  7283 raft_consensus.cc:2272] T 7a9bf56b22b746788b18d6750841cd81 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.238059  7283 tablet_replica.cc:333] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.238875  7283 raft_consensus.cc:2243] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.239470  7283 raft_consensus.cc:2272] T 10699b1acff542b48fe24849b5154054 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.242545  7283 tablet_replica.cc:333] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.243187  7283 raft_consensus.cc:2243] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.243820  7283 raft_consensus.cc:2272] T 35dba36e7f6148fbba14032657943e9d P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:06.243806 16151 consensus_peers.cc:597] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 -> Peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Couldn't send request to peer e86ef4d3d63c483d975d4022f3093da0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.246769  7283 tablet_replica.cc:333] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.247370  7283 raft_consensus.cc:2243] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.248162  7283 raft_consensus.cc:2272] T 396c2802a4c145e0897bf51d63bf8b73 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.250540  7283 tablet_replica.cc:333] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.251246  7283 raft_consensus.cc:2243] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.251760  7283 raft_consensus.cc:2272] T b95cdbc4f9e14650ad38752ea1bf411d P e86ef4d3d63c483d975d4022f3093da0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.253872  7283 tablet_replica.cc:333] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.254505  7283 raft_consensus.cc:2243] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.255347  7283 raft_consensus.cc:2272] T e3031d485f54441888e8e6ef1a325929 P e86ef4d3d63c483d975d4022f3093da0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.257468  7283 tablet_replica.cc:333] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.258121  7283 raft_consensus.cc:2243] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.258610  7283 raft_consensus.cc:2272] T cef1e9dd6c8847b787659ed9f87af311 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.261302  7283 tablet_replica.cc:333] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.261981  7283 raft_consensus.cc:2243] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.262485  7283 raft_consensus.cc:2272] T dc2f2d3b8a18442fa49b08cd6609ec92 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:06.263763 16151 consensus_peers.cc:597] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 -> Peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Couldn't send request to peer e86ef4d3d63c483d975d4022f3093da0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.264823  7283 tablet_replica.cc:333] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.265478  7283 raft_consensus.cc:2243] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.266052  7283 raft_consensus.cc:2272] T 00ad438e03a44b0fb583e38f7a535d84 P e86ef4d3d63c483d975d4022f3093da0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.267927  7283 tablet_replica.cc:333] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.268524  7283 raft_consensus.cc:2243] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.269349  7283 raft_consensus.cc:2272] T bc54ca9c964a44a8ae7125556f8c691f P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.271643  7283 tablet_replica.cc:333] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0: stopping tablet replica
I20260709 13:05:06.272133  7283 raft_consensus.cc:2243] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.272570  7283 raft_consensus.cc:2272] T 822b4008c46a46f2b10fa35f37f29256 P e86ef4d3d63c483d975d4022f3093da0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.314114  7283 tablet_server.cc:196] TabletServer@127.7.28.193:0 shutdown complete.
I20260709 13:05:06.347705  7283 tablet_server.cc:179] TabletServer@127.7.28.194:0 shutting down...
I20260709 13:05:06.379833  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:06.380668  7283 tablet_replica.cc:333] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.381646  7283 raft_consensus.cc:2243] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.382352  7283 raft_consensus.cc:2272] T e35520108063427787b5af977ac1abe4 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.384291  7283 tablet_replica.cc:333] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.384840  7283 raft_consensus.cc:2243] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.385591  7283 raft_consensus.cc:2272] T 3d0ded4eff6448e6bb79d1ecaedd1cee P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.387492  7283 tablet_replica.cc:333] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.388003  7283 raft_consensus.cc:2243] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.388439  7283 raft_consensus.cc:2272] T eb3ac40d0756433d9f4f4468575fc2fb P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.390709  7283 tablet_replica.cc:333] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.391392  7283 raft_consensus.cc:2243] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.391902  7283 raft_consensus.cc:2272] T b131207223334bb6adfad5b7db7a0bee P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.394511  7283 tablet_replica.cc:333] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.395159  7283 raft_consensus.cc:2243] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:06.395661 16151 consensus_peers.cc:597] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 -> Peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Couldn't send request to peer e86ef4d3d63c483d975d4022f3093da0. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:37577: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.396181  7283 raft_consensus.cc:2272] T cb4bfd85ccb1458395776eafcaec1333 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.398411  7283 tablet_replica.cc:333] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.399137  7283 raft_consensus.cc:2243] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.399632  7283 raft_consensus.cc:2272] T 596e922d333c4540ba156d83e5513375 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.401947  7283 tablet_replica.cc:333] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.402637  7283 raft_consensus.cc:2243] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:06.402799 16222 consensus_peers.cc:597] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 -> Peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Couldn't send request to peer c6459ab11719439fa9b7baf76983e832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.403618  7283 raft_consensus.cc:2272] T 6e233a5c40a5424e9fe943bc265d93aa P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.405452  7283 tablet_replica.cc:333] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.406051  7283 raft_consensus.cc:2243] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.406448  7283 raft_consensus.cc:2272] T 7a9bf56b22b746788b18d6750841cd81 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.408430  7283 tablet_replica.cc:333] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.409061  7283 raft_consensus.cc:2243] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.409608  7283 raft_consensus.cc:2272] T 10699b1acff542b48fe24849b5154054 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.411815  7283 tablet_replica.cc:333] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.412379  7283 raft_consensus.cc:2243] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.413422  7283 raft_consensus.cc:2272] T 35dba36e7f6148fbba14032657943e9d P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.416831  7283 tablet_replica.cc:333] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.417675  7283 raft_consensus.cc:2243] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:06.418174 16222 consensus_peers.cc:597] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 -> Peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Couldn't send request to peer c6459ab11719439fa9b7baf76983e832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.418308  7283 raft_consensus.cc:2272] T 822b4008c46a46f2b10fa35f37f29256 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:06.419661 16225 consensus_peers.cc:597] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 -> Peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Couldn't send request to peer e86ef4d3d63c483d975d4022f3093da0. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:37577: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.421022  7283 tablet_replica.cc:333] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.421685  7283 raft_consensus.cc:2243] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.422215  7283 raft_consensus.cc:2272] T 00ad438e03a44b0fb583e38f7a535d84 P c6459ab11719439fa9b7baf76983e832 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.424109  7283 tablet_replica.cc:333] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.424669  7283 raft_consensus.cc:2243] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.425089  7283 raft_consensus.cc:2272] T bc54ca9c964a44a8ae7125556f8c691f P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.427237  7283 tablet_replica.cc:333] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.427759  7283 raft_consensus.cc:2243] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.428550  7283 raft_consensus.cc:2272] T dc2f2d3b8a18442fa49b08cd6609ec92 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.430673  7283 tablet_replica.cc:333] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.431171  7283 raft_consensus.cc:2243] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.431885  7283 raft_consensus.cc:2272] T cef1e9dd6c8847b787659ed9f87af311 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.433858  7283 tablet_replica.cc:333] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.434418  7283 raft_consensus.cc:2243] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.434800  7283 raft_consensus.cc:2272] T b95cdbc4f9e14650ad38752ea1bf411d P c6459ab11719439fa9b7baf76983e832 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.436816  7283 tablet_replica.cc:333] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.437297  7283 raft_consensus.cc:2243] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.437656  7283 raft_consensus.cc:2272] T e3031d485f54441888e8e6ef1a325929 P c6459ab11719439fa9b7baf76983e832 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.439651  7283 tablet_replica.cc:333] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832: stopping tablet replica
I20260709 13:05:06.440093  7283 raft_consensus.cc:2243] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.440457  7283 raft_consensus.cc:2272] T 396c2802a4c145e0897bf51d63bf8b73 P c6459ab11719439fa9b7baf76983e832 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.480051  7283 tablet_server.cc:196] TabletServer@127.7.28.194:0 shutdown complete.
W20260709 13:05:06.501361 16222 consensus_peers.cc:597] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 -> Peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Couldn't send request to peer c6459ab11719439fa9b7baf76983e832. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:46241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.515209  7283 tablet_server.cc:179] TabletServer@127.7.28.195:0 shutting down...
W20260709 13:05:06.519668 16222 consensus_peers.cc:597] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 -> Peer c6459ab11719439fa9b7baf76983e832 (127.7.28.194:46241): Couldn't send request to peer c6459ab11719439fa9b7baf76983e832. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:46241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.546051  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:06.546885  7283 tablet_replica.cc:333] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.547508  7283 raft_consensus.cc:2243] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.548012  7283 raft_consensus.cc:2272] T 3d0ded4eff6448e6bb79d1ecaedd1cee P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.550019  7283 tablet_replica.cc:333] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.550679  7283 raft_consensus.cc:2243] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.551467  7283 raft_consensus.cc:2272] T e35520108063427787b5af977ac1abe4 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.553285  7283 tablet_replica.cc:333] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.553906  7283 raft_consensus.cc:2243] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.554337  7283 raft_consensus.cc:2272] T 6e233a5c40a5424e9fe943bc265d93aa P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.556048  7283 tablet_replica.cc:333] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.556645  7283 raft_consensus.cc:2243] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.557085  7283 raft_consensus.cc:2272] T 7a9bf56b22b746788b18d6750841cd81 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.558883  7283 tablet_replica.cc:333] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.559423  7283 raft_consensus.cc:2243] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.559844  7283 raft_consensus.cc:2272] T cb4bfd85ccb1458395776eafcaec1333 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.561561  7283 tablet_replica.cc:333] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.562201  7283 raft_consensus.cc:2243] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.562661  7283 raft_consensus.cc:2272] T 596e922d333c4540ba156d83e5513375 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.564409  7283 tablet_replica.cc:333] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.564988  7283 raft_consensus.cc:2243] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.565750  7283 raft_consensus.cc:2272] T 10699b1acff542b48fe24849b5154054 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.567683  7283 tablet_replica.cc:333] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.568222  7283 raft_consensus.cc:2243] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.568925  7283 raft_consensus.cc:2272] T cef1e9dd6c8847b787659ed9f87af311 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.571007  7283 tablet_replica.cc:333] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.571579  7283 raft_consensus.cc:2243] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.572036  7283 raft_consensus.cc:2272] T dc2f2d3b8a18442fa49b08cd6609ec92 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.574048  7283 tablet_replica.cc:333] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.574625  7283 raft_consensus.cc:2243] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.575433  7283 raft_consensus.cc:2272] T 00ad438e03a44b0fb583e38f7a535d84 P 406177939488436e998d9cc938163a91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.577291  7283 tablet_replica.cc:333] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.577914  7283 raft_consensus.cc:2243] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.578502  7283 raft_consensus.cc:2272] T bc54ca9c964a44a8ae7125556f8c691f P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.581470  7283 tablet_replica.cc:333] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.582201  7283 raft_consensus.cc:2243] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.583214  7283 raft_consensus.cc:2272] T b95cdbc4f9e14650ad38752ea1bf411d P 406177939488436e998d9cc938163a91 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:06.583557 16225 consensus_peers.cc:597] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 -> Peer e86ef4d3d63c483d975d4022f3093da0 (127.7.28.193:37577): Couldn't send request to peer e86ef4d3d63c483d975d4022f3093da0. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:37577: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.585464  7283 tablet_replica.cc:333] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.586146  7283 raft_consensus.cc:2243] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.586607  7283 raft_consensus.cc:2272] T e3031d485f54441888e8e6ef1a325929 P 406177939488436e998d9cc938163a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.588690  7283 tablet_replica.cc:333] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.589239  7283 raft_consensus.cc:2243] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.589695  7283 raft_consensus.cc:2272] T 396c2802a4c145e0897bf51d63bf8b73 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.591734  7283 tablet_replica.cc:333] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.592303  7283 raft_consensus.cc:2243] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.592746  7283 raft_consensus.cc:2272] T 35dba36e7f6148fbba14032657943e9d P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.594893  7283 tablet_replica.cc:333] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.595434  7283 raft_consensus.cc:2243] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.596210  7283 raft_consensus.cc:2272] T eb3ac40d0756433d9f4f4468575fc2fb P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.598155  7283 tablet_replica.cc:333] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.598642  7283 raft_consensus.cc:2243] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.599088  7283 raft_consensus.cc:2272] T b131207223334bb6adfad5b7db7a0bee P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.600872  7283 tablet_replica.cc:333] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91: stopping tablet replica
I20260709 13:05:06.601341  7283 raft_consensus.cc:2243] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.602164  7283 raft_consensus.cc:2272] T 822b4008c46a46f2b10fa35f37f29256 P 406177939488436e998d9cc938163a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.670570  7283 tablet_server.cc:196] TabletServer@127.7.28.195:0 shutdown complete.
I20260709 13:05:06.704298  7283 master.cc:562] Master@127.7.28.254:35923 shutting down...
I20260709 13:05:06.727288  7283 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.727893  7283 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.728246  7283 tablet_replica.cc:333] T 00000000000000000000000000000000 P f82d8fc081de4064a52ec325fcfebe82: stopping tablet replica
I20260709 13:05:06.749662  7283 master.cc:584] Master@127.7.28.254:35923 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12813 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:05:06.801772  7283 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.28.254:40649
I20260709 13:05:06.803084  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.808905 16576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.808965 16575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.810329 16578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.811777  7283 server_base.cc:1061] running on GCE node
I20260709 13:05:06.813078  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:06.813290  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.813515  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602306813498 us; error 0 us; skew 500 ppm
I20260709 13:05:06.814610  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.817349  7283 webserver.cc:533] Webserver started at http://127.7.28.254:38393/ using document root <none> and password file <none>
I20260709 13:05:06.817853  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.818028  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:06.818245  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:06.819310  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/master-0-root/instance:
uuid: "d4a57ababed846959d36c873a4e77034"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-ll1f"
I20260709 13:05:06.823912  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:05:06.827559 16583 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.828377  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:06.828720  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/master-0-root
uuid: "d4a57ababed846959d36c873a4e77034"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-ll1f"
I20260709 13:05:06.829017  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:06.862681  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:06.863916  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:06.903844  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.254:40649
I20260709 13:05:06.904002 16634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.254:40649 every 8 connection(s)
I20260709 13:05:06.907730 16635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.919174 16635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034: Bootstrap starting.
I20260709 13:05:06.924122 16635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.928555 16635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034: No bootstrap required, opened a new log
I20260709 13:05:06.930910 16635 raft_consensus.cc:359] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a57ababed846959d36c873a4e77034" member_type: VOTER }
I20260709 13:05:06.931378 16635 raft_consensus.cc:385] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.931563 16635 raft_consensus.cc:740] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4a57ababed846959d36c873a4e77034, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.932153 16635 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a57ababed846959d36c873a4e77034" member_type: VOTER }
I20260709 13:05:06.932751 16635 raft_consensus.cc:399] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:06.933000 16635 raft_consensus.cc:493] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:06.933218 16635 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.938052 16635 raft_consensus.cc:515] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a57ababed846959d36c873a4e77034" member_type: VOTER }
I20260709 13:05:06.938547 16635 leader_election.cc:304] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4a57ababed846959d36c873a4e77034; no voters: 
I20260709 13:05:06.939657 16635 leader_election.cc:290] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:06.940042 16638 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.941493 16638 raft_consensus.cc:697] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 1 LEADER]: Becoming Leader. State: Replica: d4a57ababed846959d36c873a4e77034, State: Running, Role: LEADER
I20260709 13:05:06.942205 16638 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a57ababed846959d36c873a4e77034" member_type: VOTER }
I20260709 13:05:06.942596 16635 sys_catalog.cc:565] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:06.946524 16639 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4a57ababed846959d36c873a4e77034" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a57ababed846959d36c873a4e77034" member_type: VOTER } }
I20260709 13:05:06.947238 16639 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:06.946579 16640 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4a57ababed846959d36c873a4e77034. Latest consensus state: current_term: 1 leader_uuid: "d4a57ababed846959d36c873a4e77034" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a57ababed846959d36c873a4e77034" member_type: VOTER } }
I20260709 13:05:06.948068 16640 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:06.950470 16645 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:06.959054 16645 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:06.961380  7283 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:06.969461 16645 catalog_manager.cc:1383] Generated new cluster ID: 3d6464e699534c8cba7cec0c5b2a4b93
I20260709 13:05:06.969841 16645 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:06.989887 16645 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:06.991286 16645 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:07.008235 16645 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034: Generated new TSK 0
I20260709 13:05:07.008925 16645 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:07.028189  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.035511 16656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.036375 16657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.039662 16659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.039906  7283 server_base.cc:1061] running on GCE node
I20260709 13:05:07.040968  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:07.041154  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.041276  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602307041264 us; error 0 us; skew 500 ppm
I20260709 13:05:07.041767  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.044365  7283 webserver.cc:533] Webserver started at http://127.7.28.193:38111/ using document root <none> and password file <none>
I20260709 13:05:07.044834  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.044996  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.045217  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.046437  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-0-root/instance:
uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-ll1f"
I20260709 13:05:07.051205  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:07.054821 16664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.055807  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:07.056092  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-0-root
uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-ll1f"
I20260709 13:05:07.056360  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.073058  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.074290  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.075735  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.078097  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.078277  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.078604  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.078763  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.121639  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.193:39551
I20260709 13:05:07.121773 16726 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.193:39551 every 8 connection(s)
I20260709 13:05:07.127031  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.134692 16731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.135103 16732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.144191 16734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.144388  7283 server_base.cc:1061] running on GCE node
I20260709 13:05:07.146128  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:07.146445  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.146656  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602307146638 us; error 0 us; skew 500 ppm
I20260709 13:05:07.146680 16727 heartbeater.cc:344] Connected to a master server at 127.7.28.254:40649
I20260709 13:05:07.147100 16727 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.147143  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.147891 16727 heartbeater.cc:507] Master 127.7.28.254:40649 requested a full tablet report, sending...
I20260709 13:05:07.150319  7283 webserver.cc:533] Webserver started at http://127.7.28.194:38617/ using document root <none> and password file <none>
I20260709 13:05:07.150380 16600 ts_manager.cc:194] Registered new tserver with Master: 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551)
I20260709 13:05:07.150938  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.151208  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.151471  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.152565  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-1-root/instance:
uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-ll1f"
I20260709 13:05:07.152689 16600 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59504
I20260709 13:05:07.158155  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:05:07.161695 16739 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.162748  7283 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:05:07.163184  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-1-root
uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-ll1f"
I20260709 13:05:07.163516  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.176831  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.178092  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.179641  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.181962  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.182147  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.182431  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.182608  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.224561  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.194:41969
I20260709 13:05:07.224680 16801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.194:41969 every 8 connection(s)
I20260709 13:05:07.229493  7283 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.236806 16805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.237565 16806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.240969  7283 server_base.cc:1061] running on GCE node
W20260709 13:05:07.241394 16808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.242627 16802 heartbeater.cc:344] Connected to a master server at 127.7.28.254:40649
I20260709 13:05:07.242656  7283 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:07.243131  7283 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.243175 16802 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.243332  7283 hybrid_clock.cc:648] HybridClock initialized: now 1783602307243315 us; error 0 us; skew 500 ppm
I20260709 13:05:07.244270  7283 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.244374 16802 heartbeater.cc:507] Master 127.7.28.254:40649 requested a full tablet report, sending...
I20260709 13:05:07.246833 16600 ts_manager.cc:194] Registered new tserver with Master: 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:07.247125  7283 webserver.cc:533] Webserver started at http://127.7.28.195:46527/ using document root <none> and password file <none>
I20260709 13:05:07.247671  7283 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.247835  7283 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.248075  7283 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.248529 16600 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59516
I20260709 13:05:07.249146  7283 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-2-root/instance:
uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-ll1f"
I20260709 13:05:07.254555  7283 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:07.258379 16813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.259478  7283 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:05:07.259829  7283 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-2-root
uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-ll1f"
I20260709 13:05:07.260146  7283 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2t72V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602049386691-7283-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.269765  7283 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.271070  7283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.272579  7283 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.275018  7283 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.275259  7283 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.275518  7283 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.275695  7283 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.318269  7283 rpc_server.cc:307] RPC server started. Bound to: 127.7.28.195:33787
I20260709 13:05:07.318481 16875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.28.195:33787 every 8 connection(s)
I20260709 13:05:07.333170 16876 heartbeater.cc:344] Connected to a master server at 127.7.28.254:40649
I20260709 13:05:07.333703 16876 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.334546 16876 heartbeater.cc:507] Master 127.7.28.254:40649 requested a full tablet report, sending...
I20260709 13:05:07.336549 16600 ts_manager.cc:194] Registered new tserver with Master: 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:07.336871  7283 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015327745s
I20260709 13:05:07.338493 16600 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59528
I20260709 13:05:07.364455 16600 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59540:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:07.367383 16600 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:07.436897 16840 tablet_service.cc:1511] Processing CreateTablet for tablet c0c5136b5a8d4c2fa67159a4cafa1705 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.438407 16839 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6a9d0b7bec4a03a07930caa4b8737f (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.439640 16841 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4d7ac2370b4187b67d93f795b9603c (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.438467 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c5136b5a8d4c2fa67159a4cafa1705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.441636 16839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6a9d0b7bec4a03a07930caa4b8737f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.442447 16692 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4d7ac2370b4187b67d93f795b9603c (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.443871 16692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4d7ac2370b4187b67d93f795b9603c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.445026 16841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4d7ac2370b4187b67d93f795b9603c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.446900 16691 tablet_service.cc:1511] Processing CreateTablet for tablet c0c5136b5a8d4c2fa67159a4cafa1705 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.447531 16838 tablet_service.cc:1511] Processing CreateTablet for tablet 1da92e15ddbd435399bdd953d46cafe6 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.448374 16691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c5136b5a8d4c2fa67159a4cafa1705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.448956 16838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da92e15ddbd435399bdd953d46cafe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.451375 16690 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6a9d0b7bec4a03a07930caa4b8737f (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.452863 16690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6a9d0b7bec4a03a07930caa4b8737f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.456094 16689 tablet_service.cc:1511] Processing CreateTablet for tablet 1da92e15ddbd435399bdd953d46cafe6 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.457630 16689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da92e15ddbd435399bdd953d46cafe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.464730 16688 tablet_service.cc:1511] Processing CreateTablet for tablet 55a59fcc9437459a86a79efe5d24a14c (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.466216 16688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a59fcc9437459a86a79efe5d24a14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.467063 16891 tablet_bootstrap.cc:492] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.471506 16837 tablet_service.cc:1511] Processing CreateTablet for tablet 55a59fcc9437459a86a79efe5d24a14c (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.473034 16837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a59fcc9437459a86a79efe5d24a14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.474539 16891 tablet_bootstrap.cc:654] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.480369 16839 tablet_service.cc:1511] Processing CreateTablet for tablet a22c54f47c1749a09c836fcc71acef94 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.481284 16687 tablet_service.cc:1511] Processing CreateTablet for tablet a22c54f47c1749a09c836fcc71acef94 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.481998 16839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22c54f47c1749a09c836fcc71acef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.482779 16687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22c54f47c1749a09c836fcc71acef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.488315 16686 tablet_service.cc:1511] Processing CreateTablet for tablet d84cc3b4833e4e2fbddee0ca01fd4224 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.489929 16686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84cc3b4833e4e2fbddee0ca01fd4224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.496354 16685 tablet_service.cc:1511] Processing CreateTablet for tablet 9122434fa25e4ab18cb9cd44dc90352b (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.497931 16685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9122434fa25e4ab18cb9cd44dc90352b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.504873 16891 tablet_bootstrap.cc:492] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:07.505496 16891 ts_tablet_manager.cc:1403] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.004s
I20260709 13:05:07.506785 16840 tablet_service.cc:1511] Processing CreateTablet for tablet d84cc3b4833e4e2fbddee0ca01fd4224 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.508247 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84cc3b4833e4e2fbddee0ca01fd4224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.508814 16891 raft_consensus.cc:359] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.509657 16891 raft_consensus.cc:385] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.511483 16891 raft_consensus.cc:740] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.518836 16839 tablet_service.cc:1511] Processing CreateTablet for tablet 9122434fa25e4ab18cb9cd44dc90352b (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.520259 16839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9122434fa25e4ab18cb9cd44dc90352b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.527449 16891 consensus_queue.cc:260] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.531279 16684 tablet_service.cc:1511] Processing CreateTablet for tablet c94f96ebc5c149beb9d070eb0f299780 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.535422 16841 tablet_service.cc:1511] Processing CreateTablet for tablet c94f96ebc5c149beb9d070eb0f299780 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.537256 16841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94f96ebc5c149beb9d070eb0f299780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.533057 16684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94f96ebc5c149beb9d070eb0f299780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.546967 16766 tablet_service.cc:1511] Processing CreateTablet for tablet c0c5136b5a8d4c2fa67159a4cafa1705 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.548516 16766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c5136b5a8d4c2fa67159a4cafa1705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.550902 16765 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6a9d0b7bec4a03a07930caa4b8737f (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.552330 16765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6a9d0b7bec4a03a07930caa4b8737f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.555022 16764 tablet_service.cc:1511] Processing CreateTablet for tablet 1da92e15ddbd435399bdd953d46cafe6 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.556438 16764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da92e15ddbd435399bdd953d46cafe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.559020 16763 tablet_service.cc:1511] Processing CreateTablet for tablet 55a59fcc9437459a86a79efe5d24a14c (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.560456 16763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a59fcc9437459a86a79efe5d24a14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.545480 16767 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4d7ac2370b4187b67d93f795b9603c (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.562927 16767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4d7ac2370b4187b67d93f795b9603c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.564308 16761 tablet_service.cc:1511] Processing CreateTablet for tablet d84cc3b4833e4e2fbddee0ca01fd4224 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.574829 16762 tablet_service.cc:1511] Processing CreateTablet for tablet a22c54f47c1749a09c836fcc71acef94 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.568037 16760 tablet_service.cc:1511] Processing CreateTablet for tablet 9122434fa25e4ab18cb9cd44dc90352b (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.567010 16759 tablet_service.cc:1511] Processing CreateTablet for tablet c94f96ebc5c149beb9d070eb0f299780 (DEFAULT_TABLE table=test-workload [id=638b7cc9defc45d580bdcaa721acdc85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.565765 16761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84cc3b4833e4e2fbddee0ca01fd4224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.578219 16760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9122434fa25e4ab18cb9cd44dc90352b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.578895 16759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94f96ebc5c149beb9d070eb0f299780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.579986 16762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22c54f47c1749a09c836fcc71acef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.609086 16876 heartbeater.cc:499] Master 127.7.28.254:40649 was elected leader, sending a full tablet report...
I20260709 13:05:07.616801 16891 ts_tablet_manager.cc:1434] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.111s	user 0.025s	sys 0.032s
I20260709 13:05:07.618110 16891 tablet_bootstrap.cc:492] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.622345 16893 tablet_bootstrap.cc:492] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:07.652661 16893 tablet_bootstrap.cc:654] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.670845 16895 tablet_bootstrap.cc:492] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:07.693915 16891 tablet_bootstrap.cc:654] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.699788 16895 tablet_bootstrap.cc:654] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.715974 16891 tablet_bootstrap.cc:492] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:07.703886 16893 tablet_bootstrap.cc:492] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:07.716630 16891 ts_tablet_manager.cc:1403] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.020s
I20260709 13:05:07.716938 16893 ts_tablet_manager.cc:1403] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.004s
I20260709 13:05:07.720403 16895 tablet_bootstrap.cc:492] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:07.719923 16891 raft_consensus.cc:359] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:07.720075 16893 raft_consensus.cc:359] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.720919 16891 raft_consensus.cc:385] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.720964 16895 ts_tablet_manager.cc:1403] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.005s
I20260709 13:05:07.720959 16893 raft_consensus.cc:385] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.721422 16891 raft_consensus.cc:740] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.721740 16893 raft_consensus.cc:740] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.722362 16891 consensus_queue.cc:260] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:07.722692 16893 consensus_queue.cc:260] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.724318 16895 raft_consensus.cc:359] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.724993 16891 ts_tablet_manager.cc:1434] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:07.725121 16895 raft_consensus.cc:385] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.725680 16895 raft_consensus.cc:740] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.726707 16891 tablet_bootstrap.cc:492] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.726472 16895 consensus_queue.cc:260] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.732345 16893 ts_tablet_manager.cc:1434] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:05:07.733173 16727 heartbeater.cc:499] Master 127.7.28.254:40649 was elected leader, sending a full tablet report...
I20260709 13:05:07.734925 16891 tablet_bootstrap.cc:654] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.750967 16893 tablet_bootstrap.cc:492] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:07.751487 16802 heartbeater.cc:499] Master 127.7.28.254:40649 was elected leader, sending a full tablet report...
I20260709 13:05:07.752032 16895 ts_tablet_manager.cc:1434] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.030s	user 0.014s	sys 0.015s
I20260709 13:05:07.753073 16895 tablet_bootstrap.cc:492] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:07.759706 16891 tablet_bootstrap.cc:492] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:07.759832 16895 tablet_bootstrap.cc:654] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.760443 16891 ts_tablet_manager.cc:1403] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.013s
I20260709 13:05:07.763645 16891 raft_consensus.cc:359] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.764514 16891 raft_consensus.cc:385] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.764802 16891 raft_consensus.cc:740] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.765900 16891 consensus_queue.cc:260] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.766423 16893 tablet_bootstrap.cc:654] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.771296 16891 ts_tablet_manager.cc:1434] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:07.772541 16891 tablet_bootstrap.cc:492] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.776942 16895 tablet_bootstrap.cc:492] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:07.777769 16895 ts_tablet_manager.cc:1403] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 13:05:07.778672 16891 tablet_bootstrap.cc:654] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.781836 16895 raft_consensus.cc:359] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:07.783028 16895 raft_consensus.cc:385] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.783439 16895 raft_consensus.cc:740] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.784686 16895 consensus_queue.cc:260] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:07.788232 16895 ts_tablet_manager.cc:1434] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:07.789640 16895 tablet_bootstrap.cc:492] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:07.790565 16891 tablet_bootstrap.cc:492] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:07.791198 16891 ts_tablet_manager.cc:1403] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:05:07.794194 16891 raft_consensus.cc:359] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.794958 16891 raft_consensus.cc:385] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.795243 16891 raft_consensus.cc:740] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.796258 16891 consensus_queue.cc:260] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.798731 16895 tablet_bootstrap.cc:654] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.800766 16891 ts_tablet_manager.cc:1434] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:07.801941 16891 tablet_bootstrap.cc:492] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.808066 16891 tablet_bootstrap.cc:654] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.819694 16891 tablet_bootstrap.cc:492] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:07.820258 16891 ts_tablet_manager.cc:1403] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:05:07.823227 16891 raft_consensus.cc:359] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.823969 16891 raft_consensus.cc:385] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.824277 16891 raft_consensus.cc:740] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
W20260709 13:05:07.824869 16877 tablet.cc:2406] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:07.825207 16891 consensus_queue.cc:260] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.830519 16891 ts_tablet_manager.cc:1434] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:05:07.831915 16891 tablet_bootstrap.cc:492] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.832958 16893 tablet_bootstrap.cc:492] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:07.833606 16893 ts_tablet_manager.cc:1403] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.083s	user 0.033s	sys 0.040s
I20260709 13:05:07.833861 16895 tablet_bootstrap.cc:492] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:07.834472 16895 ts_tablet_manager.cc:1403] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.023s
I20260709 13:05:07.837401 16895 raft_consensus.cc:359] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.838210 16895 raft_consensus.cc:385] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.838455 16891 tablet_bootstrap.cc:654] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.838557 16895 raft_consensus.cc:740] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.839105 16893 raft_consensus.cc:359] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.839999 16893 raft_consensus.cc:385] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.839675 16895 consensus_queue.cc:260] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.840397 16893 raft_consensus.cc:740] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.841374 16893 consensus_queue.cc:260] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.846912 16893 ts_tablet_manager.cc:1434] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:07.847958 16893 tablet_bootstrap.cc:492] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:07.848050 16895 ts_tablet_manager.cc:1434] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:05:07.848670 16891 tablet_bootstrap.cc:492] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:07.849218 16891 ts_tablet_manager.cc:1403] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 13:05:07.849251 16895 tablet_bootstrap.cc:492] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:07.852519 16891 raft_consensus.cc:359] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.853411 16891 raft_consensus.cc:385] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.853736 16891 raft_consensus.cc:740] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.854100 16894 raft_consensus.cc:493] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.854676 16894 raft_consensus.cc:515] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.854723 16891 consensus_queue.cc:260] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.866457 16895 tablet_bootstrap.cc:654] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.870692 16891 ts_tablet_manager.cc:1434] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.016s
I20260709 13:05:07.871824 16891 tablet_bootstrap.cc:492] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.862174 16894 leader_election.cc:290] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:07.876147 16893 tablet_bootstrap.cc:654] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.887279 16894 raft_consensus.cc:493] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.887465 16891 tablet_bootstrap.cc:654] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.888913 16894 raft_consensus.cc:515] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.895435 16893 tablet_bootstrap.cc:492] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:07.895951 16893 ts_tablet_manager.cc:1403] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 13:05:07.897886 16891 tablet_bootstrap.cc:492] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:07.898451 16891 ts_tablet_manager.cc:1403] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 13:05:07.899233 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6a9d0b7bec4a03a07930caa4b8737f" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:07.900015 16702 raft_consensus.cc:2468] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:07.900159 16894 leader_election.cc:290] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:07.900216 16895 tablet_bootstrap.cc:492] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:07.901044 16895 ts_tablet_manager.cc:1403] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.014s
I20260709 13:05:07.901530 16816 leader_election.cc:304] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:07.902092 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:07.902177 16891 raft_consensus.cc:359] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.902619 16894 raft_consensus.cc:2804] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.903097 16891 raft_consensus.cc:385] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.903237 16894 raft_consensus.cc:493] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.903478 16891 raft_consensus.cc:740] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.903786 16894 raft_consensus.cc:3060] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:07.904150 16816 leader_election.cc:343] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.904300 16895 raft_consensus.cc:359] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.904367 16891 consensus_queue.cc:260] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.905221 16895 raft_consensus.cc:385] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.908077 16891 ts_tablet_manager.cc:1434] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:05:07.905380 16893 raft_consensus.cc:359] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.908991 16893 raft_consensus.cc:385] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.909338 16893 raft_consensus.cc:740] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.909471 16891 tablet_bootstrap.cc:492] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.910306 16893 consensus_queue.cc:260] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.912731 16893 ts_tablet_manager.cc:1434] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:05:07.913914 16893 tablet_bootstrap.cc:492] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:07.913451 16894 raft_consensus.cc:515] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.917090 16891 tablet_bootstrap.cc:654] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.922070 16776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:07.922091 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6a9d0b7bec4a03a07930caa4b8737f" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:07.924288 16894 leader_election.cc:290] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:07.925151 16815 leader_election.cc:343] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.905638 16895 raft_consensus.cc:740] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.925701 16815 leader_election.cc:304] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:07.927026 16894 raft_consensus.cc:2749] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:07.927454 16815 leader_election.cc:343] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.926967 16895 consensus_queue.cc:260] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.925187 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6a9d0b7bec4a03a07930caa4b8737f" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:07.929538 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6a9d0b7bec4a03a07930caa4b8737f" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
W20260709 13:05:07.931022 16815 leader_election.cc:343] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.931565 16702 raft_consensus.cc:3060] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.934376 16895 ts_tablet_manager.cc:1434] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 13:05:07.935998 16895 tablet_bootstrap.cc:492] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:07.939859 16702 raft_consensus.cc:2468] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:07.941334 16816 leader_election.cc:304] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:07.944816 16894 raft_consensus.cc:2804] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:07.945515 16894 raft_consensus.cc:697] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:07.946523 16894 consensus_queue.cc:237] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.948503 16893 tablet_bootstrap.cc:654] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.949178 16895 tablet_bootstrap.cc:654] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.954921 16891 tablet_bootstrap.cc:492] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:07.955396 16899 raft_consensus.cc:493] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.955595 16891 ts_tablet_manager.cc:1403] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.030s
I20260709 13:05:07.956121 16899 raft_consensus.cc:515] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.959424 16900 raft_consensus.cc:493] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:07.959619 16648 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:07.960021 16900 raft_consensus.cc:515] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.961462 16891 raft_consensus.cc:359] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.962252 16891 raft_consensus.cc:385] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.962538 16891 raft_consensus.cc:740] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.963413 16891 consensus_queue.cc:260] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.965140 16899 leader_election.cc:290] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:07.966035 16891 ts_tablet_manager.cc:1434] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:05:07.966650 16900 leader_election.cc:290] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:07.967239 16891 tablet_bootstrap.cc:492] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:07.977051 16891 tablet_bootstrap.cc:654] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.991037 16895 tablet_bootstrap.cc:492] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:07.991647 16895 ts_tablet_manager.cc:1403] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.011s
I20260709 13:05:07.991226 16599 catalog_manager.cc:5697] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 1 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.994705 16893 tablet_bootstrap.cc:492] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:07.995473 16893 ts_tablet_manager.cc:1403] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.010s
I20260709 13:05:07.996387 16895 raft_consensus.cc:359] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.997202 16895 raft_consensus.cc:385] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.997519 16895 raft_consensus.cc:740] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.998427 16893 raft_consensus.cc:359] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:07.998554 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:07.999322 16893 raft_consensus.cc:385] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.999706 16893 raft_consensus.cc:740] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.000476 16893 consensus_queue.cc:260] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.003002 16893 ts_tablet_manager.cc:1434] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:05:08.001065 16666 leader_election.cc:343] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.004845 16893 tablet_bootstrap.cc:492] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:07.998703 16895 consensus_queue.cc:260] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.016321 16893 tablet_bootstrap.cc:654] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.022625 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.023770 16851 raft_consensus.cc:2468] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:08.025597 16743 leader_election.cc:304] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:08.027439 16891 tablet_bootstrap.cc:492] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:08.027379 16900 raft_consensus.cc:2804] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.027992 16900 raft_consensus.cc:493] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.028142 16891 ts_tablet_manager.cc:1403] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.003s
I20260709 13:05:08.028479 16900 raft_consensus.cc:3060] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.032969 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
W20260709 13:05:08.034602 16742 leader_election.cc:343] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.037699 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.039093 16851 raft_consensus.cc:2468] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 0.
I20260709 13:05:08.039552 16891 raft_consensus.cc:359] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.040390 16891 raft_consensus.cc:385] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.040707 16891 raft_consensus.cc:740] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.043121 16891 consensus_queue.cc:260] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.044406 16668 leader_election.cc:304] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:08.045279 16891 ts_tablet_manager.cc:1434] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:05:08.046139 16899 raft_consensus.cc:2804] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.046291 16900 raft_consensus.cc:515] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.046849 16899 raft_consensus.cc:493] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.047338 16899 raft_consensus.cc:3060] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.048974 16900 leader_election.cc:290] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.049192 16893 tablet_bootstrap.cc:492] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:08.049353 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:08.049764 16893 ts_tablet_manager.cc:1403] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.023s
I20260709 13:05:08.050619 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
W20260709 13:05:08.050870 16742 leader_election.cc:343] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.051250 16851 raft_consensus.cc:3060] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.044304 16895 ts_tablet_manager.cc:1434] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.052s	user 0.003s	sys 0.007s
I20260709 13:05:08.054304 16893 raft_consensus.cc:359] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.055167 16893 raft_consensus.cc:385] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.055457 16893 raft_consensus.cc:740] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.056600 16895 tablet_bootstrap.cc:492] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:08.056370 16893 consensus_queue.cc:260] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.060608 16894 raft_consensus.cc:493] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.061228 16894 raft_consensus.cc:515] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:08.063822 16894 leader_election.cc:290] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:08.064182 16895 tablet_bootstrap.cc:654] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.065092 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.065419 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:08.065834 16777 raft_consensus.cc:2468] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
W20260709 13:05:08.066938 16816 leader_election.cc:343] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.067485 16815 leader_election.cc:304] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:08.067569 16899 raft_consensus.cc:515] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.068670 16894 raft_consensus.cc:2804] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.069058 16894 raft_consensus.cc:493] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.069410 16894 raft_consensus.cc:3060] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.070581 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:08.071317 16893 ts_tablet_manager.cc:1434] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.002s
W20260709 13:05:08.072104 16666 leader_election.cc:343] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.074337 16893 tablet_bootstrap.cc:492] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:08.075591 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:08.076264 16850 raft_consensus.cc:3060] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.077057 16894 raft_consensus.cc:515] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:08.080605 16908 raft_consensus.cc:493] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.081248 16893 tablet_bootstrap.cc:654] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.081138 16908 raft_consensus.cc:515] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.083230 16908 leader_election.cc:290] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:08.084923 16776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.085069 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:08.086316 16777 raft_consensus.cc:3060] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:08.086447 16815 leader_election.cc:343] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.087107 16894 leader_election.cc:290] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:08.090790 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:08.091459 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
W20260709 13:05:08.092260 16816 leader_election.cc:343] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.091398 16895 tablet_bootstrap.cc:492] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
W20260709 13:05:08.093379 16816 leader_election.cc:343] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.093524 16895 ts_tablet_manager.cc:1403] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.013s
I20260709 13:05:08.093823 16816 leader_election.cc:304] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:08.096369 16851 raft_consensus.cc:2468] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 1.
I20260709 13:05:08.098683 16894 raft_consensus.cc:2749] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.098450 16895 raft_consensus.cc:359] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.099757 16895 raft_consensus.cc:385] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.100252 16895 raft_consensus.cc:740] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.101533 16895 consensus_queue.cc:260] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.103091 16777 raft_consensus.cc:2468] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:08.104523 16815 leader_election.cc:304] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:08.105702 16894 raft_consensus.cc:2804] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.105839 16899 leader_election.cc:290] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.106727 16894 raft_consensus.cc:697] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:08.107227 16743 leader_election.cc:304] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:08.107681 16894 consensus_queue.cc:237] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:08.108507 16900 raft_consensus.cc:2804] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.108641 16895 ts_tablet_manager.cc:1434] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:05:08.110376 16895 tablet_bootstrap.cc:492] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:08.111296 16908 raft_consensus.cc:493] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.111855 16908 raft_consensus.cc:515] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.115027 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:08.115626 16908 leader_election.cc:290] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:08.117062 16776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.118134 16776 raft_consensus.cc:2468] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:08.119498 16815 leader_election.cc:304] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:08.119917 16850 raft_consensus.cc:2468] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 1.
I20260709 13:05:08.119971 16895 tablet_bootstrap.cc:654] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:08.120958 16816 leader_election.cc:343] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.120850 16908 raft_consensus.cc:2804] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.122327 16908 raft_consensus.cc:493] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.122839 16908 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.124903 16668 leader_election.cc:304] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:08.125813 16927 raft_consensus.cc:493] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.126323 16927 raft_consensus.cc:515] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.128620 16927 leader_election.cc:290] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.129141 16927 raft_consensus.cc:2804] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.129544 16927 raft_consensus.cc:697] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:08.134496 16927 consensus_queue.cc:237] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.140415 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da92e15ddbd435399bdd953d46cafe6" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.140879 16849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da92e15ddbd435399bdd953d46cafe6" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.141932 16849 raft_consensus.cc:2468] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 0.
I20260709 13:05:08.143693 16908 raft_consensus.cc:515] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.144888 16668 leader_election.cc:304] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:08.147266 16776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:08.145238 16599 catalog_manager.cc:5697] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 1 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.147939 16776 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.141220 16777 raft_consensus.cc:2468] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 0.
I20260709 13:05:08.151674 16899 raft_consensus.cc:2804] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.152151 16899 raft_consensus.cc:493] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.152503 16899 raft_consensus.cc:3060] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.156900 16908 leader_election.cc:290] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:08.160753 16776 raft_consensus.cc:2468] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:08.162287 16815 leader_election.cc:304] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:08.164232 16908 raft_consensus.cc:2804] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.166116 16908 raft_consensus.cc:697] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:08.167306 16908 consensus_queue.cc:237] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.180158 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:08.180830 16895 tablet_bootstrap.cc:492] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:08.181576 16900 raft_consensus.cc:697] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
W20260709 13:05:08.181607 16816 leader_election.cc:343] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.181994 16599 catalog_manager.cc:5697] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.182729 16900 consensus_queue.cc:237] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.183939 16899 raft_consensus.cc:515] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.187672 16894 raft_consensus.cc:493] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.188251 16894 raft_consensus.cc:515] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.189534 16893 tablet_bootstrap.cc:492] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:08.190167 16893 ts_tablet_manager.cc:1403] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.116s	user 0.035s	sys 0.064s
I20260709 13:05:08.190485 16894 leader_election.cc:290] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:08.190860 16776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da92e15ddbd435399bdd953d46cafe6" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:08.191780 16776 raft_consensus.cc:3060] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.193811 16893 raft_consensus.cc:359] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:08.194336 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9122434fa25e4ab18cb9cd44dc90352b" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.195329 16777 raft_consensus.cc:2468] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:08.196599 16899 leader_election.cc:290] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.194940 16893 raft_consensus.cc:385] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.197463 16893 raft_consensus.cc:740] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.197154 16815 leader_election.cc:304] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:08.198846 16893 consensus_queue.cc:260] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:08.199918 16894 raft_consensus.cc:2804] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.200322 16894 raft_consensus.cc:493] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.200666 16894 raft_consensus.cc:3060] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.202639 16893 ts_tablet_manager.cc:1434] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.005s
I20260709 13:05:08.204134 16893 tablet_bootstrap.cc:492] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:08.207091 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9122434fa25e4ab18cb9cd44dc90352b" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:08.207767 16701 raft_consensus.cc:2468] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:08.207093 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da92e15ddbd435399bdd953d46cafe6" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:08.209168 16851 raft_consensus.cc:3060] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.212620 16894 raft_consensus.cc:515] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.213143 16893 tablet_bootstrap.cc:654] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.216060 16895 ts_tablet_manager.cc:1403] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.106s	user 0.026s	sys 0.015s
I20260709 13:05:08.222230 16895 raft_consensus.cc:359] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.224699 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9122434fa25e4ab18cb9cd44dc90352b" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:08.226634 16895 raft_consensus.cc:385] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.226779 16701 raft_consensus.cc:3060] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.227002 16895 raft_consensus.cc:740] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.228118 16776 raft_consensus.cc:2468] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 1.
I20260709 13:05:08.229389 16666 leader_election.cc:304] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:08.225603 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9122434fa25e4ab18cb9cd44dc90352b" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:08.230159 16777 raft_consensus.cc:3060] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.230309 16899 raft_consensus.cc:2804] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.230880 16899 raft_consensus.cc:697] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:08.231712 16899 consensus_queue.cc:237] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.226135 16894 leader_election.cc:290] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:08.242688 16851 raft_consensus.cc:2468] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 1.
I20260709 13:05:08.240550 16895 consensus_queue.cc:260] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.245489 16777 raft_consensus.cc:2468] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:08.252432 16701 raft_consensus.cc:2468] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:08.252436 16599 catalog_manager.cc:5697] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 1 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.254614 16895 ts_tablet_manager.cc:1434] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:05:08.255311 16816 leader_election.cc:304] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:08.255944 16895 tablet_bootstrap.cc:492] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:08.256523 16908 raft_consensus.cc:2804] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.257028 16908 raft_consensus.cc:697] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:08.257892 16908 consensus_queue.cc:237] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.263303 16895 tablet_bootstrap.cc:654] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.274259 16893 tablet_bootstrap.cc:492] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:08.274879 16893 ts_tablet_manager.cc:1403] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.022s
I20260709 13:05:08.276597 16600 catalog_manager.cc:5697] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.279279 16893 raft_consensus.cc:359] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.280231 16893 raft_consensus.cc:385] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.280639 16893 raft_consensus.cc:740] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.273520 16598 catalog_manager.cc:5697] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.283771 16895 tablet_bootstrap.cc:492] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:08.281597 16893 consensus_queue.cc:260] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.284524 16895 ts_tablet_manager.cc:1403] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.003s
I20260709 13:05:08.286309 16893 ts_tablet_manager.cc:1434] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:08.287379 16893 tablet_bootstrap.cc:492] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:08.287379 16895 raft_consensus.cc:359] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.288303 16895 raft_consensus.cc:385] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.288646 16895 raft_consensus.cc:740] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.288880 16599 catalog_manager.cc:5697] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 1 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.289499 16895 consensus_queue.cc:260] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.292100 16895 ts_tablet_manager.cc:1434] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:08.293116 16895 tablet_bootstrap.cc:492] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:08.294382 16893 tablet_bootstrap.cc:654] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.299000 16895 tablet_bootstrap.cc:654] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.303678 16893 tablet_bootstrap.cc:492] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:08.304220 16893 ts_tablet_manager.cc:1403] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:05:08.306761 16893 raft_consensus.cc:359] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.307533 16893 raft_consensus.cc:385] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.307821 16893 raft_consensus.cc:740] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.308506 16893 consensus_queue.cc:260] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.309335 16895 tablet_bootstrap.cc:492] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:08.309943 16895 ts_tablet_manager.cc:1403] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.006s
I20260709 13:05:08.310465 16893 ts_tablet_manager.cc:1434] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:08.311601 16893 tablet_bootstrap.cc:492] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:08.312949 16895 raft_consensus.cc:359] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.313737 16895 raft_consensus.cc:385] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.314059 16895 raft_consensus.cc:740] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.314780 16895 consensus_queue.cc:260] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.316708 16895 ts_tablet_manager.cc:1434] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:08.317397 16893 tablet_bootstrap.cc:654] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.322177 16893 tablet_bootstrap.cc:492] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:08.322679 16893 ts_tablet_manager.cc:1403] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:05:08.322853 16899 raft_consensus.cc:493] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.323402 16899 raft_consensus.cc:515] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:08.325510 16899 leader_election.cc:290] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:08.326143 16893 raft_consensus.cc:359] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.326920 16893 raft_consensus.cc:385] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.326819 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.327329 16893 raft_consensus.cc:740] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.328052 16893 consensus_queue.cc:260] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.328306 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.329245 16777 raft_consensus.cc:2393] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in current term 1: Already voted for candidate 3a25c0c95ca84b3d825ca1b83606ebea in this term.
I20260709 13:05:08.330221 16893 ts_tablet_manager.cc:1434] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:08.331094 16668 leader_election.cc:304] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea
I20260709 13:05:08.331904 16899 raft_consensus.cc:3060] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.338867 16899 raft_consensus.cc:2749] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.370471 16899 raft_consensus.cc:493] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.371045 16899 raft_consensus.cc:515] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.373100 16899 leader_election.cc:290] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.374015 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.374284 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.374822 16777 raft_consensus.cc:2468] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 0.
I20260709 13:05:08.374900 16851 raft_consensus.cc:2468] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 0.
I20260709 13:05:08.376026 16668 leader_election.cc:304] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:08.376778 16899 raft_consensus.cc:2804] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.377230 16899 raft_consensus.cc:493] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.377516 16899 raft_consensus.cc:3060] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.382586 16900 raft_consensus.cc:493] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.382987 16899 raft_consensus.cc:515] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.383186 16900 raft_consensus.cc:515] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.385174 16900 leader_election.cc:290] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.385174 16899 leader_election.cc:290] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.386442 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.386653 16777 raft_consensus.cc:3060] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.387359 16851 raft_consensus.cc:2393] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02e5f1c7a2c04e36a0474d09cab07d6f in current term 1: Already voted for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in this term.
I20260709 13:05:08.387184 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:08.387471 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:08.387811 16850 raft_consensus.cc:3060] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.389293 16743 leader_election.cc:304] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f; no voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:08.390147 16900 raft_consensus.cc:3060] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.390537 16776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:08.391235 16776 raft_consensus.cc:3060] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.396135 16850 raft_consensus.cc:2468] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 1.
I20260709 13:05:08.397038 16908 consensus_queue.cc:1048] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.398087 16668 leader_election.cc:304] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:08.398743 16900 raft_consensus.cc:2749] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.398950 16899 raft_consensus.cc:2804] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.398758 16776 raft_consensus.cc:2468] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 1.
I20260709 13:05:08.399549 16899 raft_consensus.cc:697] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:08.401504 16899 consensus_queue.cc:237] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.407343 16900 raft_consensus.cc:493] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.408030 16900 raft_consensus.cc:515] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.412420 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.413440 16850 raft_consensus.cc:2468] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:08.415112 16743 leader_election.cc:304] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:08.415218 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:08.415125 16899 raft_consensus.cc:493] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.416188 16931 raft_consensus.cc:2804] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.417140 16931 raft_consensus.cc:493] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.415937 16701 raft_consensus.cc:2468] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:08.417712 16931 raft_consensus.cc:3060] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.419164 16908 consensus_queue.cc:1048] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.411082 16598 catalog_manager.cc:5697] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.415247 16900 leader_election.cc:290] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.416951 16899 raft_consensus.cc:515] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.435214 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.436151 16777 raft_consensus.cc:2393] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in current term 1: Already voted for candidate 3a25c0c95ca84b3d825ca1b83606ebea in this term.
I20260709 13:05:08.436584 16899 leader_election.cc:290] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.440624 16931 raft_consensus.cc:515] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.442358 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.443511 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:08.443907 16668 leader_election.cc:304] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea
I20260709 13:05:08.444391 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:08.444808 16899 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.445098 16850 raft_consensus.cc:3060] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.445971 16931 leader_election.cc:290] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.444242 16701 raft_consensus.cc:3060] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.451253 16850 raft_consensus.cc:2468] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 1.
I20260709 13:05:08.452540 16743 leader_election.cc:304] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:08.453704 16931 raft_consensus.cc:2804] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.455094 16931 raft_consensus.cc:697] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:08.455112 16701 raft_consensus.cc:2468] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 1.
I20260709 13:05:08.456239 16899 raft_consensus.cc:2749] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.456156 16931 consensus_queue.cc:237] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.463750 16599 catalog_manager.cc:5697] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.564558 16908 consensus_queue.cc:1048] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.577327 16949 consensus_queue.cc:1048] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.637223 16850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
mode: GRACEFUL
new_leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:05:08.639582 16850 raft_consensus.cc:606] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Received request to transfer leadership to TS 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:08.660305 16931 consensus_queue.cc:1048] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.667299 16899 consensus_queue.cc:1048] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.673941 16777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
mode: GRACEFUL
new_leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:46622
I20260709 13:05:08.675046 16777 raft_consensus.cc:606] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Received request to transfer leadership to TS 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:08.685685 16701 raft_consensus.cc:3060] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.702140 16850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e6a9d0b7bec4a03a07930caa4b8737f"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
mode: GRACEFUL
new_leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:05:08.703084 16850 raft_consensus.cc:606] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Received request to transfer leadership to TS 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:08.701478 16949 consensus_queue.cc:1048] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:08.710460 16949 consensus_queue.cc:1048] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.715798 16931 consensus_queue.cc:1048] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.716090 16935 consensus_queue.cc:1048] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.717140 16899 raft_consensus.cc:493] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.717708 16899 raft_consensus.cc:515] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.731148 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:08.735286 16899 leader_election.cc:290] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.740155 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:08.756206 16668 leader_election.cc:304] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea
I20260709 13:05:08.751205 16899 consensus_queue.cc:1048] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.752375 16951 consensus_queue.cc:1048] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.762442 16951 consensus_queue.cc:1048] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.763880 16899 raft_consensus.cc:2749] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:08.782799 16899 consensus_queue.cc:1048] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.803758 16702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
mode: GRACEFUL
new_leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:42206
I20260709 13:05:08.804513 16702 raft_consensus.cc:606] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Received request to transfer leadership to TS 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:08.814857 16702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
mode: GRACEFUL
new_leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:42206
I20260709 13:05:08.815611 16702 raft_consensus.cc:606] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Received request to transfer leadership to TS 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:08.824784 16850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
mode: GRACEFUL
new_leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:05:08.825507 16850 raft_consensus.cc:606] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Received request to transfer leadership to TS 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:08.834075 16850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9122434fa25e4ab18cb9cd44dc90352b"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
mode: GRACEFUL
new_leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:05:08.835206 16850 raft_consensus.cc:606] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Received request to transfer leadership to TS 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:08.842861 16775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
mode: GRACEFUL
new_leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
 from {username='slave'} at 127.0.0.1:46622
I20260709 13:05:08.843668 16775 raft_consensus.cc:606] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Received request to transfer leadership to TS 3a25c0c95ca84b3d825ca1b83606ebea
I20260709 13:05:08.861097 16931 consensus_queue.cc:1048] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.876237 16974 consensus_queue.cc:1048] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.885376 16931 raft_consensus.cc:993] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f: : Instructing follower 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:08.885953 16974 raft_consensus.cc:1081] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Signalling peer 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:08.888018 16702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:42200
I20260709 13:05:08.888631 16702 raft_consensus.cc:493] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.888935 16702 raft_consensus.cc:3060] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.896185 16702 raft_consensus.cc:515] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.898079 16702 leader_election.cc:290] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:08.899120 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:08.899246 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c5136b5a8d4c2fa67159a4cafa1705" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:08.899760 16775 raft_consensus.cc:3055] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.899966 16850 raft_consensus.cc:3060] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.900168 16775 raft_consensus.cc:740] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:08.901369 16775 consensus_queue.cc:260] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.902878 16775 raft_consensus.cc:3060] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.907331 16850 raft_consensus.cc:2468] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:08.908679 16668 leader_election.cc:304] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:08.909569 16899 raft_consensus.cc:2804] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.910079 16899 raft_consensus.cc:697] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:08.910852 16775 raft_consensus.cc:2468] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:08.911239 16899 consensus_queue.cc:237] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:08.917884 16599 catalog_manager.cc:5697] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 1 to 2, leader changed from 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194) to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.967648 16899 consensus_queue.cc:1048] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.976099 16935 raft_consensus.cc:993] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9: : Instructing follower 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:08.976711 16963 raft_consensus.cc:1081] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Signalling peer 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:08.979008 16774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:46612
I20260709 13:05:08.984810 16774 raft_consensus.cc:493] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.985301 16774 raft_consensus.cc:3060] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.985567 16963 consensus_queue.cc:1048] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.994608 16774 raft_consensus.cc:515] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.000027 16774 leader_election.cc:290] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:09.000511 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:09.001294 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22c54f47c1749a09c836fcc71acef94" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:09.001302 16702 raft_consensus.cc:3055] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.002027 16850 raft_consensus.cc:3060] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.002225 16702 raft_consensus.cc:740] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:09.004194 16908 raft_consensus.cc:993] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea: : Instructing follower 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:09.004768 16908 raft_consensus.cc:1081] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Signalling peer 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:09.003299 16702 consensus_queue.cc:260] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.006414 16702 raft_consensus.cc:3060] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.006811 16701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e6a9d0b7bec4a03a07930caa4b8737f"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:42194
I20260709 13:05:09.007488 16701 raft_consensus.cc:493] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.007863 16701 raft_consensus.cc:3060] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.010396 16850 raft_consensus.cc:2468] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:09.011813 16743 leader_election.cc:304] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:09.012768 16974 raft_consensus.cc:2804] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.013269 16974 raft_consensus.cc:697] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:09.014320 16974 consensus_queue.cc:237] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.014771 16702 raft_consensus.cc:2468] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:09.016769 16701 raft_consensus.cc:515] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.019934 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6a9d0b7bec4a03a07930caa4b8737f" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:09.020437 16774 raft_consensus.cc:3060] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.020853 16701 leader_election.cc:290] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:09.021478 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6a9d0b7bec4a03a07930caa4b8737f" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:09.022486 16850 raft_consensus.cc:3055] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.022807 16850 raft_consensus.cc:740] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:09.023593 16850 consensus_queue.cc:260] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.024699 16850 raft_consensus.cc:3060] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.023739 16599 catalog_manager.cc:5697] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 1 to 2, leader changed from 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193) to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.032045 16850 raft_consensus.cc:2468] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:09.032045 16774 raft_consensus.cc:2468] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:09.033432 16668 leader_election.cc:304] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:09.034183 16963 raft_consensus.cc:2804] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.034621 16963 raft_consensus.cc:697] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:09.035683 16963 consensus_queue.cc:237] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.042338 16599 catalog_manager.cc:5697] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 1 to 2, leader changed from 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195) to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.110297 16931 raft_consensus.cc:993] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f: : Instructing follower 3a25c0c95ca84b3d825ca1b83606ebea to start an election
I20260709 13:05:09.110859 16974 raft_consensus.cc:1081] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Signalling peer 3a25c0c95ca84b3d825ca1b83606ebea to start an election
I20260709 13:05:09.112635 16850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:05:09.113145 16850 raft_consensus.cc:493] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.113440 16850 raft_consensus.cc:3060] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.119091 16850 raft_consensus.cc:515] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.121189 16850 leader_election.cc:290] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:09.122495 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:09.122493 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94f96ebc5c149beb9d070eb0f299780" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:09.123442 16774 raft_consensus.cc:3055] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.123759 16701 raft_consensus.cc:3060] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.123842 16774 raft_consensus.cc:740] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:09.125087 16774 consensus_queue.cc:260] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.126525 16951 raft_consensus.cc:993] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea: : Instructing follower 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:09.126780 16774 raft_consensus.cc:3060] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.127125 16908 raft_consensus.cc:1081] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Signalling peer 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:09.129217 16702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:42194
I20260709 13:05:09.129843 16702 raft_consensus.cc:493] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.130240 16702 raft_consensus.cc:3060] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.131820 16701 raft_consensus.cc:2468] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 2.
I20260709 13:05:09.133023 16816 leader_election.cc:304] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:09.133841 16908 raft_consensus.cc:2804] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.134305 16908 raft_consensus.cc:697] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:09.135143 16774 raft_consensus.cc:2468] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 2.
I20260709 13:05:09.135288 16908 consensus_queue.cc:237] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.137989 16702 raft_consensus.cc:515] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:09.140105 16702 leader_election.cc:290] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Requested vote from peers 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:09.140970 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:09.141381 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d7ac2370b4187b67d93f795b9603c" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:09.141702 16850 raft_consensus.cc:3055] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.142122 16850 raft_consensus.cc:740] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:09.142184 16774 raft_consensus.cc:3060] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.143252 16850 consensus_queue.cc:260] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:09.143290 16599 catalog_manager.cc:5697] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 1 to 2, leader changed from 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194) to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 2 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.144577 16850 raft_consensus.cc:3060] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.149214 16774 raft_consensus.cc:2468] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:09.152104 16850 raft_consensus.cc:2468] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:09.153492 16666 leader_election.cc:304] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:09.154402 16963 raft_consensus.cc:2804] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.154946 16963 raft_consensus.cc:697] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:09.156116 16963 consensus_queue.cc:237] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:09.163632 16599 catalog_manager.cc:5697] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 1 to 2, leader changed from 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195) to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.213639 16935 raft_consensus.cc:993] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9: : Instructing follower 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:09.214205 16963 raft_consensus.cc:1081] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Signalling peer 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:09.215981 16774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:46612
I20260709 13:05:09.216562 16774 raft_consensus.cc:493] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.217002 16774 raft_consensus.cc:3060] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.222417 16774 raft_consensus.cc:515] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.224466 16774 leader_election.cc:290] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:09.225106 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:09.225601 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a59fcc9437459a86a79efe5d24a14c" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:09.225839 16702 raft_consensus.cc:3055] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.226351 16850 raft_consensus.cc:3060] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.226362 16702 raft_consensus.cc:740] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:09.227546 16702 consensus_queue.cc:260] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.228570 16702 raft_consensus.cc:3060] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.232381 16850 raft_consensus.cc:2468] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:09.234030 16743 leader_election.cc:304] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:09.234288 16702 raft_consensus.cc:2468] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:09.234790 16974 raft_consensus.cc:2804] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.235332 16974 raft_consensus.cc:697] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:09.236342 16974 consensus_queue.cc:237] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.242944 16599 catalog_manager.cc:5697] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 1 to 2, leader changed from 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193) to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.257611 16949 raft_consensus.cc:993] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea: : Instructing follower 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:09.258285 16908 raft_consensus.cc:1081] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Signalling peer 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:09.260002 16775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9122434fa25e4ab18cb9cd44dc90352b"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:46610
I20260709 13:05:09.260586 16775 raft_consensus.cc:493] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.261119 16775 raft_consensus.cc:3060] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.266945 16775 raft_consensus.cc:515] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.268694 16775 leader_election.cc:290] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:09.269773 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9122434fa25e4ab18cb9cd44dc90352b" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:09.269914 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9122434fa25e4ab18cb9cd44dc90352b" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:09.270465 16702 raft_consensus.cc:3060] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.270628 16850 raft_consensus.cc:3055] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.271049 16850 raft_consensus.cc:740] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:09.271831 16850 consensus_queue.cc:260] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.272837 16850 raft_consensus.cc:3060] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.276152 16702 raft_consensus.cc:2468] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:09.277839 16742 leader_election.cc:304] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:09.278451 16850 raft_consensus.cc:2468] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:09.278744 16974 raft_consensus.cc:2804] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.279290 16974 raft_consensus.cc:697] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:09.280308 16974 consensus_queue.cc:237] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.287336 16599 catalog_manager.cc:5697] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 1 to 2, leader changed from 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195) to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.317209 16949 raft_consensus.cc:993] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea: : Instructing follower 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:09.317674 16949 raft_consensus.cc:1081] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Signalling peer 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:09.319393 16775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:46610
I20260709 13:05:09.320077 16775 raft_consensus.cc:493] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.320423 16775 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.326169 16775 raft_consensus.cc:515] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.327931 16775 leader_election.cc:290] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:09.328995 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:09.329159 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:09.329643 16702 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.329877 16850 raft_consensus.cc:3055] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.330319 16850 raft_consensus.cc:740] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:09.331328 16850 consensus_queue.cc:260] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.332471 16850 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.335707 16702 raft_consensus.cc:2468] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:09.336966 16742 leader_election.cc:304] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:09.337925 16974 raft_consensus.cc:2804] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.338405 16974 raft_consensus.cc:697] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:09.338765 16850 raft_consensus.cc:2468] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:09.339366 16974 consensus_queue.cc:237] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:09.346639 16599 catalog_manager.cc:5697] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 1 to 2, leader changed from 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195) to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.444469 16775 raft_consensus.cc:1275] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.446159 16963 consensus_queue.cc:1048] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.456848 16850 raft_consensus.cc:1275] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.459533 16899 consensus_queue.cc:1048] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.475332 16775 raft_consensus.cc:1275] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.476684 16899 consensus_queue.cc:1048] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.485100 16850 raft_consensus.cc:1275] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.487650 16935 consensus_queue.cc:1048] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.566236 16850 raft_consensus.cc:1275] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.567477 16974 consensus_queue.cc:1048] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.577497 16702 raft_consensus.cc:1275] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.579087 16974 consensus_queue.cc:1048] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.661326 16702 raft_consensus.cc:1275] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 3a25c0c95ca84b3d825ca1b83606ebea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.662708 16949 consensus_queue.cc:1048] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.670873 16775 raft_consensus.cc:1275] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 3a25c0c95ca84b3d825ca1b83606ebea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.674028 16951 consensus_queue.cc:1048] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:09.713135 16775 raft_consensus.cc:1275] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.714555 16935 consensus_queue.cc:1048] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.724677 16850 raft_consensus.cc:1275] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.726650 16963 consensus_queue.cc:1048] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.786196 16850 raft_consensus.cc:1275] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.787645 16974 consensus_queue.cc:1048] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.797580 16702 raft_consensus.cc:1275] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.799288 16931 consensus_queue.cc:1048] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.813019 16702 raft_consensus.cc:1275] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.814546 16931 consensus_queue.cc:1048] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.824975 16850 raft_consensus.cc:1275] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.826682 16974 consensus_queue.cc:1048] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.847556 16850 raft_consensus.cc:1275] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.848860 16974 consensus_queue.cc:1048] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.861505 16702 raft_consensus.cc:1275] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.863713 16980 consensus_queue.cc:1048] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:11.888696 16597 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59552:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:11.891424 16597 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:11.946482 16686 tablet_service.cc:1511] Processing CreateTablet for tablet ccba36ba3c6149be870d4a69ca5f2674 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.947639 16765 tablet_service.cc:1511] Processing CreateTablet for tablet ccba36ba3c6149be870d4a69ca5f2674 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.949270 16765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccba36ba3c6149be870d4a69ca5f2674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.949502 16839 tablet_service.cc:1511] Processing CreateTablet for tablet ccba36ba3c6149be870d4a69ca5f2674 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.951116 16839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccba36ba3c6149be870d4a69ca5f2674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.953469 16684 tablet_service.cc:1511] Processing CreateTablet for tablet 52e07e20704e4218962167488ee3b012 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.953737 16763 tablet_service.cc:1511] Processing CreateTablet for tablet 52e07e20704e4218962167488ee3b012 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.955245 16686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccba36ba3c6149be870d4a69ca5f2674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.955417 16763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e07e20704e4218962167488ee3b012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.956776 16684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e07e20704e4218962167488ee3b012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.959281 16841 tablet_service.cc:1511] Processing CreateTablet for tablet 52e07e20704e4218962167488ee3b012 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.959281 16687 tablet_service.cc:1511] Processing CreateTablet for tablet 23d7b077834f471192e5ee5709fa48e3 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.962805 16687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d7b077834f471192e5ee5709fa48e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.966451 16762 tablet_service.cc:1511] Processing CreateTablet for tablet 23d7b077834f471192e5ee5709fa48e3 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.966284 16840 tablet_service.cc:1511] Processing CreateTablet for tablet 23d7b077834f471192e5ee5709fa48e3 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.968205 16762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d7b077834f471192e5ee5709fa48e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.979636 16841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e07e20704e4218962167488ee3b012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.980547 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d7b077834f471192e5ee5709fa48e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:12.000988 16648 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:12.013475 17000 tablet_bootstrap.cc:492] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.025768 17001 tablet_bootstrap.cc:492] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.030232 17000 tablet_bootstrap.cc:654] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.037590 16837 tablet_service.cc:1511] Processing CreateTablet for tablet 21e2f5f2d73d49aba6616c9febfe2560 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:12.037979 16765 tablet_service.cc:1511] Processing CreateTablet for tablet 21e2f5f2d73d49aba6616c9febfe2560 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:12.042973 16686 tablet_service.cc:1511] Processing CreateTablet for tablet e458f2e3eaf14777acd86b33e508e50d (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:12.043545 16837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e2f5f2d73d49aba6616c9febfe2560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.044247 16765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e2f5f2d73d49aba6616c9febfe2560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.044641 16686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e458f2e3eaf14777acd86b33e508e50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.038955 16684 tablet_service.cc:1511] Processing CreateTablet for tablet 21e2f5f2d73d49aba6616c9febfe2560 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:12.047128 16684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e2f5f2d73d49aba6616c9febfe2560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.058168 16762 tablet_service.cc:1511] Processing CreateTablet for tablet e458f2e3eaf14777acd86b33e508e50d (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:12.059046 17001 tablet_bootstrap.cc:654] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.059784 16762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e458f2e3eaf14777acd86b33e508e50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.069092 16840 tablet_service.cc:1511] Processing CreateTablet for tablet e458f2e3eaf14777acd86b33e508e50d (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:12.070597 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e458f2e3eaf14777acd86b33e508e50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.073830 17000 tablet_bootstrap.cc:492] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.074466 17000 ts_tablet_manager.cc:1403] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.007s
I20260709 13:05:12.075136 16687 tablet_service.cc:1511] Processing CreateTablet for tablet 25f4d3e0f81c47e2a7c63f9be90034e6 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:12.082664 16687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f4d3e0f81c47e2a7c63f9be90034e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.086097 17000 raft_consensus.cc:359] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.086972 17000 raft_consensus.cc:385] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.087299 17000 raft_consensus.cc:740] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.090022 17000 consensus_queue.cc:260] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.107499 17000 ts_tablet_manager.cc:1434] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:05:12.108628 17000 tablet_bootstrap.cc:492] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.114902 17002 tablet_bootstrap.cc:492] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.119719 16837 tablet_service.cc:1511] Processing CreateTablet for tablet 25f4d3e0f81c47e2a7c63f9be90034e6 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:12.120149 16765 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4b1932601c46d5a2e0d5b5adaf43f6 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:12.121240 16837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f4d3e0f81c47e2a7c63f9be90034e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.121579 16765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4b1932601c46d5a2e0d5b5adaf43f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.117349 16763 tablet_service.cc:1511] Processing CreateTablet for tablet 25f4d3e0f81c47e2a7c63f9be90034e6 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:12.123224 17002 tablet_bootstrap.cc:654] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.119719 16684 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4b1932601c46d5a2e0d5b5adaf43f6 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:12.132086 16692 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6d79c49b7a4dcd9818ff6f6231c403 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:12.132725 16684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4b1932601c46d5a2e0d5b5adaf43f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.133590 16692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6d79c49b7a4dcd9818ff6f6231c403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.124493 16685 tablet_service.cc:1511] Processing CreateTablet for tablet a27610a2696d4a458326d18fe58a4e62 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:12.124598 16763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f4d3e0f81c47e2a7c63f9be90034e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.125516 16841 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4b1932601c46d5a2e0d5b5adaf43f6 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:12.136988 16841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4b1932601c46d5a2e0d5b5adaf43f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.140074 16685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27610a2696d4a458326d18fe58a4e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.142083 17000 tablet_bootstrap.cc:654] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.126875 16766 tablet_service.cc:1511] Processing CreateTablet for tablet a27610a2696d4a458326d18fe58a4e62 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:12.128235 16838 tablet_service.cc:1511] Processing CreateTablet for tablet a27610a2696d4a458326d18fe58a4e62 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:12.146621 16838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27610a2696d4a458326d18fe58a4e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.151636 16766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27610a2696d4a458326d18fe58a4e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.158835 17001 tablet_bootstrap.cc:492] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.159507 17001 ts_tablet_manager.cc:1403] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.006s
I20260709 13:05:12.164665 16762 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6d79c49b7a4dcd9818ff6f6231c403 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:12.165740 17001 raft_consensus.cc:359] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.166277 16762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6d79c49b7a4dcd9818ff6f6231c403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.171833 16839 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6d79c49b7a4dcd9818ff6f6231c403 (DEFAULT_TABLE table=soft_deleted_table [id=114c1032348c4e529f2771eac204edda]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:12.173286 16839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6d79c49b7a4dcd9818ff6f6231c403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.174706 17001 raft_consensus.cc:385] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.188089 17001 raft_consensus.cc:740] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.188974 17001 consensus_queue.cc:260] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.198246 16963 raft_consensus.cc:493] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.199010 16963 raft_consensus.cc:515] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.202455 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccba36ba3c6149be870d4a69ca5f2674" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:12.203184 16775 raft_consensus.cc:2468] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 0.
I20260709 13:05:12.205111 16666 leader_election.cc:304] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.211442 17001 ts_tablet_manager.cc:1434] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 13:05:12.211747 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccba36ba3c6149be870d4a69ca5f2674" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:12.216460 17002 tablet_bootstrap.cc:492] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.217051 17002 ts_tablet_manager.cc:1403] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.015s
I20260709 13:05:12.217448 17001 tablet_bootstrap.cc:492] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.213197 16963 leader_election.cc:290] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.218998 16963 raft_consensus.cc:2804] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.219358 16963 raft_consensus.cc:493] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.219693 16963 raft_consensus.cc:3060] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.220093 17002 raft_consensus.cc:359] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.220957 17002 raft_consensus.cc:385] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.221271 17002 raft_consensus.cc:740] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.222091 17002 consensus_queue.cc:260] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
W20260709 13:05:12.223337 16668 leader_election.cc:343] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.224767 17002 ts_tablet_manager.cc:1434] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:12.228356 17001 tablet_bootstrap.cc:654] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.236680 17000 tablet_bootstrap.cc:492] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.237391 17000 ts_tablet_manager.cc:1403] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.129s	user 0.030s	sys 0.021s
I20260709 13:05:12.242640 16951 raft_consensus.cc:493] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.243484 16951 raft_consensus.cc:515] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.251559 16951 leader_election.cc:290] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.254532 17002 tablet_bootstrap.cc:492] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.256892 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccba36ba3c6149be870d4a69ca5f2674" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:12.257691 16775 raft_consensus.cc:2468] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.257212 16963 raft_consensus.cc:515] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.262290 16815 leader_election.cc:304] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:12.262372 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccba36ba3c6149be870d4a69ca5f2674" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.263363 16702 raft_consensus.cc:2393] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a25c0c95ca84b3d825ca1b83606ebea in current term 1: Already voted for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in this term.
I20260709 13:05:12.263374 16951 raft_consensus.cc:2804] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.263929 16951 raft_consensus.cc:493] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.264289 16951 raft_consensus.cc:3060] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.265612 17000 raft_consensus.cc:359] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.266589 17000 raft_consensus.cc:385] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.267019 17000 raft_consensus.cc:740] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.268119 17000 consensus_queue.cc:260] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.272294 17002 tablet_bootstrap.cc:654] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:12.273994 16666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.28.194:41969, user_credentials={real_user=slave}} blocked reactor thread for 69034.7us
I20260709 13:05:12.274493 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccba36ba3c6149be870d4a69ca5f2674" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:12.276790 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccba36ba3c6149be870d4a69ca5f2674" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:12.277482 16775 raft_consensus.cc:3060] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.278700 16963 leader_election.cc:290] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.289547 17001 tablet_bootstrap.cc:492] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.290752 17000 ts_tablet_manager.cc:1434] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.005s
I20260709 13:05:12.292044 17001 ts_tablet_manager.cc:1403] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.012s
I20260709 13:05:12.292711 17000 tablet_bootstrap.cc:492] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.295454 17001 raft_consensus.cc:359] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.297421 17001 raft_consensus.cc:385] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.297878 17001 raft_consensus.cc:740] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.298209 16951 raft_consensus.cc:515] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.296998 17002 tablet_bootstrap.cc:492] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.299404 17002 ts_tablet_manager.cc:1403] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.008s
I20260709 13:05:12.299501 16850 raft_consensus.cc:2393] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in current term 1: Already voted for candidate 3a25c0c95ca84b3d825ca1b83606ebea in this term.
I20260709 13:05:12.300416 17000 tablet_bootstrap.cc:654] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.301007 16775 raft_consensus.cc:2468] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 1.
I20260709 13:05:12.302621 16666 leader_election.cc:304] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.298786 17001 consensus_queue.cc:260] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.304847 16951 leader_election.cc:290] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.304432 17002 raft_consensus.cc:359] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.306154 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccba36ba3c6149be870d4a69ca5f2674" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.306196 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccba36ba3c6149be870d4a69ca5f2674" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:12.306587 17002 raft_consensus.cc:385] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.307214 17002 raft_consensus.cc:740] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.307322 16775 raft_consensus.cc:2393] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a25c0c95ca84b3d825ca1b83606ebea in current term 1: Already voted for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in this term.
I20260709 13:05:12.307312 16702 raft_consensus.cc:2393] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a25c0c95ca84b3d825ca1b83606ebea in current term 1: Already voted for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in this term.
I20260709 13:05:12.311267 16963 raft_consensus.cc:2804] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.311789 16963 raft_consensus.cc:697] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:12.312819 17000 tablet_bootstrap.cc:492] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.312637 16963 consensus_queue.cc:237] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.313494 17000 ts_tablet_manager.cc:1403] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:05:12.314381 16815 leader_election.cc:304] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:12.316815 17000 raft_consensus.cc:359] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.308454 17002 consensus_queue.cc:260] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.318198 16951 raft_consensus.cc:493] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.318733 16951 raft_consensus.cc:515] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.319969 17013 raft_consensus.cc:2749] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.321063 16951 leader_election.cc:290] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.323068 17002 ts_tablet_manager.cc:1434] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 13:05:12.324278 17002 tablet_bootstrap.cc:492] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.310286 17001 ts_tablet_manager.cc:1434] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:05:12.317632 17000 raft_consensus.cc:385] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.325498 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e07e20704e4218962167488ee3b012" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.326144 17000 raft_consensus.cc:740] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.326412 16702 raft_consensus.cc:2468] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.327006 17000 consensus_queue.cc:260] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.327821 16816 leader_election.cc:304] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.328881 17011 raft_consensus.cc:2804] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.329487 17011 raft_consensus.cc:493] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.330384 17011 raft_consensus.cc:3060] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.330761 17001 tablet_bootstrap.cc:492] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.329627 17000 ts_tablet_manager.cc:1434] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:05:12.327541 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e07e20704e4218962167488ee3b012" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:12.331686 16775 raft_consensus.cc:2468] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.332316 17000 tablet_bootstrap.cc:492] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.338740 17001 tablet_bootstrap.cc:654] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.339056 17002 tablet_bootstrap.cc:654] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.347561 17011 raft_consensus.cc:515] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.348985 17000 tablet_bootstrap.cc:654] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.354477 17002 tablet_bootstrap.cc:492] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.355029 17002 ts_tablet_manager.cc:1403] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.000s
I20260709 13:05:12.355185 17001 tablet_bootstrap.cc:492] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.355732 17001 ts_tablet_manager.cc:1403] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.005s
I20260709 13:05:12.358435 17002 raft_consensus.cc:359] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.359293 17002 raft_consensus.cc:385] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.358623 16597 catalog_manager.cc:5697] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.360527 17001 raft_consensus.cc:359] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.361342 17001 raft_consensus.cc:385] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.359635 17002 raft_consensus.cc:740] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.361649 17001 raft_consensus.cc:740] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.362648 17002 consensus_queue.cc:260] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.362643 17001 consensus_queue.cc:260] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.367360 17002 ts_tablet_manager.cc:1434] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:05:12.367854 17001 ts_tablet_manager.cc:1434] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:05:12.368542 17002 tablet_bootstrap.cc:492] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.368980 17001 tablet_bootstrap.cc:492] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.371485 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e07e20704e4218962167488ee3b012" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.372426 16702 raft_consensus.cc:3060] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.376377 17001 tablet_bootstrap.cc:654] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.383360 17011 leader_election.cc:290] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.391865 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e07e20704e4218962167488ee3b012" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:12.392632 16774 raft_consensus.cc:3060] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.402781 16702 raft_consensus.cc:2468] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:12.404425 17002 tablet_bootstrap.cc:654] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.404439 17001 tablet_bootstrap.cc:492] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.408905 16816 leader_election.cc:304] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.409368 17001 ts_tablet_manager.cc:1403] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.003s
I20260709 13:05:12.409715 16774 raft_consensus.cc:2468] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:12.409961 17011 raft_consensus.cc:2804] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.410566 17011 raft_consensus.cc:697] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:12.411456 17011 consensus_queue.cc:237] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.413206 17000 tablet_bootstrap.cc:492] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.413913 17000 ts_tablet_manager.cc:1403] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.082s	user 0.027s	sys 0.024s
I20260709 13:05:12.412724 17001 raft_consensus.cc:359] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.418176 17001 raft_consensus.cc:385] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.418522 17001 raft_consensus.cc:740] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.419392 17002 tablet_bootstrap.cc:492] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.419342 17001 consensus_queue.cc:260] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.420106 17002 ts_tablet_manager.cc:1403] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.000s
I20260709 13:05:12.422039 17001 ts_tablet_manager.cc:1434] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:05:12.417521 17000 raft_consensus.cc:359] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.422962 17000 raft_consensus.cc:385] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.423262 17000 raft_consensus.cc:740] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.424110 17000 consensus_queue.cc:260] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.426609 17000 ts_tablet_manager.cc:1434] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:05:12.427670 17000 tablet_bootstrap.cc:492] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.431970 17001 tablet_bootstrap.cc:492] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.434315 16597 catalog_manager.cc:5697] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 1 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.434291 17002 raft_consensus.cc:359] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.438951 17002 raft_consensus.cc:385] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.439283 17002 raft_consensus.cc:740] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.439499 17001 tablet_bootstrap.cc:654] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.440163 17002 consensus_queue.cc:260] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.441728 17000 tablet_bootstrap.cc:654] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.442950 17002 ts_tablet_manager.cc:1434] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:05:12.444597 17002 tablet_bootstrap.cc:492] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.453086 17002 tablet_bootstrap.cc:654] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.463769 17000 tablet_bootstrap.cc:492] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.463838 17001 tablet_bootstrap.cc:492] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.464358 17000 ts_tablet_manager.cc:1403] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.009s
I20260709 13:05:12.464684 17001 ts_tablet_manager.cc:1403] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 13:05:12.468250 17002 tablet_bootstrap.cc:492] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.468394 17000 raft_consensus.cc:359] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.469069 17002 ts_tablet_manager.cc:1403] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.015s
I20260709 13:05:12.468456 17001 raft_consensus.cc:359] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.469404 17000 raft_consensus.cc:385] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.469564 17001 raft_consensus.cc:385] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.469841 17000 raft_consensus.cc:740] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.469987 17001 raft_consensus.cc:740] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.470947 17001 consensus_queue.cc:260] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.470851 17000 consensus_queue.cc:260] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.473402 17001 ts_tablet_manager.cc:1434] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:12.473399 17000 ts_tablet_manager.cc:1434] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:12.474730 17001 tablet_bootstrap.cc:492] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.474761 17000 tablet_bootstrap.cc:492] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.475864 17002 raft_consensus.cc:359] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.477017 17002 raft_consensus.cc:385] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.477316 17002 raft_consensus.cc:740] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.478240 17002 consensus_queue.cc:260] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.482497 17001 tablet_bootstrap.cc:654] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.482748 17000 tablet_bootstrap.cc:654] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.484320 17002 ts_tablet_manager.cc:1434] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:05:12.485563 17002 tablet_bootstrap.cc:492] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.495260 17002 tablet_bootstrap.cc:654] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.509552 17002 tablet_bootstrap.cc:492] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.510334 17002 ts_tablet_manager.cc:1403] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:05:12.515555 17001 tablet_bootstrap.cc:492] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.516163 17001 ts_tablet_manager.cc:1403] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.012s
I20260709 13:05:12.516571 17000 tablet_bootstrap.cc:492] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.517144 17000 ts_tablet_manager.cc:1403] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.027s
I20260709 13:05:12.517401 17002 raft_consensus.cc:359] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.518332 17002 raft_consensus.cc:385] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.518646 17002 raft_consensus.cc:740] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.519443 17002 consensus_queue.cc:260] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.519587 17001 raft_consensus.cc:359] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.521744 17001 raft_consensus.cc:385] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.522104 17001 raft_consensus.cc:740] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.523298 17002 ts_tablet_manager.cc:1434] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:12.523000 17001 consensus_queue.cc:260] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.524379 17002 tablet_bootstrap.cc:492] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.520435 17000 raft_consensus.cc:359] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.524893 17000 raft_consensus.cc:385] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.525203 17000 raft_consensus.cc:740] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.526005 17000 consensus_queue.cc:260] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.528451 17000 ts_tablet_manager.cc:1434] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:12.529544 17000 tablet_bootstrap.cc:492] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.530429 17001 ts_tablet_manager.cc:1434] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:05:12.531522 17001 tablet_bootstrap.cc:492] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.532025 17002 tablet_bootstrap.cc:654] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.538393 17001 tablet_bootstrap.cc:654] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.539410 17000 tablet_bootstrap.cc:654] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.545166 17002 tablet_bootstrap.cc:492] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.545961 17002 ts_tablet_manager.cc:1403] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:05:12.546113 16989 raft_consensus.cc:493] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.546713 16989 raft_consensus.cc:515] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.548974 16989 leader_election.cc:290] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.549535 17002 raft_consensus.cc:359] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.550372 17002 raft_consensus.cc:385] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.550590 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.551337 16701 raft_consensus.cc:2468] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:12.550690 17002 raft_consensus.cc:740] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.552666 16742 leader_election.cc:304] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.552673 17002 consensus_queue.cc:260] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.550630 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:12.556109 17013 raft_consensus.cc:493] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.557211 16989 raft_consensus.cc:2804] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.556911 17013 raft_consensus.cc:515] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.557683 16989 raft_consensus.cc:493] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.558634 16850 raft_consensus.cc:2468] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:12.559876 17013 leader_election.cc:290] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.556087 17002 ts_tablet_manager.cc:1434] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:05:12.560599 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.560977 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:12.561265 16701 raft_consensus.cc:2468] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.558184 16989 raft_consensus.cc:3060] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.561398 17002 tablet_bootstrap.cc:492] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.562649 16816 leader_election.cc:304] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.563439 17013 raft_consensus.cc:2804] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.563803 17013 raft_consensus.cc:493] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.564114 17013 raft_consensus.cc:3060] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.570617 16989 raft_consensus.cc:515] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.572337 16774 raft_consensus.cc:2393] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a25c0c95ca84b3d825ca1b83606ebea in current term 1: Already voted for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in this term.
I20260709 13:05:12.575417 17001 tablet_bootstrap.cc:492] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.575901 17001 ts_tablet_manager.cc:1403] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.000s
I20260709 13:05:12.578083 17000 tablet_bootstrap.cc:492] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.578749 17000 ts_tablet_manager.cc:1403] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.008s
I20260709 13:05:12.579151 17001 raft_consensus.cc:359] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.579982 17001 raft_consensus.cc:385] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.580288 17001 raft_consensus.cc:740] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.582015 17001 consensus_queue.cc:260] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.582733 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.582738 17000 raft_consensus.cc:359] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.583469 16701 raft_consensus.cc:3060] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.583761 17000 raft_consensus.cc:385] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.584116 17000 raft_consensus.cc:740] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.584470 17001 ts_tablet_manager.cc:1434] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:12.580392 17002 tablet_bootstrap.cc:654] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.578758 17013 raft_consensus.cc:515] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.585023 17000 consensus_queue.cc:260] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.586481 17013 leader_election.cc:290] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.587699 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:12.588548 16774 raft_consensus.cc:2393] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a25c0c95ca84b3d825ca1b83606ebea in current term 1: Already voted for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in this term.
I20260709 13:05:12.589699 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.590379 17001 tablet_bootstrap.cc:492] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.591703 16816 leader_election.cc:304] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:12.592576 17013 raft_consensus.cc:2749] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.594517 16701 raft_consensus.cc:2468] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 1.
I20260709 13:05:12.595784 16742 leader_election.cc:304] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.596861 17020 raft_consensus.cc:2804] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.597122 16989 leader_election.cc:290] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.599395 17001 tablet_bootstrap.cc:654] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.606067 17000 ts_tablet_manager.cc:1434] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:05:12.606968 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:12.610776 17013 raft_consensus.cc:493] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.614281 17013 raft_consensus.cc:515] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.616304 17002 tablet_bootstrap.cc:492] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.616822 17002 ts_tablet_manager.cc:1403] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.002s
I20260709 13:05:12.617372 17013 leader_election.cc:290] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.608145 16850 raft_consensus.cc:2393] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02e5f1c7a2c04e36a0474d09cab07d6f in current term 1: Already voted for candidate 3a25c0c95ca84b3d825ca1b83606ebea in this term.
I20260709 13:05:12.618697 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d7b077834f471192e5ee5709fa48e3" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:12.619396 16774 raft_consensus.cc:2468] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.619684 17002 raft_consensus.cc:359] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.620424 17002 raft_consensus.cc:385] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.607717 17000 tablet_bootstrap.cc:492] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.620878 16815 leader_election.cc:304] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:12.620905 17002 raft_consensus.cc:740] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.613302 17020 raft_consensus.cc:697] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:12.622072 17013 raft_consensus.cc:2804] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.624238 17013 raft_consensus.cc:493] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.624702 17013 raft_consensus.cc:3060] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.622361 17002 consensus_queue.cc:260] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.623232 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d7b077834f471192e5ee5709fa48e3" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.626384 16701 raft_consensus.cc:2468] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.627939 17020 consensus_queue.cc:237] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.629284 17002 ts_tablet_manager.cc:1434] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:05:12.630713 17002 tablet_bootstrap.cc:492] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea: Bootstrap starting.
I20260709 13:05:12.637205 17002 tablet_bootstrap.cc:654] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.645694 17000 tablet_bootstrap.cc:654] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.647118 17001 tablet_bootstrap.cc:492] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.647668 17001 ts_tablet_manager.cc:1403] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.058s	user 0.031s	sys 0.019s
I20260709 13:05:12.649312 16598 catalog_manager.cc:5697] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.651103 17001 raft_consensus.cc:359] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.653052 17001 raft_consensus.cc:385] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.653323 17001 raft_consensus.cc:740] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.654054 17001 consensus_queue.cc:260] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.654652 17000 tablet_bootstrap.cc:492] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.657274 17000 ts_tablet_manager.cc:1403] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.001s
I20260709 13:05:12.660640 17000 raft_consensus.cc:359] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.660868 17001 ts_tablet_manager.cc:1434] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:05:12.661351 17000 raft_consensus.cc:385] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.655896 17013 raft_consensus.cc:515] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.662331 17001 tablet_bootstrap.cc:492] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9: Bootstrap starting.
I20260709 13:05:12.663527 17013 leader_election.cc:290] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.661643 17000 raft_consensus.cc:740] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.664867 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d7b077834f471192e5ee5709fa48e3" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:12.665548 16774 raft_consensus.cc:3060] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.664908 17000 consensus_queue.cc:260] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.668323 17000 ts_tablet_manager.cc:1434] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:12.669260 17001 tablet_bootstrap.cc:654] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.669282 17000 tablet_bootstrap.cc:492] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Bootstrap starting.
I20260709 13:05:12.669721 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d7b077834f471192e5ee5709fa48e3" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.670404 16701 raft_consensus.cc:3060] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.672322 16774 raft_consensus.cc:2468] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:12.674007 16815 leader_election.cc:304] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:12.676199 17000 tablet_bootstrap.cc:654] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.681602 17013 raft_consensus.cc:2804] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.682474 17013 raft_consensus.cc:697] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:12.683677 17013 consensus_queue.cc:237] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.692803 16701 raft_consensus.cc:2468] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:12.694882 17001 tablet_bootstrap.cc:492] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9: No bootstrap required, opened a new log
I20260709 13:05:12.695684 17001 ts_tablet_manager.cc:1403] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.014s
I20260709 13:05:12.697880 17000 tablet_bootstrap.cc:492] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f: No bootstrap required, opened a new log
I20260709 13:05:12.697896 17002 tablet_bootstrap.cc:492] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea: No bootstrap required, opened a new log
I20260709 13:05:12.700635 17002 ts_tablet_manager.cc:1403] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent bootstrapping tablet: real 0.070s	user 0.004s	sys 0.013s
I20260709 13:05:12.700947 17020 raft_consensus.cc:493] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.701418 17001 raft_consensus.cc:359] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.701475 17020 raft_consensus.cc:515] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.702257 17001 raft_consensus.cc:385] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.702595 17001 raft_consensus.cc:740] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.703380 17001 consensus_queue.cc:260] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.703820 17020 leader_election.cc:290] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.699954 16963 raft_consensus.cc:493] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.698455 17000 ts_tablet_manager.cc:1403] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 13:05:12.704977 16963 raft_consensus.cc:515] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.706830 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6d79c49b7a4dcd9818ff6f6231c403" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:12.707538 16850 raft_consensus.cc:2468] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:12.698952 17007 consensus_queue.cc:1048] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.708354 17000 raft_consensus.cc:359] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.709133 17000 raft_consensus.cc:385] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.709441 17000 raft_consensus.cc:740] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.709491 17020 raft_consensus.cc:493] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.710028 17020 raft_consensus.cc:515] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.710233 17000 consensus_queue.cc:260] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.708886 16743 leader_election.cc:304] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:12.710866 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6d79c49b7a4dcd9818ff6f6231c403" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.711741 17031 raft_consensus.cc:2804] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.712173 17031 raft_consensus.cc:493] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.712545 17000 ts_tablet_manager.cc:1434] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:12.712579 17031 raft_consensus.cc:3060] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.704274 17002 raft_consensus.cc:359] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.713547 17002 raft_consensus.cc:385] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.713868 17002 raft_consensus.cc:740] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.714665 17020 leader_election.cc:290] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.714486 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4b1932601c46d5a2e0d5b5adaf43f6" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:12.715041 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4b1932601c46d5a2e0d5b5adaf43f6" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.714556 17002 consensus_queue.cc:260] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.715817 16702 raft_consensus.cc:2468] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:12.715466 16850 raft_consensus.cc:2468] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:12.712163 16701 raft_consensus.cc:2468] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 0.
I20260709 13:05:12.723832 16598 catalog_manager.cc:5697] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 1 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.726107 16742 leader_election.cc:304] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.727507 16963 leader_election.cc:290] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.727757 17020 raft_consensus.cc:2804] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.728178 17020 raft_consensus.cc:493] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.728518 17020 raft_consensus.cc:3060] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.728957 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f4d3e0f81c47e2a7c63f9be90034e6" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:12.729637 16775 raft_consensus.cc:2468] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 0.
I20260709 13:05:12.729703 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f4d3e0f81c47e2a7c63f9be90034e6" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" is_pre_election: true
I20260709 13:05:12.734163 16850 raft_consensus.cc:2468] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 0.
I20260709 13:05:12.725441 17031 raft_consensus.cc:515] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.737339 16666 leader_election.cc:304] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.740028 16963 raft_consensus.cc:2804] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.740574 16963 raft_consensus.cc:493] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.741030 16963 raft_consensus.cc:3060] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.744311 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6d79c49b7a4dcd9818ff6f6231c403" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.745018 16701 raft_consensus.cc:3060] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.747303 17001 ts_tablet_manager.cc:1434] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9: Time spent starting tablet: real 0.049s	user 0.015s	sys 0.020s
I20260709 13:05:12.749384 17020 raft_consensus.cc:515] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.753043 17002 ts_tablet_manager.cc:1434] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:05:12.754699 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6d79c49b7a4dcd9818ff6f6231c403" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:12.755012 16701 raft_consensus.cc:2468] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 1.
I20260709 13:05:12.755328 16850 raft_consensus.cc:3060] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.756482 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4b1932601c46d5a2e0d5b5adaf43f6" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.757056 16702 raft_consensus.cc:3060] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.762228 17013 raft_consensus.cc:493] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.762866 16850 raft_consensus.cc:2468] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 1.
I20260709 13:05:12.762879 17013 raft_consensus.cc:515] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.763518 16702 raft_consensus.cc:2468] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 1.
I20260709 13:05:12.763607 16742 leader_election.cc:304] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.751459 17031 leader_election.cc:290] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.764652 16989 raft_consensus.cc:2804] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.765858 16742 leader_election.cc:304] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.771251 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4b1932601c46d5a2e0d5b5adaf43f6" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:12.771513 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27610a2696d4a458326d18fe58a4e62" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.771660 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27610a2696d4a458326d18fe58a4e62" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:12.772315 16701 raft_consensus.cc:2468] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.772428 16774 raft_consensus.cc:2468] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.773732 16815 leader_election.cc:304] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:12.774734 17011 raft_consensus.cc:2804] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.775250 17011 raft_consensus.cc:493] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.775684 17011 raft_consensus.cc:3060] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.782164 17013 leader_election.cc:290] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.782644 17020 leader_election.cc:290] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.771911 16850 raft_consensus.cc:3060] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.773761 17031 raft_consensus.cc:2804] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.786435 17031 raft_consensus.cc:697] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:12.787428 17031 consensus_queue.cc:237] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.791589 17011 raft_consensus.cc:515] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.799247 16963 raft_consensus.cc:515] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.800400 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27610a2696d4a458326d18fe58a4e62" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.801261 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27610a2696d4a458326d18fe58a4e62" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:12.801981 16774 raft_consensus.cc:3060] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.801257 16701 raft_consensus.cc:3060] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.812911 17013 raft_consensus.cc:493] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.812970 17047 consensus_queue.cc:1048] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:12.814649 17013 raft_consensus.cc:515] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.817075 17013 leader_election.cc:290] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.813386 16951 consensus_queue.cc:1048] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:12.818499 16776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e458f2e3eaf14777acd86b33e508e50d" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" is_pre_election: true
I20260709 13:05:12.819223 16776 raft_consensus.cc:2468] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.820655 16815 leader_election.cc:304] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:12.821600 16951 raft_consensus.cc:2804] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.822001 16951 raft_consensus.cc:493] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.822312 16951 raft_consensus.cc:3060] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.827039 16701 raft_consensus.cc:2468] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:12.827975 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e458f2e3eaf14777acd86b33e508e50d" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" is_pre_election: true
I20260709 13:05:12.828472 16816 leader_election.cc:304] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.828737 16702 raft_consensus.cc:2468] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 0.
I20260709 13:05:12.830698 17048 raft_consensus.cc:2804] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.834458 16951 raft_consensus.cc:515] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.835711 17048 raft_consensus.cc:697] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:12.836761 17011 leader_election.cc:290] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.837683 16989 raft_consensus.cc:697] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:12.838616 16774 raft_consensus.cc:2468] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:12.847532 16951 leader_election.cc:290] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:12.839596 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f4d3e0f81c47e2a7c63f9be90034e6" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:12.840139 16849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f4d3e0f81c47e2a7c63f9be90034e6" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:12.848110 17011 consensus_queue.cc:1048] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.848551 16775 raft_consensus.cc:3060] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.848659 16849 raft_consensus.cc:3060] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.849568 17048 consensus_queue.cc:237] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.851080 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e458f2e3eaf14777acd86b33e508e50d" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:12.851848 16701 raft_consensus.cc:3060] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.848764 16989 consensus_queue.cc:237] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.855458 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e458f2e3eaf14777acd86b33e508e50d" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:12.856191 16774 raft_consensus.cc:3060] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.843394 16963 leader_election.cc:290] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:12.841142 16850 raft_consensus.cc:2468] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 1.
I20260709 13:05:12.870534 16701 raft_consensus.cc:2468] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:12.871979 16816 leader_election.cc:304] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.873181 16849 raft_consensus.cc:2468] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 1.
I20260709 13:05:12.874571 16951 raft_consensus.cc:2804] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.875896 16668 leader_election.cc:304] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:12.876070 16951 raft_consensus.cc:697] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:12.876818 16963 raft_consensus.cc:2804] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.876931 16775 raft_consensus.cc:2468] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 1.
I20260709 13:05:12.877614 16963 raft_consensus.cc:697] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:12.882077 16963 consensus_queue.cc:237] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.877063 16951 consensus_queue.cc:237] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:12.878988 16774 raft_consensus.cc:2468] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 1.
I20260709 13:05:12.890372 16597 catalog_manager.cc:5697] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 1 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.890944 16599 catalog_manager.cc:5697] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.910017 16598 catalog_manager.cc:5697] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 1 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.921144 16597 catalog_manager.cc:5697] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 1 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.929554 16599 catalog_manager.cc:5697] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 1 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.117985 16849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52e07e20704e4218962167488ee3b012"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
mode: GRACEFUL
new_leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:05:13.118534 16849 raft_consensus.cc:606] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Received request to transfer leadership to TS 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:13.123898 16849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d7b077834f471192e5ee5709fa48e3"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
mode: GRACEFUL
new_leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:05:13.124544 16849 raft_consensus.cc:606] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Received request to transfer leadership to TS 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:13.129712 16774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
mode: GRACEFUL
new_leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:46622
I20260709 13:05:13.130442 16774 raft_consensus.cc:606] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Received request to transfer leadership to TS 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:13.136168 16849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e458f2e3eaf14777acd86b33e508e50d"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
mode: GRACEFUL
new_leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:05:13.136819 16849 raft_consensus.cc:606] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Received request to transfer leadership to TS 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:13.142562 16701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25f4d3e0f81c47e2a7c63f9be90034e6"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
mode: GRACEFUL
new_leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:42206
I20260709 13:05:13.143181 16701 raft_consensus.cc:606] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Received request to transfer leadership to TS 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:13.151232 16849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a27610a2696d4a458326d18fe58a4e62"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
mode: GRACEFUL
new_leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:05:13.151783 16849 raft_consensus.cc:606] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Received request to transfer leadership to TS 02e5f1c7a2c04e36a0474d09cab07d6f
I20260709 13:05:13.157536 16774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6d79c49b7a4dcd9818ff6f6231c403"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
mode: GRACEFUL
new_leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
 from {username='slave'} at 127.0.0.1:46622
I20260709 13:05:13.158277 16774 raft_consensus.cc:606] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Received request to transfer leadership to TS 3a25c0c95ca84b3d825ca1b83606ebea
I20260709 13:05:13.168370 16989 consensus_queue.cc:1048] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.179453 16989 consensus_queue.cc:1048] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.187804 16951 consensus_queue.cc:1048] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.192268 17041 raft_consensus.cc:993] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f: : Instructing follower 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:13.192891 17031 raft_consensus.cc:1081] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Signalling peer 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:13.195158 16701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:42200
I20260709 13:05:13.195791 16701 raft_consensus.cc:493] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.196234 16701 raft_consensus.cc:3060] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.198362 17054 raft_consensus.cc:993] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea: : Instructing follower 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:13.198920 17054 raft_consensus.cc:1081] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Signalling peer 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:13.202337 16700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d7b077834f471192e5ee5709fa48e3"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:42194
I20260709 13:05:13.202991 16700 raft_consensus.cc:493] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.203395 16700 raft_consensus.cc:3060] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.204244 17048 consensus_queue.cc:1048] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.211447 16701 raft_consensus.cc:515] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.211690 16700 raft_consensus.cc:515] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.212776 16702 raft_consensus.cc:1240] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Rejecting Update request from peer 3a25c0c95ca84b3d825ca1b83606ebea for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.216588 17048 consensus_queue.cc:1059] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.217293 17055 raft_consensus.cc:3055] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.217636 17055 raft_consensus.cc:740] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:13.218487 17055 consensus_queue.cc:260] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.219105 16700 leader_election.cc:290] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:13.219694 17055 raft_consensus.cc:3060] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.219846 16774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d7b077834f471192e5ee5709fa48e3" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:13.220495 16774 raft_consensus.cc:3060] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.222915 16849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d7b077834f471192e5ee5709fa48e3" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:13.223825 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:13.224424 16775 raft_consensus.cc:3055] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.224692 16775 raft_consensus.cc:740] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:13.225509 16775 consensus_queue.cc:260] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.226528 16775 raft_consensus.cc:3060] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.228422 16774 raft_consensus.cc:2468] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:13.229990 16666 leader_election.cc:304] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:13.231060 16963 raft_consensus.cc:2804] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.231624 16963 raft_consensus.cc:697] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:13.232553 16963 consensus_queue.cc:237] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.239725 16775 raft_consensus.cc:2468] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:13.241207 16701 leader_election.cc:290] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:13.241588 16666 leader_election.cc:304] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:13.242231 17054 raft_consensus.cc:993] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea: : Instructing follower 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:13.242679 16963 raft_consensus.cc:2804] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.242820 17054 raft_consensus.cc:1081] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Signalling peer 8659f2f6302b4e8d9781d2478a5a6ab9 to start an election
I20260709 13:05:13.243577 16963 raft_consensus.cc:697] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:13.244526 16963 consensus_queue.cc:237] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.246424 16701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52e07e20704e4218962167488ee3b012"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
 from {username='slave'} at 127.0.0.1:42194
I20260709 13:05:13.247171 16701 raft_consensus.cc:493] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.247627 16701 raft_consensus.cc:3060] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.249364 16850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e2f5f2d73d49aba6616c9febfe2560" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:13.250097 16850 raft_consensus.cc:3060] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.250633 17031 consensus_queue.cc:1048] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.256759 16597 catalog_manager.cc:5697] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 1 to 2, leader changed from 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195) to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.262974 16701 raft_consensus.cc:515] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.265395 16701 leader_election.cc:290] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Requested vote from peers 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:13.267638 16850 raft_consensus.cc:2468] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:13.270386 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e07e20704e4218962167488ee3b012" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:13.271109 16851 raft_consensus.cc:3055] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.271453 16851 raft_consensus.cc:740] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:13.272322 16851 consensus_queue.cc:260] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.273339 16851 raft_consensus.cc:3060] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.277433 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e07e20704e4218962167488ee3b012" candidate_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:13.278247 16775 raft_consensus.cc:3060] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.281960 16849 raft_consensus.cc:2468] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:13.286315 17045 consensus_queue.cc:1048] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.285431 16775 raft_consensus.cc:2468] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:13.290239 16666 leader_election.cc:304] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:13.291195 16963 raft_consensus.cc:2804] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.291800 16963 raft_consensus.cc:697] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Becoming Leader. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:13.290855 16598 catalog_manager.cc:5697] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 1 to 2, leader changed from 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194) to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.292971 16963 consensus_queue.cc:237] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.294646 16851 raft_consensus.cc:2468] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8659f2f6302b4e8d9781d2478a5a6ab9 in term 2.
I20260709 13:05:13.306283 16598 catalog_manager.cc:5697] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 reported cstate change: term changed from 1 to 2, leader changed from 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195) to 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193). New cstate: current_term: 2 leader_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.314517 17055 consensus_queue.cc:1048] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.318027 17045 consensus_queue.cc:1048] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.328398 17055 consensus_queue.cc:1048] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.330366 17045 raft_consensus.cc:993] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: : Instructing follower 3a25c0c95ca84b3d825ca1b83606ebea to start an election
I20260709 13:05:13.330931 17045 raft_consensus.cc:1081] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Signalling peer 3a25c0c95ca84b3d825ca1b83606ebea to start an election
I20260709 13:05:13.335716 16851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c6d79c49b7a4dcd9818ff6f6231c403"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:05:13.336328 16851 raft_consensus.cc:493] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.336735 16851 raft_consensus.cc:3060] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.343312 17045 consensus_queue.cc:1048] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.351365 16851 raft_consensus.cc:515] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.353240 17048 raft_consensus.cc:993] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea: : Instructing follower 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:13.353811 17048 raft_consensus.cc:1081] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Signalling peer 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:13.354590 17054 consensus_queue.cc:1048] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.356323 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6d79c49b7a4dcd9818ff6f6231c403" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:13.356323 16774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e458f2e3eaf14777acd86b33e508e50d"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:46610
I20260709 13:05:13.358144 16774 raft_consensus.cc:493] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.358717 16774 raft_consensus.cc:3060] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.354180 16849 raft_consensus.cc:1240] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Rejecting Update request from peer 02e5f1c7a2c04e36a0474d09cab07d6f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.361476 17045 consensus_queue.cc:1059] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.362496 17031 raft_consensus.cc:3055] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.362900 17031 raft_consensus.cc:740] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:13.363844 16851 leader_election.cc:290] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:13.363750 17031 consensus_queue.cc:260] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.363751 16775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6d79c49b7a4dcd9818ff6f6231c403" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:13.367405 16774 raft_consensus.cc:515] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.368964 17031 raft_consensus.cc:3060] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.370662 17047 consensus_queue.cc:1048] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.370944 16700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e458f2e3eaf14777acd86b33e508e50d" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:13.371549 16700 raft_consensus.cc:3060] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.381263 17007 consensus_queue.cc:1048] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.383164 16700 raft_consensus.cc:2468] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:13.384595 16742 leader_election.cc:304] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:13.386041 17045 raft_consensus.cc:2804] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.386734 17045 raft_consensus.cc:697] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:13.387842 17045 consensus_queue.cc:237] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.395918 16849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e458f2e3eaf14777acd86b33e508e50d" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:13.396549 16775 raft_consensus.cc:2468] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 2.
I20260709 13:05:13.396698 16849 raft_consensus.cc:3055] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.397104 16849 raft_consensus.cc:740] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:13.398303 16849 consensus_queue.cc:260] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.400138 16849 raft_consensus.cc:3060] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.398115 16774 leader_election.cc:290] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:13.405774 16963 raft_consensus.cc:993] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: : Instructing follower 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:13.406441 16963 raft_consensus.cc:1081] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Signalling peer 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:13.409600 16776 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25f4d3e0f81c47e2a7c63f9be90034e6"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:46612
I20260709 13:05:13.410249 16776 raft_consensus.cc:493] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.410657 16776 raft_consensus.cc:3060] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.411298 16849 raft_consensus.cc:2468] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:13.413383 16815 leader_election.cc:304] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:13.414904 17054 raft_consensus.cc:2804] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.415431 17054 raft_consensus.cc:697] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:13.415463 16599 catalog_manager.cc:5697] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 1 to 2, leader changed from 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195) to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.416153 17054 consensus_queue.cc:237] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.426736 17053 consensus_queue.cc:1048] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:13.439337 16597 catalog_manager.cc:5697] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 1 to 2, leader changed from 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194) to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 2 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.418604 16776 raft_consensus.cc:515] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.443156 16774 raft_consensus.cc:1240] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Rejecting Update request from peer 8659f2f6302b4e8d9781d2478a5a6ab9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.445518 17047 consensus_queue.cc:1059] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.446604 17047 raft_consensus.cc:3055] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.446969 17047 raft_consensus.cc:740] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:13.447817 17047 consensus_queue.cc:260] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.448994 17047 raft_consensus.cc:3060] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.455945 16701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f4d3e0f81c47e2a7c63f9be90034e6" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:13.457052 16776 leader_election.cc:290] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:13.457741 17055 raft_consensus.cc:993] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea: : Instructing follower 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:13.458141 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f4d3e0f81c47e2a7c63f9be90034e6" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:13.458623 17055 raft_consensus.cc:1081] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Signalling peer 02e5f1c7a2c04e36a0474d09cab07d6f to start an election
I20260709 13:05:13.458783 16851 raft_consensus.cc:3060] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.461719 16775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a27610a2696d4a458326d18fe58a4e62"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
 from {username='slave'} at 127.0.0.1:46610
I20260709 13:05:13.462460 16775 raft_consensus.cc:493] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.464850 16775 raft_consensus.cc:3060] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.468706 16851 raft_consensus.cc:2468] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:13.469959 16743 leader_election.cc:304] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:13.470715 17031 raft_consensus.cc:2804] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.471190 17031 raft_consensus.cc:697] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:13.471482 16775 raft_consensus.cc:515] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.471943 17031 consensus_queue.cc:237] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.473625 16775 leader_election.cc:290] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195:33787)
I20260709 13:05:13.475984 16700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27610a2696d4a458326d18fe58a4e62" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:13.476565 16700 raft_consensus.cc:3060] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.476732 16701 raft_consensus.cc:2468] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:13.476707 16851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27610a2696d4a458326d18fe58a4e62" candidate_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
I20260709 13:05:13.477749 16851 raft_consensus.cc:3055] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.478158 16851 raft_consensus.cc:740] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:13.479061 16851 consensus_queue.cc:260] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.480384 16851 raft_consensus.cc:3060] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.484463 16700 raft_consensus.cc:2468] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:13.485212 16597 catalog_manager.cc:5697] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 1 to 2, leader changed from 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193) to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.485774 16742 leader_election.cc:304] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:13.486688 17031 raft_consensus.cc:2804] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.487174 17031 raft_consensus.cc:697] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Becoming Leader. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:13.487798 16851 raft_consensus.cc:2468] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02e5f1c7a2c04e36a0474d09cab07d6f in term 2.
I20260709 13:05:13.487962 17031 consensus_queue.cc:237] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:13.498903 16597 catalog_manager.cc:5697] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f reported cstate change: term changed from 1 to 2, leader changed from 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195) to 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194). New cstate: current_term: 2 leader_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.666906 16775 raft_consensus.cc:1275] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.668262 17047 consensus_queue.cc:1048] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.677489 16851 raft_consensus.cc:1275] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.679144 17047 consensus_queue.cc:1048] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.747473 16775 raft_consensus.cc:1275] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.749032 17047 consensus_queue.cc:1048] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.757241 16851 raft_consensus.cc:1275] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.758993 17007 consensus_queue.cc:1048] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.790881 16775 raft_consensus.cc:1275] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.792161 17007 consensus_queue.cc:1048] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.800218 16851 raft_consensus.cc:1275] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 8659f2f6302b4e8d9781d2478a5a6ab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.802143 16963 consensus_queue.cc:1048] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.833534 16700 raft_consensus.cc:3060] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.840327 16700 raft_consensus.cc:1275] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 3a25c0c95ca84b3d825ca1b83606ebea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.841673 17055 consensus_queue.cc:1048] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.850492 16775 raft_consensus.cc:1275] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 3a25c0c95ca84b3d825ca1b83606ebea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.851907 17053 consensus_queue.cc:1048] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.904911 16700 raft_consensus.cc:1275] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.906576 16989 consensus_queue.cc:1048] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.907451 16849 raft_consensus.cc:1275] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.908165 16851 raft_consensus.cc:1275] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.908962 16989 consensus_queue.cc:1048] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.909616 17045 consensus_queue.cc:1048] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.920691 16701 raft_consensus.cc:1275] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.922365 17031 consensus_queue.cc:1048] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.959757 16701 raft_consensus.cc:1275] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.961104 17031 consensus_queue.cc:1048] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.970897 16849 raft_consensus.cc:1275] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Refusing update from remote peer 02e5f1c7a2c04e36a0474d09cab07d6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.972795 17045 consensus_queue.cc:1048] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:15.237115 16631 debug-util.cc:398] Leaking SignalData structure 0x7b0800089120 after lost signal to thread 7286
W20260709 13:05:15.238250 16631 debug-util.cc:398] Leaking SignalData structure 0x7b0800152740 after lost signal to thread 16634
W20260709 13:05:15.239532 16631 debug-util.cc:398] Leaking SignalData structure 0x7b080003edc0 after lost signal to thread 16726
W20260709 13:05:15.240507 16631 debug-util.cc:398] Leaking SignalData structure 0x7b0800063320 after lost signal to thread 16801
W20260709 13:05:15.241580 16631 debug-util.cc:398] Leaking SignalData structure 0x7b0800323140 after lost signal to thread 16875
I20260709 13:05:16.194325 16598 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59552:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:16.221184 16598 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59552:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:16.294425  7283 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:16.401260 17095 log.cc:927] Time spent T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:05:16.500507 17109 log.cc:927] Time spent T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Append to log took a long time: real 0.051s	user 0.004s	sys 0.000s
W20260709 13:05:16.551745 16668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:33787, user_credentials={real_user=slave}} blocked reactor thread for 160262us
I20260709 13:05:16.558635 16701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1da92e15ddbd435399bdd953d46cafe6"
dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
mode: GRACEFUL
new_leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
 from {username='slave'} at 127.0.0.1:51078
I20260709 13:05:16.559242 16701 raft_consensus.cc:606] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Received request to transfer leadership to TS 3a25c0c95ca84b3d825ca1b83606ebea
W20260709 13:05:16.552551 16666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.194:41969, user_credentials={real_user=slave}} blocked reactor thread for 157895us
I20260709 13:05:16.675485 16774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224"
dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
mode: GRACEFUL
new_leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
 from {username='slave'} at 127.0.0.1:60902
I20260709 13:05:16.676524 16774 raft_consensus.cc:606] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Received request to transfer leadership to TS 3a25c0c95ca84b3d825ca1b83606ebea
W20260709 13:05:16.678455 17129 log.cc:927] Time spent T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:16.678954  7283 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:16.679884  7283 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:16.687851 17146 tablet.cc:1724] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.629829 17131 tablet.cc:1724] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.698750 17143 tablet.cc:1724] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:16.734385 16668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.28.195:33787, user_credentials={real_user=slave}} blocked reactor thread for 44232.7us
I20260709 13:05:16.801872 17152 tablet.cc:1724] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:16.794405 17134 log.cc:927] Time spent T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:05:16.803588 17149 tablet.cc:1724] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.760077 17148 tablet.cc:1724] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.819782 17131 tablet.cc:1724] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.836022 17151 tablet.cc:1724] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.837989 17149 tablet.cc:1724] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.861428 17114 raft_consensus.cc:993] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9: : Instructing follower 3a25c0c95ca84b3d825ca1b83606ebea to start an election
I20260709 13:05:16.862316 17098 raft_consensus.cc:1081] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Signalling peer 3a25c0c95ca84b3d825ca1b83606ebea to start an election
I20260709 13:05:16.867404 17153 tablet.cc:1724] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.877128 17148 tablet.cc:1724] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.892895 17154 tablet.cc:1724] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.884970 16849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1da92e15ddbd435399bdd953d46cafe6"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
 from {username='slave'} at 127.0.0.1:39790
I20260709 13:05:16.894663 16849 raft_consensus.cc:493] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.895033 16849 raft_consensus.cc:3060] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.903086 17156 tablet.cc:1724] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.904577 17143 tablet.cc:1724] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.907298 17155 tablet.cc:1724] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.907752 16849 raft_consensus.cc:515] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:16.884255 17146 tablet.cc:1724] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.776607 17147 tablet.cc:1724] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.916844 17112 raft_consensus.cc:993] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f: : Instructing follower 3a25c0c95ca84b3d825ca1b83606ebea to start an election
I20260709 13:05:16.917692 17101 raft_consensus.cc:1081] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Signalling peer 3a25c0c95ca84b3d825ca1b83606ebea to start an election
I20260709 13:05:16.922873 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da92e15ddbd435399bdd953d46cafe6" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:16.923494 16702 raft_consensus.cc:3055] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:16.923839 16702 raft_consensus.cc:740] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8659f2f6302b4e8d9781d2478a5a6ab9, State: Running, Role: LEADER
I20260709 13:05:16.924618 16702 consensus_queue.cc:260] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:16.925666 16702 raft_consensus.cc:3060] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.931586 17146 tablet.cc:1724] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.936993 16702 raft_consensus.cc:2468] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 2.
I20260709 13:05:16.939764 16850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224"
dest_uuid: "3a25c0c95ca84b3d825ca1b83606ebea"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:05:16.950331 16850 raft_consensus.cc:493] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.950695 16850 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.941511 16849 leader_election.cc:290] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:16.942664 16777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da92e15ddbd435399bdd953d46cafe6" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:16.951891 16777 raft_consensus.cc:3060] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.956234 17151 tablet.cc:1724] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.965997 16850 raft_consensus.cc:515] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:16.970464 17147 tablet.cc:1724] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.983129 17153 tablet.cc:1724] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.967605 16816 leader_election.cc:304] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea, 8659f2f6302b4e8d9781d2478a5a6ab9; no voters: 
I20260709 13:05:16.985296 17078 raft_consensus.cc:2804] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:16.986299 17078 raft_consensus.cc:697] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:16.989068 17078 consensus_queue.cc:237] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:16.964695 17154 tablet.cc:1724] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.973687 16776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f"
I20260709 13:05:16.991230 16776 raft_consensus.cc:3055] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:16.991565 16776 raft_consensus.cc:740] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02e5f1c7a2c04e36a0474d09cab07d6f, State: Running, Role: LEADER
I20260709 13:05:16.992396 16776 consensus_queue.cc:260] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:16.993546 16776 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.978943 16850 leader_election.cc:290] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 election: Requested vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:16.980436 17155 tablet.cc:1724] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.982457 17131 tablet.cc:1724] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.966856 17152 tablet.cc:1724] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:17.001017 16702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84cc3b4833e4e2fbddee0ca01fd4224" candidate_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9"
I20260709 13:05:17.001708 16702 raft_consensus.cc:3060] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.986270 16777 raft_consensus.cc:2468] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 2.
I20260709 13:05:17.011458 16776 raft_consensus.cc:2468] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 3.
I20260709 13:05:17.012948 16815 leader_election.cc:304] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 
I20260709 13:05:17.018206 17140 raft_consensus.cc:2804] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:17.022993 17156 tablet.cc:1724] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:17.024338 16702 raft_consensus.cc:2468] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a25c0c95ca84b3d825ca1b83606ebea in term 3.
I20260709 13:05:17.049702 16599 catalog_manager.cc:5697] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 1 to 2, leader changed from 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193) to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 2 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.054015 17155 tablet.cc:1724] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:17.058539 17140 raft_consensus.cc:697] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 3 LEADER]: Becoming Leader. State: Replica: 3a25c0c95ca84b3d825ca1b83606ebea, State: Running, Role: LEADER
I20260709 13:05:17.063004 17140 consensus_queue.cc:237] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:17.111141 16599 catalog_manager.cc:6242] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034: soft_deleted_table [id=114c1032348c4e529f2771eac204edda] alter complete (version 1)
I20260709 13:05:17.125136 16598 catalog_manager.cc:5697] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea reported cstate change: term changed from 2 to 3, leader changed from 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194) to 3a25c0c95ca84b3d825ca1b83606ebea (127.7.28.195). New cstate: current_term: 3 leader_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.478263 16702 raft_consensus.cc:1275] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 3 FOLLOWER]: Refusing update from remote peer 3a25c0c95ca84b3d825ca1b83606ebea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.479591 17140 consensus_queue.cc:1048] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.500288 16776 raft_consensus.cc:1275] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 3 FOLLOWER]: Refusing update from remote peer 3a25c0c95ca84b3d825ca1b83606ebea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.502435 17140 consensus_queue.cc:1048] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.582947 16776 raft_consensus.cc:1275] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Refusing update from remote peer 3a25c0c95ca84b3d825ca1b83606ebea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.584338 17140 consensus_queue.cc:1048] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.595018 16702 raft_consensus.cc:1275] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Refusing update from remote peer 3a25c0c95ca84b3d825ca1b83606ebea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.596788 17160 consensus_queue.cc:1048] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.756668  7283 tablet_server.cc:179] TabletServer@127.7.28.193:0 shutting down...
W20260709 13:05:17.768220 16742 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:05:17.773967 16742 consensus_peers.cc:597] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:17.785775 16742 consensus_peers.cc:597] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.814471  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:17.815501  7283 tablet_replica.cc:333] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.816497  7283 raft_consensus.cc:2243] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.817121  7283 raft_consensus.cc:2272] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.819907  7283 tablet_replica.cc:333] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.820974  7283 raft_consensus.cc:2243] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.821630  7283 raft_consensus.cc:2272] T a27610a2696d4a458326d18fe58a4e62 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.824540  7283 tablet_replica.cc:333] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.825243  7283 raft_consensus.cc:2243] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.826089  7283 raft_consensus.cc:2272] T e458f2e3eaf14777acd86b33e508e50d P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.828758  7283 tablet_replica.cc:333] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.829473  7283 raft_consensus.cc:2243] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.830063  7283 raft_consensus.cc:2272] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.832762  7283 tablet_replica.cc:333] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.833633  7283 raft_consensus.cc:2243] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.834612  7283 raft_consensus.cc:2272] T 21e2f5f2d73d49aba6616c9febfe2560 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.837462  7283 tablet_replica.cc:333] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.838227  7283 raft_consensus.cc:2243] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.839047  7283 raft_consensus.cc:2272] T ccba36ba3c6149be870d4a69ca5f2674 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.841187  7283 tablet_replica.cc:333] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.841991  7283 raft_consensus.cc:2243] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.842847  7283 raft_consensus.cc:2272] T c0c5136b5a8d4c2fa67159a4cafa1705 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.845355  7283 tablet_replica.cc:333] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.845997  7283 raft_consensus.cc:2243] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.846796  7283 raft_consensus.cc:2272] T 52e07e20704e4218962167488ee3b012 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.848979  7283 tablet_replica.cc:333] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.849747  7283 raft_consensus.cc:2243] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.850342  7283 raft_consensus.cc:2272] T c94f96ebc5c149beb9d070eb0f299780 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.852597  7283 tablet_replica.cc:333] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.853222  7283 raft_consensus.cc:2243] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.853679  7283 raft_consensus.cc:2272] T 9122434fa25e4ab18cb9cd44dc90352b P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.856189  7283 tablet_replica.cc:333] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.856755  7283 raft_consensus.cc:2243] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.857288  7283 raft_consensus.cc:2272] T d84cc3b4833e4e2fbddee0ca01fd4224 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.860090  7283 tablet_replica.cc:333] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.861065  7283 raft_consensus.cc:2243] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.861848  7283 raft_consensus.cc:2272] T 55a59fcc9437459a86a79efe5d24a14c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.864738  7283 tablet_replica.cc:333] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.866078  7283 raft_consensus.cc:2243] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.866698  7283 raft_consensus.cc:2272] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.870589  7283 tablet_replica.cc:333] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.871693  7283 raft_consensus.cc:2243] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.873109  7283 raft_consensus.cc:2272] T 23d7b077834f471192e5ee5709fa48e3 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.876322  7283 tablet_replica.cc:333] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
W20260709 13:05:17.876734 16816 consensus_peers.cc:597] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.877172  7283 raft_consensus.cc:2243] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.877689  7283 raft_consensus.cc:2272] T 1da92e15ddbd435399bdd953d46cafe6 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.880915  7283 tablet_replica.cc:333] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.881498  7283 raft_consensus.cc:2243] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.882009  7283 raft_consensus.cc:2272] T a22c54f47c1749a09c836fcc71acef94 P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.884164  7283 tablet_replica.cc:333] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.885159  7283 raft_consensus.cc:2243] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.888481  7283 raft_consensus.cc:2272] T 4a4d7ac2370b4187b67d93f795b9603c P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.891152  7283 tablet_replica.cc:333] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9: stopping tablet replica
I20260709 13:05:17.891794  7283 raft_consensus.cc:2243] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.892709  7283 raft_consensus.cc:2272] T 7e6a9d0b7bec4a03a07930caa4b8737f P 8659f2f6302b4e8d9781d2478a5a6ab9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:17.906920 16742 consensus_peers.cc:597] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:17.913995 16742 consensus_peers.cc:597] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.943255  7283 tablet_server.cc:196] TabletServer@127.7.28.193:0 shutdown complete.
W20260709 13:05:17.982280 16816 consensus_peers.cc:597] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.993218  7283 tablet_server.cc:179] TabletServer@127.7.28.194:0 shutting down...
W20260709 13:05:18.006594 16816 consensus_peers.cc:597] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.016806 16815 consensus_peers.cc:597] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Couldn't send request to peer 02e5f1c7a2c04e36a0474d09cab07d6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:18.039196  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:18.040113  7283 tablet_replica.cc:333] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.041074  7283 raft_consensus.cc:2243] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.042207  7283 raft_consensus.cc:2272] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.044157  7283 tablet_replica.cc:333] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.044838  7283 raft_consensus.cc:2243] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.045686  7283 raft_consensus.cc:2272] T a27610a2696d4a458326d18fe58a4e62 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.049868  7283 tablet_replica.cc:333] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.050693  7283 raft_consensus.cc:2243] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.051251  7283 raft_consensus.cc:2272] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:18.051350 16816 consensus_peers.cc:597] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:18.054358  7283 tablet_replica.cc:333] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.055125  7283 raft_consensus.cc:2243] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.055929  7283 raft_consensus.cc:2272] T e458f2e3eaf14777acd86b33e508e50d P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.057991  7283 tablet_replica.cc:333] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.058531  7283 raft_consensus.cc:2243] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.058954  7283 raft_consensus.cc:2272] T 21e2f5f2d73d49aba6616c9febfe2560 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.061877  7283 tablet_replica.cc:333] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.062582  7283 raft_consensus.cc:2243] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.063024  7283 raft_consensus.cc:2272] T 52e07e20704e4218962167488ee3b012 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.065583  7283 tablet_replica.cc:333] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.066488  7283 raft_consensus.cc:2243] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.067649  7283 raft_consensus.cc:2272] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:18.069092 16815 consensus_peers.cc:597] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Couldn't send request to peer 02e5f1c7a2c04e36a0474d09cab07d6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:18.070372  7283 tablet_replica.cc:333] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.071154  7283 raft_consensus.cc:2243] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.071640  7283 raft_consensus.cc:2272] T 1da92e15ddbd435399bdd953d46cafe6 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.074685  7283 tablet_replica.cc:333] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.075292  7283 raft_consensus.cc:2243] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.075770  7283 raft_consensus.cc:2272] T 23d7b077834f471192e5ee5709fa48e3 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.077908  7283 tablet_replica.cc:333] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.078514  7283 raft_consensus.cc:2243] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.079001  7283 raft_consensus.cc:2272] T ccba36ba3c6149be870d4a69ca5f2674 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.080912  7283 tablet_replica.cc:333] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.081517  7283 raft_consensus.cc:2243] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.082397  7283 raft_consensus.cc:2272] T 9122434fa25e4ab18cb9cd44dc90352b P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.084527  7283 tablet_replica.cc:333] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.085100  7283 raft_consensus.cc:2243] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.085577  7283 raft_consensus.cc:2272] T c94f96ebc5c149beb9d070eb0f299780 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.087628  7283 tablet_replica.cc:333] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.088193  7283 raft_consensus.cc:2243] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.088671  7283 raft_consensus.cc:2272] T c0c5136b5a8d4c2fa67159a4cafa1705 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.090974  7283 tablet_replica.cc:333] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.091539  7283 raft_consensus.cc:2243] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.092592  7283 raft_consensus.cc:2272] T a22c54f47c1749a09c836fcc71acef94 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.095582  7283 tablet_replica.cc:333] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.096199  7283 raft_consensus.cc:2243] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.096689  7283 raft_consensus.cc:2272] T 7e6a9d0b7bec4a03a07930caa4b8737f P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.098951  7283 tablet_replica.cc:333] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.099607  7283 raft_consensus.cc:2243] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.100088  7283 raft_consensus.cc:2272] T 4a4d7ac2370b4187b67d93f795b9603c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.102427  7283 tablet_replica.cc:333] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.103160  7283 raft_consensus.cc:2243] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.103991  7283 raft_consensus.cc:2272] T 55a59fcc9437459a86a79efe5d24a14c P 02e5f1c7a2c04e36a0474d09cab07d6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.106251  7283 tablet_replica.cc:333] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f: stopping tablet replica
I20260709 13:05:18.106805  7283 raft_consensus.cc:2243] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.107252  7283 raft_consensus.cc:2272] T d84cc3b4833e4e2fbddee0ca01fd4224 P 02e5f1c7a2c04e36a0474d09cab07d6f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:18.280141 16815 consensus_peers.cc:597] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Couldn't send request to peer 02e5f1c7a2c04e36a0474d09cab07d6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.325932 16798 debug-util.cc:398] Leaking SignalData structure 0x7b08002a68c0 after lost signal to thread 7286
W20260709 13:05:18.327049 16798 debug-util.cc:398] Leaking SignalData structure 0x7b0800210a20 after lost signal to thread 16634
W20260709 13:05:18.329512 16798 debug-util.cc:398] Leaking SignalData structure 0x7b080027e1e0 after lost signal to thread 16875
W20260709 13:05:18.511292 16815 consensus_peers.cc:597] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Couldn't send request to peer 02e5f1c7a2c04e36a0474d09cab07d6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:18.798484 17160 raft_consensus.cc:493] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:18.800137 17160 raft_consensus.cc:515] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:18.803592 17160 leader_election.cc:290] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:18.809132 16816 leader_election.cc:336] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:18.810340 16815 leader_election.cc:336] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:18.810840 16815 leader_election.cc:304] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:18.811813 17160 raft_consensus.cc:2749] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:18.871946 17160 raft_consensus.cc:493] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:18.872897 17160 raft_consensus.cc:515] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:18.878458 17160 leader_election.cc:290] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:18.881109 16816 leader_election.cc:336] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:18.881953 16815 leader_election.cc:336] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:18.882467 16815 leader_election.cc:304] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:18.883406 17160 raft_consensus.cc:2749] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:18.939352 17160 raft_consensus.cc:493] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:18.940357 17160 raft_consensus.cc:515] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:18.943475 17160 leader_election.cc:290] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:18.950249 16816 leader_election.cc:336] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:18.951267 16815 leader_election.cc:336] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:18.951944 16815 leader_election.cc:304] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:18.953096 17140 raft_consensus.cc:2749] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.025266 17160 raft_consensus.cc:493] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:19.026355 17160 raft_consensus.cc:515] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
W20260709 13:05:19.037977 16815 leader_election.cc:336] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:19.039412 17160 leader_election.cc:290] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:19.042851 16816 leader_election.cc:336] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:19.043341 16816 leader_election.cc:304] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.044214 17160 raft_consensus.cc:2749] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.064445 17160 raft_consensus.cc:493] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:19.065419 17160 raft_consensus.cc:515] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:19.068879 17159 raft_consensus.cc:493] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:19.070003 17159 raft_consensus.cc:515] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:19.073136 17140 raft_consensus.cc:493] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:19.074075 17140 raft_consensus.cc:515] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
W20260709 13:05:19.075802 16815 leader_election.cc:336] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:19.076773 17140 leader_election.cc:290] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:19.077847 17159 leader_election.cc:290] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:19.069089 17160 leader_election.cc:290] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:19.082314 16816 leader_election.cc:336] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:19.083030 16816 leader_election.cc:304] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.084036 17160 raft_consensus.cc:2749] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:19.085198 16815 leader_election.cc:336] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:19.085852 16815 leader_election.cc:336] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:19.089161 16816 leader_election.cc:336] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:19.089649 16816 leader_election.cc:304] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.090540 17160 raft_consensus.cc:2749] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:19.090677 16816 leader_election.cc:336] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:19.091463 16816 leader_election.cc:304] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.092272 17160 raft_consensus.cc:2749] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:19.141686  7283 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16798)
I20260709 13:05:19.240236 17160 raft_consensus.cc:493] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:19.241323 17160 raft_consensus.cc:515] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:19.244148 17160 leader_election.cc:290] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:19.250787 16816 leader_election.cc:336] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:19.253358 16815 leader_election.cc:336] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:19.253933 16815 leader_election.cc:304] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.254885 17160 raft_consensus.cc:2749] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.280836 17160 raft_consensus.cc:493] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:19.281839 17160 raft_consensus.cc:515] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:19.284561 17160 leader_election.cc:290] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:19.289623 16816 leader_election.cc:336] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:19.292547 16815 leader_election.cc:336] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:19.293148 16815 leader_election.cc:304] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.294256 17159 raft_consensus.cc:493] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:19.294967 17160 raft_consensus.cc:2749] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.295130 17159 raft_consensus.cc:515] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:19.297948 17159 leader_election.cc:290] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:19.302825 16816 leader_election.cc:336] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:19.305238 16815 leader_election.cc:336] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:19.305745 16815 leader_election.cc:304] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.306674 17159 raft_consensus.cc:2749] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.363919 17159 raft_consensus.cc:493] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:19.364880 17159 raft_consensus.cc:515] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:19.366264 17160 raft_consensus.cc:493] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:19.367206 17160 raft_consensus.cc:515] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:19.367991 17159 leader_election.cc:290] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
I20260709 13:05:19.370030 17160 leader_election.cc:290] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:19.377692 16815 leader_election.cc:336] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:19.378427 16815 leader_election.cc:336] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:19.378734 16816 leader_election.cc:336] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:19.379277 16816 leader_election.cc:304] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.380228 17160 raft_consensus.cc:2749] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:19.380389 16816 leader_election.cc:336] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:19.381131 16816 leader_election.cc:304] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.381992 17160 raft_consensus.cc:2749] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.442442 17160 raft_consensus.cc:493] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:19.443100 17160 raft_consensus.cc:515] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:19.445083 17160 leader_election.cc:290] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:19.449134 16816 leader_election.cc:336] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:19.451031 16815 leader_election.cc:336] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:19.451421 16815 leader_election.cc:304] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.452054 17160 raft_consensus.cc:2749] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.478859 17160 raft_consensus.cc:493] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:19.479632 17160 raft_consensus.cc:515] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:19.481613 17160 leader_election.cc:290] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:19.486740 16815 leader_election.cc:336] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:19.487308 16816 leader_election.cc:336] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:19.487650 16816 leader_election.cc:304] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:19.488349 17160 raft_consensus.cc:2749] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:20.142325  7283 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16798)
W20260709 13:05:20.244673 16816 consensus_peers.cc:597] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:20.419766 17160 raft_consensus.cc:493] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:20.420521 17160 raft_consensus.cc:515] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:20.423086 17160 leader_election.cc:290] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:20.425026 16816 consensus_peers.cc:597] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.427733 16816 leader_election.cc:336] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:20.429643 16815 leader_election.cc:336] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:20.430068 16815 leader_election.cc:304] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:20.430728 17160 raft_consensus.cc:2749] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:20.515407 16816 consensus_peers.cc:597] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:20.519439 17160 raft_consensus.cc:493] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:20.520081 17160 raft_consensus.cc:515] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:20.522908 17160 leader_election.cc:290] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:20.527405 16816 leader_election.cc:336] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:20.528065 16815 leader_election.cc:336] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:20.528509 16815 leader_election.cc:304] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:20.529170 17160 raft_consensus.cc:2749] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:20.574381 16815 consensus_peers.cc:597] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Couldn't send request to peer 02e5f1c7a2c04e36a0474d09cab07d6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.579974 16816 consensus_peers.cc:597] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Couldn't send request to peer 8659f2f6302b4e8d9781d2478a5a6ab9. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.584627 16815 consensus_peers.cc:597] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Couldn't send request to peer 02e5f1c7a2c04e36a0474d09cab07d6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.654788 16815 consensus_peers.cc:597] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Couldn't send request to peer 02e5f1c7a2c04e36a0474d09cab07d6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:20.766547 17160 raft_consensus.cc:493] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:20.767161 17160 raft_consensus.cc:515] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:20.769474 17160 leader_election.cc:290] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:20.773677 16816 leader_election.cc:336] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:20.774245 16815 leader_election.cc:336] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:20.774662 16815 leader_election.cc:304] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:20.775279 17160 raft_consensus.cc:2749] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:20.856920 17160 raft_consensus.cc:493] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:20.857589 17160 raft_consensus.cc:515] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:20.860132 17160 leader_election.cc:290] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:20.864377 16816 leader_election.cc:336] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:20.866400 16815 leader_election.cc:336] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:20.866887 16815 leader_election.cc:304] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:20.867789 17160 raft_consensus.cc:2749] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:20.918946 17160 raft_consensus.cc:493] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:20.919539 17160 raft_consensus.cc:515] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:20.921679 17160 leader_election.cc:290] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:20.925561 16816 leader_election.cc:336] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:20.926111 16815 leader_election.cc:336] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:20.926563 16815 leader_election.cc:304] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:20.927311 17160 raft_consensus.cc:2749] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:20.964533 17160 raft_consensus.cc:493] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:20.965101 17160 raft_consensus.cc:515] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:20.967028 17160 leader_election.cc:290] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:20.971490 16815 leader_election.cc:336] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:20.972064 16816 leader_election.cc:336] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:20.972462 16816 leader_election.cc:304] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:20.973088 17160 raft_consensus.cc:2749] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.117151 17160 raft_consensus.cc:493] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:21.117712 17160 raft_consensus.cc:515] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:21.120116 17160 leader_election.cc:290] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:21.123809 16816 leader_election.cc:336] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:21.124944 16815 leader_election.cc:336] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:21.125278 16815 leader_election.cc:304] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:21.125885 17160 raft_consensus.cc:2749] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:21.142913  7283 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16798)
W20260709 13:05:21.210413 16815 consensus_peers.cc:597] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea -> Peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Couldn't send request to peer 02e5f1c7a2c04e36a0474d09cab07d6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:21.212482 17160 raft_consensus.cc:493] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:21.213078 17160 raft_consensus.cc:515] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:21.215464 17160 leader_election.cc:290] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:21.219435 16816 leader_election.cc:336] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:21.220139 16815 leader_election.cc:336] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:21.220503 16815 leader_election.cc:304] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:21.221091 17160 raft_consensus.cc:2749] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.234926 17160 raft_consensus.cc:493] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:21.235471 17160 raft_consensus.cc:515] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:21.237473 17160 leader_election.cc:290] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:21.241847 16815 leader_election.cc:336] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:21.242841 16816 leader_election.cc:336] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:21.243206 16816 leader_election.cc:304] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:21.243844 17160 raft_consensus.cc:2749] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.250411 17160 raft_consensus.cc:493] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:21.250946 17160 raft_consensus.cc:515] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:21.252924 17160 leader_election.cc:290] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:21.256613 16816 leader_election.cc:336] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:21.257772 16815 leader_election.cc:336] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:21.258257 16815 leader_election.cc:304] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:21.258975 17160 raft_consensus.cc:2749] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.352278 17160 raft_consensus.cc:493] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8659f2f6302b4e8d9781d2478a5a6ab9)
I20260709 13:05:21.352850 17160 raft_consensus.cc:515] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } }
I20260709 13:05:21.354809 17160 leader_election.cc:290] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:21.359705 16815 leader_election.cc:336] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:21.360278 16816 leader_election.cc:336] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:21.360661 16816 leader_election.cc:304] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:21.361263 17160 raft_consensus.cc:2749] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.417409 17160 raft_consensus.cc:493] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:21.417963 17160 raft_consensus.cc:515] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:21.420173 17160 leader_election.cc:290] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:21.424865 16816 leader_election.cc:336] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
W20260709 13:05:21.425422 16815 leader_election.cc:336] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
I20260709 13:05:21.425838 16815 leader_election.cc:304] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:21.426502 17160 raft_consensus.cc:2749] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.498883 17160 raft_consensus.cc:493] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:21.499523 17160 raft_consensus.cc:515] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:21.501740 17160 leader_election.cc:290] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:21.506495 16815 leader_election.cc:336] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:21.506942 16816 leader_election.cc:336] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:21.507396 16816 leader_election.cc:304] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:21.508139 17160 raft_consensus.cc:2749] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.622344 17160 raft_consensus.cc:493] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 02e5f1c7a2c04e36a0474d09cab07d6f)
I20260709 13:05:21.622903 17160 raft_consensus.cc:515] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8659f2f6302b4e8d9781d2478a5a6ab9" member_type: VOTER last_known_addr { host: "127.7.28.193" port: 39551 } } peers { permanent_uuid: "02e5f1c7a2c04e36a0474d09cab07d6f" member_type: VOTER last_known_addr { host: "127.7.28.194" port: 41969 } } peers { permanent_uuid: "3a25c0c95ca84b3d825ca1b83606ebea" member_type: VOTER last_known_addr { host: "127.7.28.195" port: 33787 } }
I20260709 13:05:21.624692 17160 leader_election.cc:290] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551), 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969)
W20260709 13:05:21.628855 16815 leader_election.cc:336] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 02e5f1c7a2c04e36a0474d09cab07d6f (127.7.28.194:41969): Network error: Client connection negotiation failed: client connection to 127.7.28.194:41969: connect: Connection refused (error 111)
W20260709 13:05:21.629472 16816 leader_election.cc:336] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8659f2f6302b4e8d9781d2478a5a6ab9 (127.7.28.193:39551): Network error: Client connection negotiation failed: client connection to 127.7.28.193:39551: connect: Connection refused (error 111)
I20260709 13:05:21.629892 16816 leader_election.cc:304] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a25c0c95ca84b3d825ca1b83606ebea; no voters: 02e5f1c7a2c04e36a0474d09cab07d6f, 8659f2f6302b4e8d9781d2478a5a6ab9
I20260709 13:05:21.630836 17160 raft_consensus.cc:2749] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.971161  7283 tablet_server.cc:196] TabletServer@127.7.28.194:0 shutdown complete.
I20260709 13:05:22.040665  7283 tablet_server.cc:179] TabletServer@127.7.28.195:0 shutting down...
I20260709 13:05:22.080345  7283 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:22.081611  7283 tablet_replica.cc:333] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.083067  7283 raft_consensus.cc:2243] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.084038  7283 raft_consensus.cc:2272] T a27610a2696d4a458326d18fe58a4e62 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.086947  7283 tablet_replica.cc:333] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.087651  7283 raft_consensus.cc:2243] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.088624  7283 raft_consensus.cc:2272] T 2c6d79c49b7a4dcd9818ff6f6231c403 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.091367  7283 tablet_replica.cc:333] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.092015  7283 raft_consensus.cc:2243] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.092549  7283 raft_consensus.cc:2272] T 25f4d3e0f81c47e2a7c63f9be90034e6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.095206  7283 tablet_replica.cc:333] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.095775  7283 raft_consensus.cc:2243] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.096354  7283 raft_consensus.cc:2272] T e458f2e3eaf14777acd86b33e508e50d P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.098984  7283 tablet_replica.cc:333] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.099612  7283 raft_consensus.cc:2243] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.100270  7283 raft_consensus.cc:2272] T 21e2f5f2d73d49aba6616c9febfe2560 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.103045  7283 tablet_replica.cc:333] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.103724  7283 raft_consensus.cc:2243] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.104417  7283 raft_consensus.cc:2272] T ccba36ba3c6149be870d4a69ca5f2674 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.107126  7283 tablet_replica.cc:333] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.107828  7283 raft_consensus.cc:2243] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.108530  7283 raft_consensus.cc:2272] T 52e07e20704e4218962167488ee3b012 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.111281  7283 tablet_replica.cc:333] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.111914  7283 raft_consensus.cc:2243] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.112491  7283 raft_consensus.cc:2272] T 9122434fa25e4ab18cb9cd44dc90352b P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.115477  7283 tablet_replica.cc:333] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.116197  7283 raft_consensus.cc:2243] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.117180  7283 raft_consensus.cc:2272] T c94f96ebc5c149beb9d070eb0f299780 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.119763  7283 tablet_replica.cc:333] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.120340  7283 raft_consensus.cc:2243] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.120855  7283 raft_consensus.cc:2272] T 5b4b1932601c46d5a2e0d5b5adaf43f6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.123461  7283 tablet_replica.cc:333] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.124025  7283 raft_consensus.cc:2243] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.124570  7283 raft_consensus.cc:2272] T 23d7b077834f471192e5ee5709fa48e3 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.127096  7283 tablet_replica.cc:333] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.127602  7283 raft_consensus.cc:2243] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.128572  7283 raft_consensus.cc:2272] T 1da92e15ddbd435399bdd953d46cafe6 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.131803  7283 tablet_replica.cc:333] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.132441  7283 raft_consensus.cc:2243] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.133472  7283 raft_consensus.cc:2272] T d84cc3b4833e4e2fbddee0ca01fd4224 P 3a25c0c95ca84b3d825ca1b83606ebea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.136251  7283 tablet_replica.cc:333] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.136823  7283 raft_consensus.cc:2243] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.137300  7283 raft_consensus.cc:2272] T 55a59fcc9437459a86a79efe5d24a14c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.139875  7283 tablet_replica.cc:333] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.140501  7283 raft_consensus.cc:2243] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.141005  7283 raft_consensus.cc:2272] T c0c5136b5a8d4c2fa67159a4cafa1705 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.143500  7283 tablet_replica.cc:333] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.144035  7283 raft_consensus.cc:2243] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.144498  7283 raft_consensus.cc:2272] T 4a4d7ac2370b4187b67d93f795b9603c P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.147094  7283 tablet_replica.cc:333] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.147604  7283 raft_consensus.cc:2243] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.148080  7283 raft_consensus.cc:2272] T a22c54f47c1749a09c836fcc71acef94 P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.150911  7283 tablet_replica.cc:333] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea: stopping tablet replica
I20260709 13:05:22.151415  7283 raft_consensus.cc:2243] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.152030  7283 raft_consensus.cc:2272] T 7e6a9d0b7bec4a03a07930caa4b8737f P 3a25c0c95ca84b3d825ca1b83606ebea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.199491  7283 tablet_server.cc:196] TabletServer@127.7.28.195:0 shutdown complete.
I20260709 13:05:22.248250  7283 master.cc:562] Master@127.7.28.254:40649 shutting down...
I20260709 13:05:22.278825  7283 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.279469  7283 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.279814  7283 tablet_replica.cc:333] T 00000000000000000000000000000000 P d4a57ababed846959d36c873a4e77034: stopping tablet replica
I20260709 13:05:22.319541  7283 master.cc:584] Master@127.7.28.254:40649 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (15575 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (28389 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (272826 ms total)
[  PASSED  ] 8 tests.
I20260709 13:05:22.379828  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 520 messages since previous log ~18 seconds ago
I20260709 13:05:22.380039  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 520 messages since previous log ~18 seconds ago
I20260709 13:05:22.380177  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 516 messages since previous log ~18 seconds ago
I20260709 13:05:22.380334  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~43 seconds ago
I20260709 13:05:22.380476  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~43 seconds ago
I20260709 13:05:22.380614  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~85 seconds ago
I20260709 13:05:22.380754  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~192 seconds ago
I20260709 13:05:22.380908  7283 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~229 seconds ago
I20260709 13:05:22.381038  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~229 seconds ago
I20260709 13:05:22.381217  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 126 messages since previous log ~4 seconds ago
I20260709 13:05:22.381448  7283 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~14 seconds ago
